Jul 21 14:59:08.752906 ip-10-0-130-165 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 14:59:09.090984 ip-10-0-130-165 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 14:59:09.090984 ip-10-0-130-165 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 14:59:09.090984 ip-10-0-130-165 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 14:59:09.090984 ip-10-0-130-165 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 14:59:09.090984 ip-10-0-130-165 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 14:59:09.093302 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.093237    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 14:59:09.097943 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097923    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 14:59:09.097943 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097939    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 14:59:09.097943 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097944    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 14:59:09.097943 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097947    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 14:59:09.097943 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097950    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097954    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097957    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097960    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097963    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097966    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097968    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097971    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097974    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097977    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097981    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097984    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097987    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097990    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097993    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097996    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.097998    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098000    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098003    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 14:59:09.098139 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098005    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098007    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098010    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098013    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098015    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098018    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098020    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098023    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098029    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098032    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098034    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098037    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098040    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098042    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098044    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098047    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098049    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098053    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098055    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098057    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 14:59:09.098587 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098060    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098063    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098065    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098068    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098070    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098073    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098076    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098079    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098082    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098084    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098094    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098098    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098100    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098102    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098105    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098108    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098110    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098113    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098115    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098118    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 14:59:09.099129 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098121    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098123    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098126    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098128    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098131    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098133    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098136    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098139    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098142    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098145    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098147    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098150    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098153    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098156    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098158    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098160    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098165    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098169    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098172    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 14:59:09.099611 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098175    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098178    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098182    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098186    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098189    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098192    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098194    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098197    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098200    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098203    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098205    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098208    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098211    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098214    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098217    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098220    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.098223    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099386    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099393    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099397    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 14:59:09.100088 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099400    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099403    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099406    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099409    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099411    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099414    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099417    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099419    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099422    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099424    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099427    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099429    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099432    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099435    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099437    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099440    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099442    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099445    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099447    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099450    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 14:59:09.100578 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099452    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099455    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099457    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099460    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099462    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099465    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099468    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099470    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099473    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099475    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099478    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099480    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099483    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099485    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099488    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099490    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099493    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099495    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099498    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099501    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 14:59:09.101084 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099503    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099506    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099508    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099510    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099513    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099515    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099517    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099520    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099522    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099525    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099527    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099531    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099534    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099537    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099539    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099541    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099544    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099547    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099549    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 14:59:09.101600 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099552    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099555    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099558    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099561    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099565    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099568    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099570    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099573    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099576    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099578    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099581    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099584    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099587    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099589    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099592    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099595    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099598    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099600    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099603    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 14:59:09.102080 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099606    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099610    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099614    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099617    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099620    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099624    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099627    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099630    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099632    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099635    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099637    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099640    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099643    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099646    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099648    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099651    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099653    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.099674    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100039    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 14:59:09.102568 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100044    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100046    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100050    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100052    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100055    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100057    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100060    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100062    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100065    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100067    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100070    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100074    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100077    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100080    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100083    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100086    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100089    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100092    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100095    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100098    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 14:59:09.103047 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100100    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100103    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100106    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100109    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100112    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100115    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100117    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100120    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100123    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100125    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100128    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100131    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100134    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100136    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100139    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100141    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100143    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100154    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100158    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 14:59:09.103531 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100161    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100163    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100166    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100168    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100171    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100174    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100176    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100179    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100181    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100184    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100187    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100189    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100192    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100194    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100196    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100199    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100201    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100204    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100206    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100208    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 14:59:09.103996 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100211    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100213    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100215    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100218    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100220    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100223    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100225    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100228    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100231    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100233    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100235    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100239    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100242    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100245    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100247    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100249    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100252    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100255    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100257    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100260    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 14:59:09.104466 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100262    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100264    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100273    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100276    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100278    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100280    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100283    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100285    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100288    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100291    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100294    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100296    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100299    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100302    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100304    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100307    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100309    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100312    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100314    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100378    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 14:59:09.104981 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100385    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100389    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100393    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100397    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100402    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100406    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100410    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100413    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100415    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100419    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100422    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100424    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100427    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100430    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100433    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100441    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100444    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100451    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100454    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100457    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100459    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100462    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100466    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 14:59:09.105454 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100469    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100472    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100475    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100478    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100480    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100484    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100487    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100489    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100493    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100496    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100498    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100501    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100504    2562 flags.go:64] FLAG: --enable-server="true"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100508    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100516    2562 flags.go:64] FLAG: --event-burst="100"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100519    2562 flags.go:64] FLAG: --event-qps="50"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100522    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100524    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100527    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100530    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100533    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100536    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100539    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100541    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100544    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 14:59:09.106013 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100547    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100550    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100552    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100555    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100557    2562 flags.go:64] FLAG: --feature-gates=""
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100561    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100564    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100567    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100569    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100573    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100575    2562 flags.go:64] FLAG: --help="false"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100578    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100583    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100590    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100593    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100596    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100599    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100602    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100605    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100607    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100611    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100614    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100617    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100620    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 21 14:59:09.106734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100622    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100625    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100628    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100631    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100633    2562 flags.go:64] FLAG: --lock-file=""
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100636    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100639    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100642    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100647    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100650    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100653    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100673    2562 flags.go:64] FLAG: --logging-format="text"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100676    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100679    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100682    2562 flags.go:64] FLAG: --manifest-url=""
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100685    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100689    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100691    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100695    2562 flags.go:64] FLAG: --max-pods="110"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100698    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100702    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100705    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100708    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100711    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100713    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 14:59:09.107633 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100716    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100724    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100727    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100731    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100734    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100736    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100742    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100745    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100747    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100750    2562 flags.go:64] FLAG: --port="10250"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100753    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100756    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e2af126e49ff997"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100759    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100762    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100765    2562 flags.go:64] FLAG: --register-node="true"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100767    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100771    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100774    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100777    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100779    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100783    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100786    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100788    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100791    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100794    2562 flags.go:64] FLAG: --runonce="false"
Jul 21 14:59:09.108719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100797    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100799    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100802    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100806    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100809    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100812    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100815    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100817    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100820    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100823    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100826    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100829    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100832    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100834    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100837    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100842    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100844    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100847    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100851    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100854    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100856    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100859    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100862    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100865    2562 flags.go:64] FLAG: --v="2"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100868    2562 flags.go:64] FLAG: --version="false"
Jul 21 14:59:09.109791 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100873    2562 flags.go:64] FLAG: --vmodule=""
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100876    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.100879    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100995    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.100998    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101001    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101004    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101007    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101009    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101012    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101015    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101018    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101020    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101023    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101026    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101028    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101030    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101035    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101037    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101039    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 14:59:09.110899 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101042    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101044    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101047    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101050    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101052    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101055    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101057    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101060    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101063    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101065    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101067    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101070    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101072    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101075    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101077    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101080    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101082    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101084    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101087    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101089    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 14:59:09.111565 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101092    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101095    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101099    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101102    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101105    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101107    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101109    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101112    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101114    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101118    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101121    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101123    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101126    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101129    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101131    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101134    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101136    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101139    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101141    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 14:59:09.112414 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101144    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101146    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101148    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101153    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101156    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101159    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101162    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101165    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101167    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101170    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101172    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101175    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101177    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101180    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101182    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101185    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101188    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101190    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 14:59:09.113168 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101194    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101198    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101202    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101205    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101210    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101213    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101216    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101218    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101221    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101224    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101227    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101229    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101232    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101234    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101237    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101239    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101242    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101244    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101247    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101249    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 14:59:09.113717 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101251    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101254    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101257    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101259    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.101262    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.101941    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.109529    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.109547    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.109574    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.109583    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109684    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109692    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109696    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109700    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109705    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 14:59:09.114243 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109709    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109713    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109717    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109722    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109726    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109730    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109734    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109738    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109742    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109747    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109751    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109755    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109759    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109763    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109767    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109772    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109776    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109780    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109785    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109789    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 14:59:09.114648 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109793    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109797    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109800    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109804    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109811    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109815    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109819    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109823    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109827    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109831    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109834    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109838    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109843    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109847    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109850    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109855    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109858    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109863    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109867    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109871    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 14:59:09.115208 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109874    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109879    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109883    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109887    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109891    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109897    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109903    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109908    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109912    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109917    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109921    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109926    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109930    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109935    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109940    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109944    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109949    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109954    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109958    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 14:59:09.115745 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109962    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109969    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109974    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109979    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109983    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109987    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109991    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109995    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.109999    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110003    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110007    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110011    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110015    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110019    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110023    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110027    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110031    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110035    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110039    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 14:59:09.116240 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110045    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110049    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110054    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110058    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110062    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110066    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110070    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110074    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110078    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110082    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110094    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110099    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110104    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110108    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110111    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 14:59:09.116768 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110116    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.110123    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110323    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110331    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110336    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110341    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110345    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110352    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110358    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110363    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110367    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110371    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110376    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110380    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110385    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 14:59:09.117292 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110390    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110394    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110398    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110402    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110406    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110410    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110414    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110418    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110422    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110426    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110430    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110434    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110439    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110443    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110447    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110452    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110456    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110460    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110464    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110468    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 14:59:09.117936 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110472    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110477    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110481    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110485    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110489    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110493    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110497    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110501    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110505    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110509    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110513    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110518    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110522    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110526    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110530    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110534    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110538    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110542    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110546    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110549    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 14:59:09.118798 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110554    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110558    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110562    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110566    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110571    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110575    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110579    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110584    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110588    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110592    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110596    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110600    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110605    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110608    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110612    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110616    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110620    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110625    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110628    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 14:59:09.119492 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110632    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110636    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110640    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110645    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110649    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110652    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110679    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110683    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110687    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110691    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110695    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110699    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110703    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110707    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110711    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110715    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110719    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110723    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110730    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110734    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 14:59:09.120034 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110738    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110744    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110751    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110755    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110760    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110764    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:09.110770    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.110778    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.110915    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.113584    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.115002    2562 server.go:1019] "Starting client certificate rotation"
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.115101    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 14:59:09.120535 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.115164    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 14:59:09.120864 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.117613    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 14:59:09.120864 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.119280    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 14:59:09.128261 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.128242    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 21 14:59:09.131627 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.131609    2562 log.go:25] "Validated CRI v1 image API"
Jul 21 14:59:09.133213 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.133199    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 14:59:09.135324 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.135306    2562 fs.go:135] Filesystem UUIDs: map[068a7191-7023-434f-9413-3eb5eb1eb770:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 daa800cd-645d-488f-bde6-66c01d3cd8d8:/dev/nvme0n1p3]
Jul 21 14:59:09.135383 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.135324    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 14:59:09.139428 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.139297    2562 manager.go:216] Machine: {Timestamp:2026-07-21 14:59:09.138807507 +0000 UTC m=+0.282720468 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099996 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec258e30835bfd832aed488c7f244c32 SystemUUID:ec258e30-835b-fd83-2aed-488c7f244c32 BootID:e560f010-3f17-4072-a5df-b870792ef59b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:73:1e:55:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:73:1e:55:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:a6:e8:60:6c:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 14:59:09.139428 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.139418    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 14:59:09.139526 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.139499    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 14:59:09.142224 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.142201    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 14:59:09.142343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.142225    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 14:59:09.142893 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.142882    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 14:59:09.142934 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.142896    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 14:59:09.142934 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.142903    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 14:59:09.142934 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.142914    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 14:59:09.144291 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.144281    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 14:59:09.146213 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.146196    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 14:59:09.148378 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148366    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 14:59:09.148620 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148610    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 14:59:09.148653 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148641    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 14:59:09.148653 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148666    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 14:59:09.148730 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148682    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 14:59:09.148730 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148692    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 21 14:59:09.148730 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148704    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 14:59:09.148998 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.148986    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 14:59:09.149039 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.149004    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 14:59:09.150771 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.150756    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 14:59:09.152252 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.152235    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 14:59:09.152337 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.152274    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 14:59:09.152980 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.152967    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.152985    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.152993    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153002    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153013    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153021    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153032    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 14:59:09.153044 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153042    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 14:59:09.153343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153051    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 14:59:09.153343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153059    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 14:59:09.153343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153079    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 14:59:09.153343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153088    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 14:59:09.153343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153118    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 14:59:09.153343 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.153126    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 14:59:09.156173 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.156156    2562 server.go:1268] "Started kubelet"
Jul 21 14:59:09.156329 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.156276    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 14:59:09.156390 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.156352    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 14:59:09.156468 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.156422    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 14:59:09.156822 ip-10-0-130-165 systemd[1]: Started Kubernetes Kubelet.
Jul 21 14:59:09.157597 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.157576    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 14:59:09.158455 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.158442    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 14:59:09.161997 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.161970    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 14:59:09.163283 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.163264    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 14:59:09.163832 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.163800    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 14:59:09.163875 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.163800    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 14:59:09.164048 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.163284    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-165.ec2.internal.18c45609094a5cda  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-165.ec2.internal,UID:ip-10-0-130-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-165.ec2.internal,},FirstTimestamp:2026-07-21 14:59:09.156121818 +0000 UTC m=+0.300034779,LastTimestamp:2026-07-21 14:59:09.156121818 +0000 UTC m=+0.300034779,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-165.ec2.internal,}"
Jul 21 14:59:09.167311 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.167288    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 14:59:09.167311 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.167296    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 14:59:09.167469 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.167439    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.167919 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.167897    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 14:59:09.167995 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.167923    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 14:59:09.167995 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.167900    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 14:59:09.168105 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168018    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 14:59:09.168105 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168026    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 14:59:09.168270 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168252    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 14:59:09.168270 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168269    2562 factory.go:55] Registering systemd factory
Jul 21 14:59:09.168409 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168277    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 21 14:59:09.168570 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168542    2562 factory.go:153] Registering CRI-O factory
Jul 21 14:59:09.168672 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168577    2562 factory.go:223] Registration of the crio container factory successfully
Jul 21 14:59:09.168672 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168601    2562 factory.go:103] Registering Raw factory
Jul 21 14:59:09.168672 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168616    2562 manager.go:1196] Started watching for new ooms in manager
Jul 21 14:59:09.168969 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.168954    2562 manager.go:349] Starting recovery of all containers
Jul 21 14:59:09.171418 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.171395    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 14:59:09.171497 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.171453    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 14:59:09.177401 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.177263    2562 manager.go:354] Recovery completed
Jul 21 14:59:09.181994 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.181982    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.183914 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.183886    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.183985 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.183924    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.183985 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.183934    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.184385 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.184370    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 14:59:09.184385 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.184384    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 14:59:09.184483 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.184398    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 14:59:09.184483 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.184438    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.185112 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.185097    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.185191 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.185127    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.185191 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.185152    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.186569 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.186554    2562 policy_none.go:49] "None policy: Start"
Jul 21 14:59:09.186635 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.186579    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 14:59:09.186635 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.186590    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 14:59:09.186904 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.186337    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-165.ec2.internal.18c456090af2680d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-165.ec2.internal,UID:ip-10-0-130-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-165.ec2.internal,},FirstTimestamp:2026-07-21 14:59:09.183911949 +0000 UTC m=+0.327824910,LastTimestamp:2026-07-21 14:59:09.183911949 +0000 UTC m=+0.327824910,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-165.ec2.internal,}"
Jul 21 14:59:09.188614 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.188600    2562 policy_none.go:47] "Start"
Jul 21 14:59:09.195253 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.195181    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-165.ec2.internal.18c456090af2a959  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-165.ec2.internal,UID:ip-10-0-130-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-165.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-165.ec2.internal,},FirstTimestamp:2026-07-21 14:59:09.183928665 +0000 UTC m=+0.327841630,LastTimestamp:2026-07-21 14:59:09.183928665 +0000 UTC m=+0.327841630,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-165.ec2.internal,}"
Jul 21 14:59:09.197778 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.197719    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-165.ec2.internal.18c456090af2ce4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-165.ec2.internal,UID:ip-10-0-130-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-165.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-165.ec2.internal,},FirstTimestamp:2026-07-21 14:59:09.183938124 +0000 UTC m=+0.327851086,LastTimestamp:2026-07-21 14:59:09.183938124 +0000 UTC m=+0.327851086,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-165.ec2.internal,}"
Jul 21 14:59:09.201484 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.201461    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dkv7m"
Jul 21 14:59:09.206558 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.206501    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-165.ec2.internal.18c456090af2680d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-165.ec2.internal.18c456090af2680d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-165.ec2.internal,UID:ip-10-0-130-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-165.ec2.internal,},FirstTimestamp:2026-07-21 14:59:09.183911949 +0000 UTC m=+0.327824910,LastTimestamp:2026-07-21 14:59:09.185112376 +0000 UTC m=+0.329025344,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-165.ec2.internal,}"
Jul 21 14:59:09.209168 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.209087    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-165.ec2.internal.18c456090af2a959\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-165.ec2.internal.18c456090af2a959  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-165.ec2.internal,UID:ip-10-0-130-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-165.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-165.ec2.internal,},FirstTimestamp:2026-07-21 14:59:09.183928665 +0000 UTC m=+0.327841630,LastTimestamp:2026-07-21 14:59:09.185133945 +0000 UTC m=+0.329046907,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-165.ec2.internal,}"
Jul 21 14:59:09.210172 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.210153    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dkv7m"
Jul 21 14:59:09.221254 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221240    2562 manager.go:337] "Starting Device Plugin manager"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.221267    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221276    2562 server.go:87] "Starting device plugin registration server"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221475    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221486    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221587    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221687    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.221697    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.222112    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 14:59:09.243575 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.222153    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.290597 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.290570    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 14:59:09.291886 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.291868    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 14:59:09.291952 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.291914    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 14:59:09.291952 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.291937    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 14:59:09.292042 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.291975    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 14:59:09.294779 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.294757    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 14:59:09.321917 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.321901    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.322787 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.322774    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.322858 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.322800    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.322858 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.322813    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.322858 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.322838    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.334158 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.334140    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.334244 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.334162    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-165.ec2.internal\": node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.362108 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.362059    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.392962 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.392942    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"]
Jul 21 14:59:09.393032 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.393002    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.394328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.394314    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.394413 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.394342    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.394413 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.394358    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.396669 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.396641    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.396811 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.396797    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.396859 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.396823    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.397354 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.397337    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.397421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.397367    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.397421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.397379    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.397421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.397386    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.397421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.397403    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.397421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.397412    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.399746 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.399732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.399829 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.399761    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:09.400368 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.400355    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:09.400435 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.400379    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:09.400435 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.400394    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:09.421188 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.421167    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-165.ec2.internal\" not found" node="ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.425367 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.425354    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-165.ec2.internal\" not found" node="ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.462786 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.462770    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.470120 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.470099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7530766705a66ef33547ad56463ffe71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal\" (UID: \"7530766705a66ef33547ad56463ffe71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.470176 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.470129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7530766705a66ef33547ad56463ffe71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal\" (UID: \"7530766705a66ef33547ad56463ffe71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.470176 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.470147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1faa3d6ac6af8dc03734d559d6e87e75-config\") pod \"kube-apiserver-proxy-ip-10-0-130-165.ec2.internal\" (UID: \"1faa3d6ac6af8dc03734d559d6e87e75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.563876 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.563855    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.571196 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.571172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7530766705a66ef33547ad56463ffe71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal\" (UID: \"7530766705a66ef33547ad56463ffe71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.571278 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.571204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7530766705a66ef33547ad56463ffe71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal\" (UID: \"7530766705a66ef33547ad56463ffe71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.571278 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.571228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1faa3d6ac6af8dc03734d559d6e87e75-config\") pod \"kube-apiserver-proxy-ip-10-0-130-165.ec2.internal\" (UID: \"1faa3d6ac6af8dc03734d559d6e87e75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.571278 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.571273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7530766705a66ef33547ad56463ffe71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal\" (UID: \"7530766705a66ef33547ad56463ffe71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.571404 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.571284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7530766705a66ef33547ad56463ffe71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal\" (UID: \"7530766705a66ef33547ad56463ffe71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.571404 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.571278    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1faa3d6ac6af8dc03734d559d6e87e75-config\") pod \"kube-apiserver-proxy-ip-10-0-130-165.ec2.internal\" (UID: \"1faa3d6ac6af8dc03734d559d6e87e75\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.664632 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.664585    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.723147 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.723123    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.729090 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.729072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:09.765634 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.765609    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.866176 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.866151    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.966705 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:09.966637    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:09.982952 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:09.982922    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 14:59:10.067382 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:10.067357    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:10.114723 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.114701    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 14:59:10.115233 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.114834    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 14:59:10.115233 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.114873    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 14:59:10.168161 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:10.168133    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:10.218421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.218363    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 14:54:09 +0000 UTC" deadline="2028-01-09 10:31:17.194473653 +0000 UTC"
Jul 21 14:59:10.218421 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.218387    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12883h32m6.976089346s"
Jul 21 14:59:10.266693 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.266669    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 14:59:10.267710 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.267689    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 14:59:10.267811 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.267726    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 14:59:10.267811 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.267743    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeHasSufficientPID"
Jul 21 14:59:10.268913 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:10.268895    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:10.369672 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:10.369632    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:10.421640 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.421621    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 14:59:10.467065 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:10.467038    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7530766705a66ef33547ad56463ffe71.slice/crio-6daa8734d3053ff1620332ba1408e5fc10da7b0c411254ac86539786434d459b WatchSource:0}: Error finding container 6daa8734d3053ff1620332ba1408e5fc10da7b0c411254ac86539786434d459b: Status 404 returned error can't find the container with id 6daa8734d3053ff1620332ba1408e5fc10da7b0c411254ac86539786434d459b
Jul 21 14:59:10.467385 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:10.467365    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1faa3d6ac6af8dc03734d559d6e87e75.slice/crio-f63ed0f2486a5424a9dd91081c8c75e48ad4748fc42d3818d7938e3f383ba6c2 WatchSource:0}: Error finding container f63ed0f2486a5424a9dd91081c8c75e48ad4748fc42d3818d7938e3f383ba6c2: Status 404 returned error can't find the container with id f63ed0f2486a5424a9dd91081c8c75e48ad4748fc42d3818d7938e3f383ba6c2
Jul 21 14:59:10.470112 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:10.470082    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-165.ec2.internal\" not found"
Jul 21 14:59:10.472317 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.472306    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 14:59:10.486855 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.486839    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 14:59:10.567857 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.567776    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:10.583578 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.583561    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 14:59:10.587362 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.587349    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal"
Jul 21 14:59:10.598317 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:10.598303    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 14:59:11.149637 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.149616    2562 apiserver.go:52] "Watching apiserver"
Jul 21 14:59:11.157054 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.157017    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 14:59:11.158131 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.158108    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kjj7b","openshift-dns/node-resolver-z9ddg","openshift-image-registry/node-ca-8b46b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal","openshift-multus/network-metrics-daemon-4wcwv","openshift-network-diagnostics/network-check-target-6pbzp","openshift-ovn-kubernetes/ovnkube-node-2chhr","kube-system/global-pull-secret-syncer-nmwvs","kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd","openshift-cluster-node-tuning-operator/tuned-7swj6","openshift-multus/multus-additional-cni-plugins-gjtp6","openshift-multus/multus-kdjg5","openshift-network-operator/iptables-alerter-f684m"]
Jul 21 14:59:11.161973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.161955    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.164630 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.164609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.164861 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.164836    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 14:59:11.165227 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.165203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.165403 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.165377    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qjstg\""
Jul 21 14:59:11.165649 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.165634    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.166839 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.166815    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 14:59:11.166950 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.166880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.167476 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.167069    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.167476 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.167094    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2wc5m\""
Jul 21 14:59:11.167476 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.167188    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.167817 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.167800    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 14:59:11.168263 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.168248    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 14:59:11.168948 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.168922    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 14:59:11.169260 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.169237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.169260 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.169237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.169418 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.169372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.169418 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.169410    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5t5n7\""
Jul 21 14:59:11.171541 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.171519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.171637 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.171592    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:11.171746 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.171725    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.171886 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.171869    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 14:59:11.171958 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.171921    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.172021 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.172010    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmq5k\""
Jul 21 14:59:11.173903 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.173884    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:11.173997 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.173970    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:11.176878 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.176862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.176971 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.176924    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:11.178387 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-k8s-cni-cncf-io\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178497 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-kubelet\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178497 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cblmj\" (UniqueName: \"kubernetes.io/projected/f3528059-be51-4b52-a652-06d83081f9b0-kube-api-access-cblmj\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178497 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-socket-dir-parent\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178497 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-netns\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178714 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90305bc8-6179-449f-9661-caab6b72bcfb-host-slash\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.178714 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.178714 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-sys-fs\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.178714 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3528059-be51-4b52-a652-06d83081f9b0-cni-binary-copy\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178873 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-multus-certs\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178873 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.178873 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpkp\" (UniqueName: \"kubernetes.io/projected/ff0624d0-aca7-4737-bc11-df19765067fd-kube-api-access-zbpkp\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.178873 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-cni-multus\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178873 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-hostroot\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.178873 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90305bc8-6179-449f-9661-caab6b72bcfb-iptables-alerter-script\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-socket-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-device-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-cnibin\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.178993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-cni-bin\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtfb2\" (UniqueName: \"kubernetes.io/projected/90305bc8-6179-449f-9661-caab6b72bcfb-kube-api-access-vtfb2\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-registration-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-system-cni-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179103    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.179152 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-conf-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3528059-be51-4b52-a652-06d83081f9b0-multus-daemon-config\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-cni-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-etc-kubernetes\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff0624d0-aca7-4737-bc11-df19765067fd-serviceca\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff0624d0-aca7-4737-bc11-df19765067fd-host\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c52wx\" (UniqueName: \"kubernetes.io/projected/96300030-04ca-4b6f-bafe-b145d04f5e1b-kube-api-access-c52wx\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.179610 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.179363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-os-release\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.180447 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.180421    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.182221    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.182424    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.182552    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.182965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.183026    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.183066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.183555    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.183734 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.183685    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jxxxb\""
Jul 21 14:59:11.185576 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.185529    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.185829 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.185805    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.185829 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.185814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.185975 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.185870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qtm5r\""
Jul 21 14:59:11.188250 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.188228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.188683 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.188645    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 14:59:11.188903 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.188888    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6ftlf\""
Jul 21 14:59:11.189745 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.189728    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 14:59:11.190526 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.190498    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 14:59:11.190850 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.190575    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.191018 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.191001    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 14:59:11.191172 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.191153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-29vqq\""
Jul 21 14:59:11.192828 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.192807    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 14:59:11.193127 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.193109    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 14:59:11.193127 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.193121    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9g589\""
Jul 21 14:59:11.209252 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.209239    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnf9c"
Jul 21 14:59:11.218277 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.218255    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xnf9c"
Jul 21 14:59:11.269134 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.269117    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 14:59:11.280124 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-cni-bin\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.280189 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fm76\" (UniqueName: \"kubernetes.io/projected/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-kube-api-access-6fm76\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.280189 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-var-lib-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.280189 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpn9m\" (UniqueName: \"kubernetes.io/projected/7a649524-6475-4197-8e38-7f2403384c34-kube-api-access-bpn9m\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.280328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-hostroot\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90305bc8-6179-449f-9661-caab6b72bcfb-iptables-alerter-script\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.280328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.280328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-cni-bin\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-hostroot\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280328 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghbw\" (UniqueName: \"kubernetes.io/projected/05bc38b3-36fc-4d42-9971-93a8eb9759a9-kube-api-access-cghbw\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-modprobe-d\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-cni-bin\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-slash\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-registration-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-conf-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3528059-be51-4b52-a652-06d83081f9b0-multus-daemon-config\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280557    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-conf-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.280579 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-registration-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bc38b3-36fc-4d42-9971-93a8eb9759a9-tmp-dir\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f-konnectivity-ca\") pod \"konnectivity-agent-kjj7b\" (UID: \"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f\") " pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-run\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-systemd-units\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-cni-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-etc-kubernetes\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff0624d0-aca7-4737-bc11-df19765067fd-serviceca\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-systemd\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-cni-netd\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-env-overrides\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-cni-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff0624d0-aca7-4737-bc11-df19765067fd-host\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90305bc8-6179-449f-9661-caab6b72bcfb-iptables-alerter-script\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysconfig\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.281072 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-run-netns\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-ovn\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-etc-kubernetes\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.280983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-ovnkube-config\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff0624d0-aca7-4737-bc11-df19765067fd-host\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-socket-dir-parent\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-netns\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3528059-be51-4b52-a652-06d83081f9b0-multus-daemon-config\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f-agent-certs\") pod \"konnectivity-agent-kjj7b\" (UID: \"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f\") " pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-netns\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-multus-socket-dir-parent\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-lib-modules\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-node-log\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3528059-be51-4b52-a652-06d83081f9b0-cni-binary-copy\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05bc38b3-36fc-4d42-9971-93a8eb9759a9-hosts-file\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ff0624d0-aca7-4737-bc11-df19765067fd-serviceca\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-sys\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.281804 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-var-lib-kubelet\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99807af6-909a-4ac3-bf97-3339c78bad27-dbus\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a649524-6475-4197-8e38-7f2403384c34-ovn-node-metrics-cert\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpkp\" (UniqueName: \"kubernetes.io/projected/ff0624d0-aca7-4737-bc11-df19765067fd-kube-api-access-zbpkp\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-os-release\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3528059-be51-4b52-a652-06d83081f9b0-cni-binary-copy\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-etc-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-cni-multus\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-kubernetes\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-cni-multus\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysctl-d\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-tuned\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-systemd\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-socket-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-device-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.282373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-cnibin\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.281977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtfb2\" (UniqueName: \"kubernetes.io/projected/90305bc8-6179-449f-9661-caab6b72bcfb-kube-api-access-vtfb2\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zl77\" (UniqueName: \"kubernetes.io/projected/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-kube-api-access-5zl77\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-cnibin\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-device-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-system-cni-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-socket-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-system-cni-dir\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-kubelet\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-log-socket\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99807af6-909a-4ac3-bf97-3339c78bad27-kubelet-config\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-run-ovn-kubernetes\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c52wx\" (UniqueName: \"kubernetes.io/projected/96300030-04ca-4b6f-bafe-b145d04f5e1b-kube-api-access-c52wx\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-os-release\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-k8s-cni-cncf-io\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-kubelet\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283022 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cblmj\" (UniqueName: \"kubernetes.io/projected/f3528059-be51-4b52-a652-06d83081f9b0-kube-api-access-cblmj\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cnibin\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-k8s-cni-cncf-io\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282389    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-var-lib-kubelet\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-os-release\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-ovnkube-script-lib\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90305bc8-6179-449f-9661-caab6b72bcfb-host-slash\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-system-cni-dir\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282552    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90305bc8-6179-449f-9661-caab6b72bcfb-host-slash\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-sys-fs\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-multus-certs\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysctl-conf\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-host\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.283591 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/96300030-04ca-4b6f-bafe-b145d04f5e1b-sys-fs\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.284185 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3528059-be51-4b52-a652-06d83081f9b0-host-run-multus-certs\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.284185 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-tmp\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.284185 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.282762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v6zl\" (UniqueName: \"kubernetes.io/projected/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-kube-api-access-5v6zl\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.288805 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.288773    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 14:59:11.291956 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.291939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c52wx\" (UniqueName: \"kubernetes.io/projected/96300030-04ca-4b6f-bafe-b145d04f5e1b-kube-api-access-c52wx\") pod \"aws-ebs-csi-driver-node-764bd\" (UID: \"96300030-04ca-4b6f-bafe-b145d04f5e1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.292107 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.292087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtfb2\" (UniqueName: \"kubernetes.io/projected/90305bc8-6179-449f-9661-caab6b72bcfb-kube-api-access-vtfb2\") pod \"iptables-alerter-f684m\" (UID: \"90305bc8-6179-449f-9661-caab6b72bcfb\") " pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.292155 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.292085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cblmj\" (UniqueName: \"kubernetes.io/projected/f3528059-be51-4b52-a652-06d83081f9b0-kube-api-access-cblmj\") pod \"multus-kdjg5\" (UID: \"f3528059-be51-4b52-a652-06d83081f9b0\") " pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.292191 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.292156    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpkp\" (UniqueName: \"kubernetes.io/projected/ff0624d0-aca7-4737-bc11-df19765067fd-kube-api-access-zbpkp\") pod \"node-ca-8b46b\" (UID: \"ff0624d0-aca7-4737-bc11-df19765067fd\") " pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.298556 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.298516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal" event={"ID":"1faa3d6ac6af8dc03734d559d6e87e75","Type":"ContainerStarted","Data":"f63ed0f2486a5424a9dd91081c8c75e48ad4748fc42d3818d7938e3f383ba6c2"}
Jul 21 14:59:11.299556 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.299532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal" event={"ID":"7530766705a66ef33547ad56463ffe71","Type":"ContainerStarted","Data":"6daa8734d3053ff1620332ba1408e5fc10da7b0c411254ac86539786434d459b"}
Jul 21 14:59:11.383868 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.383841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.383979 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.383876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghbw\" (UniqueName: \"kubernetes.io/projected/05bc38b3-36fc-4d42-9971-93a8eb9759a9-kube-api-access-cghbw\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.383979 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.383901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-modprobe-d\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.383979 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.383953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.383979 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.383927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.383990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-slash\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-modprobe-d\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bc38b3-36fc-4d42-9971-93a8eb9759a9-tmp-dir\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f-konnectivity-ca\") pod \"konnectivity-agent-kjj7b\" (UID: \"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f\") " pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-run\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384092    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-slash\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-run\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:11.384186 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-systemd-units\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-systemd\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-cni-netd\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-env-overrides\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysconfig\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-run-netns\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-ovn\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-ovnkube-config\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f-agent-certs\") pod \"konnectivity-agent-kjj7b\" (UID: \"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f\") " pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bc38b3-36fc-4d42-9971-93a8eb9759a9-tmp-dir\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-lib-modules\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-node-log\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysconfig\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05bc38b3-36fc-4d42-9971-93a8eb9759a9-hosts-file\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-sys\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-systemd\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.384768 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-var-lib-kubelet\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05bc38b3-36fc-4d42-9971-93a8eb9759a9-hosts-file\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384492    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-var-lib-kubelet\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99807af6-909a-4ac3-bf97-3339c78bad27-dbus\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384515    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-run-netns\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-cni-netd\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a649524-6475-4197-8e38-7f2403384c34-ovn-node-metrics-cert\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384554    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-sys\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-os-release\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384577    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-ovn\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-etc-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-kubernetes\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysctl-d\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-lib-modules\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-tuned\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f-konnectivity-ca\") pod \"konnectivity-agent-kjj7b\" (UID: \"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f\") " pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-systemd\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.385674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zl77\" (UniqueName: \"kubernetes.io/projected/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-kube-api-access-5zl77\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-os-release\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-kubelet\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-log-socket\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-systemd-units\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.384896    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.384904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-env-overrides\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.384953    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:11.884933615 +0000 UTC m=+3.028846572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.384969    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.385019    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:11.88500689 +0000 UTC m=+3.028919844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385042    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-ovnkube-config\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-node-log\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-run-systemd\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-kubernetes\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99807af6-909a-4ac3-bf97-3339c78bad27-kubelet-config\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-etc-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386380 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-run-ovn-kubernetes\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cnibin\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385215    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysctl-d\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385251    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99807af6-909a-4ac3-bf97-3339c78bad27-dbus\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-ovnkube-script-lib\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385267    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-kubelet\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99807af6-909a-4ac3-bf97-3339c78bad27-kubelet-config\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-system-cni-dir\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-log-socket\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-system-cni-dir\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-run-ovn-kubernetes\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysctl-conf\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cnibin\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-host\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.386983 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-tmp\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v6zl\" (UniqueName: \"kubernetes.io/projected/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-kube-api-access-5v6zl\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-cni-bin\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fm76\" (UniqueName: \"kubernetes.io/projected/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-kube-api-access-6fm76\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-var-lib-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385535    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-host\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpn9m\" (UniqueName: \"kubernetes.io/projected/7a649524-6475-4197-8e38-7f2403384c34-kube-api-access-bpn9m\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-sysctl-conf\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-var-lib-openvswitch\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a649524-6475-4197-8e38-7f2403384c34-ovnkube-script-lib\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a649524-6475-4197-8e38-7f2403384c34-host-cni-bin\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.385892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.387744 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.387643    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f-agent-certs\") pod \"konnectivity-agent-kjj7b\" (UID: \"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f\") " pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.388143 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.388011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-etc-tuned\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.388336 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.388315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-tmp\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.388373 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.388357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a649524-6475-4197-8e38-7f2403384c34-ovn-node-metrics-cert\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.398005 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.397905    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:11.398005 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.397940    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:11.398005 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.397955    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:11.398005 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.398003    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghbw\" (UniqueName: \"kubernetes.io/projected/05bc38b3-36fc-4d42-9971-93a8eb9759a9-kube-api-access-cghbw\") pod \"node-resolver-z9ddg\" (UID: \"05bc38b3-36fc-4d42-9971-93a8eb9759a9\") " pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.398262 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.398014    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:11.897995389 +0000 UTC m=+3.041908340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:11.400158 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.400111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v6zl\" (UniqueName: \"kubernetes.io/projected/039018e0-f1ad-4f11-aa6b-cb414d9c0c61-kube-api-access-5v6zl\") pod \"multus-additional-cni-plugins-gjtp6\" (UID: \"039018e0-f1ad-4f11-aa6b-cb414d9c0c61\") " pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.400359 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.400341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpn9m\" (UniqueName: \"kubernetes.io/projected/7a649524-6475-4197-8e38-7f2403384c34-kube-api-access-bpn9m\") pod \"ovnkube-node-2chhr\" (UID: \"7a649524-6475-4197-8e38-7f2403384c34\") " pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.402083 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.402064    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zl77\" (UniqueName: \"kubernetes.io/projected/d7cd5a0d-4048-4ad3-9160-ac3278394b4b-kube-api-access-5zl77\") pod \"tuned-7swj6\" (UID: \"d7cd5a0d-4048-4ad3-9160-ac3278394b4b\") " pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.402139 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.402123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fm76\" (UniqueName: \"kubernetes.io/projected/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-kube-api-access-6fm76\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.472573 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.472549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd"
Jul 21 14:59:11.477460 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.477440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kdjg5"
Jul 21 14:59:11.490227 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.490041    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8b46b"
Jul 21 14:59:11.491890 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.491841    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3528059_be51_4b52_a652_06d83081f9b0.slice/crio-45a6541c0a488cf0ec12c57ac094a427c6660d883b796700c5af5f5213c9144a WatchSource:0}: Error finding container 45a6541c0a488cf0ec12c57ac094a427c6660d883b796700c5af5f5213c9144a: Status 404 returned error can't find the container with id 45a6541c0a488cf0ec12c57ac094a427c6660d883b796700c5af5f5213c9144a
Jul 21 14:59:11.494184 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.494150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f684m"
Jul 21 14:59:11.500177 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.500156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:11.501162 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.501136    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0624d0_aca7_4737_bc11_df19765067fd.slice/crio-ad46c8822920aa9882cb3dec0bb6a2a78d94fdfa85509853a6032a2b3207ae69 WatchSource:0}: Error finding container ad46c8822920aa9882cb3dec0bb6a2a78d94fdfa85509853a6032a2b3207ae69: Status 404 returned error can't find the container with id ad46c8822920aa9882cb3dec0bb6a2a78d94fdfa85509853a6032a2b3207ae69
Jul 21 14:59:11.504167 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.504054    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90305bc8_6179_449f_9661_caab6b72bcfb.slice/crio-0b53ffdce156f89c99bbf031f22c9f7ee455d3ae076314d8858f797845a2e3c0 WatchSource:0}: Error finding container 0b53ffdce156f89c99bbf031f22c9f7ee455d3ae076314d8858f797845a2e3c0: Status 404 returned error can't find the container with id 0b53ffdce156f89c99bbf031f22c9f7ee455d3ae076314d8858f797845a2e3c0
Jul 21 14:59:11.505209 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.505190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9ddg"
Jul 21 14:59:11.510999 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.510932    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a649524_6475_4197_8e38_7f2403384c34.slice/crio-e1b0fbf80bdcbb401515b6c854b9e8036eeedcf60512a54d60cdba5c37e9fa93 WatchSource:0}: Error finding container e1b0fbf80bdcbb401515b6c854b9e8036eeedcf60512a54d60cdba5c37e9fa93: Status 404 returned error can't find the container with id e1b0fbf80bdcbb401515b6c854b9e8036eeedcf60512a54d60cdba5c37e9fa93
Jul 21 14:59:11.511834 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.511818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:11.516749 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.516704    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bc38b3_36fc_4d42_9971_93a8eb9759a9.slice/crio-37df266fec5cf0c2ef73fd2dab2ab5f9c8c8f60f2a9c3cb4ac67b88d4fc679b6 WatchSource:0}: Error finding container 37df266fec5cf0c2ef73fd2dab2ab5f9c8c8f60f2a9c3cb4ac67b88d4fc679b6: Status 404 returned error can't find the container with id 37df266fec5cf0c2ef73fd2dab2ab5f9c8c8f60f2a9c3cb4ac67b88d4fc679b6
Jul 21 14:59:11.517320 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.517297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7swj6"
Jul 21 14:59:11.521232 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.521211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gjtp6"
Jul 21 14:59:11.522293 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.522270    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c06eadb_07a0_4e0f_b44c_aaebb7fe4c9f.slice/crio-ef38b5a0f0952609d2e37841c5229b4904e12d405e2055ac1e7ec5a2f974ace1 WatchSource:0}: Error finding container ef38b5a0f0952609d2e37841c5229b4904e12d405e2055ac1e7ec5a2f974ace1: Status 404 returned error can't find the container with id ef38b5a0f0952609d2e37841c5229b4904e12d405e2055ac1e7ec5a2f974ace1
Jul 21 14:59:11.528306 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.528284    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7cd5a0d_4048_4ad3_9160_ac3278394b4b.slice/crio-04ead1a9db7c9b483ca83978b28f234cc45db4f18c4de6abc11f830265563451 WatchSource:0}: Error finding container 04ead1a9db7c9b483ca83978b28f234cc45db4f18c4de6abc11f830265563451: Status 404 returned error can't find the container with id 04ead1a9db7c9b483ca83978b28f234cc45db4f18c4de6abc11f830265563451
Jul 21 14:59:11.533485 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:11.533464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039018e0_f1ad_4f11_aa6b_cb414d9c0c61.slice/crio-a8d474bd0699cbc4d0811e86089f6d4115db8c02174e2086429c4c7becbfb2e4 WatchSource:0}: Error finding container a8d474bd0699cbc4d0811e86089f6d4115db8c02174e2086429c4c7becbfb2e4: Status 404 returned error can't find the container with id a8d474bd0699cbc4d0811e86089f6d4115db8c02174e2086429c4c7becbfb2e4
Jul 21 14:59:11.607684 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.607650    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 14:59:11.889147 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.888915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:11.889147 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.889110    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:11.889381 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.889116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:11.889381 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.889201    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:12.889175792 +0000 UTC m=+4.033088744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:11.889381 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.889200    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:11.889381 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.889258    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:12.889242837 +0000 UTC m=+4.033155788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:11.990615 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:11.990570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:11.990799 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.990772    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:11.990799 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.990796    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:11.990882 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.990810    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:11.990882 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:11.990865    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:12.990846078 +0000 UTC m=+4.134759028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:12.039555 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.039526    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 14:59:12.221289 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.221151    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:54:11 +0000 UTC" deadline="2028-02-09 09:19:57.369819268 +0000 UTC"
Jul 21 14:59:12.221289 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.221201    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13626h20m45.148621796s"
Jul 21 14:59:12.303199 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.303159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7swj6" event={"ID":"d7cd5a0d-4048-4ad3-9160-ac3278394b4b","Type":"ContainerStarted","Data":"04ead1a9db7c9b483ca83978b28f234cc45db4f18c4de6abc11f830265563451"}
Jul 21 14:59:12.305401 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.305370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"e1b0fbf80bdcbb401515b6c854b9e8036eeedcf60512a54d60cdba5c37e9fa93"}
Jul 21 14:59:12.306758 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.306730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f684m" event={"ID":"90305bc8-6179-449f-9661-caab6b72bcfb","Type":"ContainerStarted","Data":"0b53ffdce156f89c99bbf031f22c9f7ee455d3ae076314d8858f797845a2e3c0"}
Jul 21 14:59:12.308000 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.307945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8b46b" event={"ID":"ff0624d0-aca7-4737-bc11-df19765067fd","Type":"ContainerStarted","Data":"ad46c8822920aa9882cb3dec0bb6a2a78d94fdfa85509853a6032a2b3207ae69"}
Jul 21 14:59:12.309426 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.309400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kdjg5" event={"ID":"f3528059-be51-4b52-a652-06d83081f9b0","Type":"ContainerStarted","Data":"45a6541c0a488cf0ec12c57ac094a427c6660d883b796700c5af5f5213c9144a"}
Jul 21 14:59:12.310703 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.310671    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerStarted","Data":"a8d474bd0699cbc4d0811e86089f6d4115db8c02174e2086429c4c7becbfb2e4"}
Jul 21 14:59:12.311946 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.311922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjj7b" event={"ID":"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f","Type":"ContainerStarted","Data":"ef38b5a0f0952609d2e37841c5229b4904e12d405e2055ac1e7ec5a2f974ace1"}
Jul 21 14:59:12.313250 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.313228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9ddg" event={"ID":"05bc38b3-36fc-4d42-9971-93a8eb9759a9","Type":"ContainerStarted","Data":"37df266fec5cf0c2ef73fd2dab2ab5f9c8c8f60f2a9c3cb4ac67b88d4fc679b6"}
Jul 21 14:59:12.314413 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.314389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd" event={"ID":"96300030-04ca-4b6f-bafe-b145d04f5e1b","Type":"ContainerStarted","Data":"7d214a9fdbe0f990500fb3e0c473e86af9cbabafc14193bc1a977f355bcac387"}
Jul 21 14:59:12.898529 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.898497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:12.898634 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.898551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:12.898793 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.898717    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:12.898793 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.898782    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:14.898761454 +0000 UTC m=+6.042674418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:12.899235 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.899213    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:12.899327 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.899276    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:14.899257902 +0000 UTC m=+6.043170856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:12.999765 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:12.999319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:12.999765 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.999488    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:12.999765 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.999503    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:12.999765 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.999512    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:12.999765 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:12.999552    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:14.999539292 +0000 UTC m=+6.143452243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:13.222242 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.222117    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:54:11 +0000 UTC" deadline="2028-03-13 11:54:44.882349683 +0000 UTC"
Jul 21 14:59:13.222242 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.222157    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14420h55m31.660197678s"
Jul 21 14:59:13.294068 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.293950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:13.294244 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:13.294084    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:13.294517 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.294337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:13.294517 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.293963    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:13.294517 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:13.294467    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:13.294744 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:13.294537    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:13.329863 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.329833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal" event={"ID":"1faa3d6ac6af8dc03734d559d6e87e75","Type":"ContainerStarted","Data":"fbd5f25737df4fd055506c3bb321ff779aefd3f6904a8dff33c9f7bd1975ebd0"}
Jul 21 14:59:13.349060 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:13.349009    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-165.ec2.internal" podStartSLOduration=2.348990005 podStartE2EDuration="2.348990005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:13.348046304 +0000 UTC m=+4.491959279" watchObservedRunningTime="2026-07-21 14:59:13.348990005 +0000 UTC m=+4.492902982"
Jul 21 14:59:14.917512 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:14.917317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:14.917512 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:14.917381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:14.918094 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:14.917671    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:14.918094 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:14.917775    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:18.917752835 +0000 UTC m=+10.061665797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:14.918094 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:14.918054    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:14.918217 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:14.918121    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:18.918088477 +0000 UTC m=+10.062001444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:15.020056 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:15.019307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:15.020056 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.019520    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:15.020056 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.019538    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:15.020056 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.019550    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:15.020056 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.019605    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:19.019586761 +0000 UTC m=+10.163499715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:15.294632 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:15.293853    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:15.294632 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.293986    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:15.294632 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:15.294420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:15.294632 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.294521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:15.295211 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:15.295049    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:15.295211 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:15.295169    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:17.293557 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:17.292889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:17.293557 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:17.293025    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:17.293557 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:17.293442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:17.293557 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:17.293517    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:17.294221 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:17.293660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:17.294221 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:17.293796    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:18.956573 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:18.956539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:18.957094 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:18.956624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:18.957094 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:18.956788    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:18.957094 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:18.956860    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:26.956839549 +0000 UTC m=+18.100752504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:18.957307 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:18.957237    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:18.957307 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:18.957281    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:26.957269873 +0000 UTC m=+18.101182824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:19.057237 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:19.057203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:19.057414 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.057384    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:19.057414 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.057404    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:19.057542 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.057418    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:19.057542 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.057479    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:27.057457817 +0000 UTC m=+18.201370790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:19.298071 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:19.297974    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:19.298233 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:19.298121    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:19.298233 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:19.298154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:19.298357 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.298259    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:19.298357 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.298265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:19.298475 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:19.298370    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:21.293209 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:21.293175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:21.293747 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:21.293320    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:21.293747 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:21.293516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:21.293747 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:21.293622    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:21.293946 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:21.293751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:21.293946 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:21.293853    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:23.293270 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:23.292756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:23.293270 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:23.292903    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:23.293270 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:23.292900    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:23.293270 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:23.293019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:23.293270 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:23.293088    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:23.293270 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:23.293154    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:25.292508 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:25.292467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:25.292972 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:25.292473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:25.292972 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:25.292587    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:25.292972 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:25.292695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:25.292972 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:25.292696    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:25.292972 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:25.292801    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:27.024304 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:27.022986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:27.024304 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:27.023050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:27.024304 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.023204    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:27.024304 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.023317    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:43.023297687 +0000 UTC m=+34.167210640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:27.024304 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.023836    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:27.024304 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.023890    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:43.023872847 +0000 UTC m=+34.167785809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:27.123539 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:27.123506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:27.123747 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.123719    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:27.123747 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.123745    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:27.123931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.123758    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:27.123931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.123831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 14:59:43.123811754 +0000 UTC m=+34.267724705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:27.293427 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:27.292946    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:27.293427 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:27.292989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:27.293427 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:27.292947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:27.293427 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.293067    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:27.293427 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.293201    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:27.293427 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:27.293264    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:29.293618 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:29.293588    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:29.294106 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:29.293691    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:29.294106 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:29.293734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:29.294106 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:29.293788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:29.294106 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:29.293910    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:29.294106 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:29.294003    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:31.293031 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:31.293002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:31.293031 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:31.293019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:31.293624 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:31.293002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:31.293624 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:31.293123    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:31.293624 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:31.293213    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:31.293624 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:31.293330    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:32.387590 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.387193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8b46b" event={"ID":"ff0624d0-aca7-4737-bc11-df19765067fd","Type":"ContainerStarted","Data":"ffd05131b80c61f070bd7405e8bbdbde688fff76238d63585e89e9355d1eb31b"}
Jul 21 14:59:32.390091 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.389921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kdjg5" event={"ID":"f3528059-be51-4b52-a652-06d83081f9b0","Type":"ContainerStarted","Data":"5d572792a856ea0087122742713d56fdb09fc221b58a35fd3efadcc9b6255666"}
Jul 21 14:59:32.400562 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.398385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjj7b" event={"ID":"2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f","Type":"ContainerStarted","Data":"34f1c542722cd409c7e237c7157fec0442d7291090f4dd5de9ec315355a5fee7"}
Jul 21 14:59:32.404582 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.404554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd" event={"ID":"96300030-04ca-4b6f-bafe-b145d04f5e1b","Type":"ContainerStarted","Data":"755efe8d18073308e23902b603bf57f0ccdf8301427eeaf1827a06ffdccb3113"}
Jul 21 14:59:32.406705 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.406680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7swj6" event={"ID":"d7cd5a0d-4048-4ad3-9160-ac3278394b4b","Type":"ContainerStarted","Data":"40ea0397be641efbef48fb0ab6cce3dd90effae15b4339e92b23e3dc6524ef43"}
Jul 21 14:59:32.413206 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.413179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"6e779fe3a10363b0fbad6094205aa56f8d0213d71b28da8a42c633ba5fb19ddb"}
Jul 21 14:59:32.413319 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.413236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"d9073dd5414c6f04bfcc53cac12de58a70350bc10d04e8fa7d07fca11965efbe"}
Jul 21 14:59:32.413319 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.413266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"fc55b3a8d3a3a16f43c404f593315f073d7e9f1ce78661d9de8ac0ef39e4da97"}
Jul 21 14:59:32.422349 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.422308    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kdjg5" podStartSLOduration=1.864633184 podStartE2EDuration="22.422290719s" totalImagesPullingTime="20.557657535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:32.408050526 +0000 UTC m=+23.551963501" watchObservedRunningTime="2026-07-21 14:59:32.422290719 +0000 UTC m=+23.566203693"
Jul 21 14:59:32.422466 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.422447    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kjj7b" podStartSLOduration=1.951479844 podStartE2EDuration="22.422441359s" totalImagesPullingTime="20.470961515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:32.421855767 +0000 UTC m=+23.565768738" watchObservedRunningTime="2026-07-21 14:59:32.422441359 +0000 UTC m=+23.566354330"
Jul 21 14:59:32.437299 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:32.437265    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7swj6" podStartSLOduration=1.968935975 podStartE2EDuration="22.437254855s" totalImagesPullingTime="20.46831888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:32.436935783 +0000 UTC m=+23.580848755" watchObservedRunningTime="2026-07-21 14:59:32.437254855 +0000 UTC m=+23.581167827"
Jul 21 14:59:33.268265 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.268197    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:33.268823 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.268806    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:33.292759 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.292733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:33.292861 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.292735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:33.292861 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:33.292839    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:33.292970 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.292738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:33.292970 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:33.292907    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:33.292970 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:33.292965    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:33.415863 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.415839    2562 generic.go:356] "Generic (PLEG): container finished" podID="7530766705a66ef33547ad56463ffe71" containerID="1c191afb20b2eb0f82edbef7692115b01d0a4242965a7bf16b17594d6891a911" exitCode=0
Jul 21 14:59:33.416201 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.415924    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal" event={"ID":"7530766705a66ef33547ad56463ffe71","Type":"ContainerDied","Data":"1c191afb20b2eb0f82edbef7692115b01d0a4242965a7bf16b17594d6891a911"}
Jul 21 14:59:33.417407 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.417391    2562 generic.go:356] "Generic (PLEG): container finished" podID="039018e0-f1ad-4f11-aa6b-cb414d9c0c61" containerID="9185ccb595d58a477d1ad1ccd8f775c847a3527a626478013567f8604240905a" exitCode=0
Jul 21 14:59:33.417487 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.417454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerDied","Data":"9185ccb595d58a477d1ad1ccd8f775c847a3527a626478013567f8604240905a"}
Jul 21 14:59:33.418719 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.418696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9ddg" event={"ID":"05bc38b3-36fc-4d42-9971-93a8eb9759a9","Type":"ContainerStarted","Data":"20e0c9fa77d601ac4129cb27ef92e0098df803d6245e48a87d68dcab93fb2674"}
Jul 21 14:59:33.421379 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.421356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"713c1373a23e9b41ff5b7c1e3cf4e430d2ba4673d342b99b979cf46bc9a028b8"}
Jul 21 14:59:33.421583 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.421422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"dde56c1118ba3a39abc4a8a686fe096a5e2d71df84fa079d4dd080a47d783a62"}
Jul 21 14:59:33.421583 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.421459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"c35a67eceb92da8b05fafe497447ce789c719b7ed6a82195dad2caabc9b1f591"}
Jul 21 14:59:33.422646 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.422621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f684m" event={"ID":"90305bc8-6179-449f-9661-caab6b72bcfb","Type":"ContainerStarted","Data":"c830ff02aab827c7968649f846bf964195ea4a05ab3d87819602976eb9f74ef8"}
Jul 21 14:59:33.422926 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.422909    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:33.423372 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.423358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kjj7b"
Jul 21 14:59:33.460674 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.460620    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f684m" podStartSLOduration=2.970557363 podStartE2EDuration="23.460603863s" totalImagesPullingTime="20.4900465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:33.460527216 +0000 UTC m=+24.604440188" watchObservedRunningTime="2026-07-21 14:59:33.460603863 +0000 UTC m=+24.604516834"
Jul 21 14:59:33.460793 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.460764    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8b46b" podStartSLOduration=2.97750471 podStartE2EDuration="23.460758185s" totalImagesPullingTime="20.483253475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:33.445684704 +0000 UTC m=+24.589597666" watchObservedRunningTime="2026-07-21 14:59:33.460758185 +0000 UTC m=+24.604671199"
Jul 21 14:59:33.479377 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.479133    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z9ddg" podStartSLOduration=3.011439165 podStartE2EDuration="23.47911715s" totalImagesPullingTime="20.467677985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:33.478411609 +0000 UTC m=+24.622324582" watchObservedRunningTime="2026-07-21 14:59:33.47911715 +0000 UTC m=+24.623030120"
Jul 21 14:59:33.554434 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:33.554407    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 14:59:34.236390 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:34.236273    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T14:59:33.554428482Z","UUID":"e1a90a6c-dcb8-4236-a9d8-cfb9e5dde342","Handler":null,"Name":"","Endpoint":""}
Jul 21 14:59:34.239811 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:34.239787    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 14:59:34.239937 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:34.239831    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 14:59:34.427689 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:34.427639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal" event={"ID":"7530766705a66ef33547ad56463ffe71","Type":"ContainerStarted","Data":"649d662f8aa1798f80eb51b7c81f987678ccc1b9e29a984698b13a29c7f507bd"}
Jul 21 14:59:34.430433 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:34.430400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd" event={"ID":"96300030-04ca-4b6f-bafe-b145d04f5e1b","Type":"ContainerStarted","Data":"07dcba8f37059c8bc960c79fcc6ca08ff8ec82ec6b1d56b794eb5ca449ccd5d0"}
Jul 21 14:59:34.443404 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:34.443035    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-165.ec2.internal" podStartSLOduration=23.443017682 podStartE2EDuration="23.443017682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:34.442291869 +0000 UTC m=+25.586204841" watchObservedRunningTime="2026-07-21 14:59:34.443017682 +0000 UTC m=+25.586930655"
Jul 21 14:59:35.293082 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:35.292994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:35.293082 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:35.293043    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:35.293287 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:35.293012    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:35.293287 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:35.293116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:35.293287 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:35.293233    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:35.293408 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:35.293327    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:35.436310 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:35.436132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"59cbda7a64168e215dcbc549102f525e63cce7646fe753455e59452b6359cfa1"}
Jul 21 14:59:35.438321 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:35.438294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd" event={"ID":"96300030-04ca-4b6f-bafe-b145d04f5e1b","Type":"ContainerStarted","Data":"f0506211dfbacd40f38202a2c08c198d5b7da537cad1e1de21cf2e94ce83446a"}
Jul 21 14:59:35.470040 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:35.469972    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-764bd" podStartSLOduration=2.868335101 podStartE2EDuration="25.469955656s" totalImagesPullingTime="22.601620555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:35.469494483 +0000 UTC m=+26.613407455" watchObservedRunningTime="2026-07-21 14:59:35.469955656 +0000 UTC m=+26.613868630"
Jul 21 14:59:37.292802 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:37.292716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:37.292802 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:37.292733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:37.293327 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:37.292844    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:37.293327 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:37.292891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:37.293327 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:37.292965    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:37.293327 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:37.293046    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:39.295810 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.293679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:39.295810 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:39.294005    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:39.295810 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.294419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:39.295810 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:39.294526    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:39.295810 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.294587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:39.295810 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:39.294721    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:39.449588 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.449554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" event={"ID":"7a649524-6475-4197-8e38-7f2403384c34","Type":"ContainerStarted","Data":"fd552a6660185efed086c54afc305312cd101c4a9c2e093fa62f0a2f7e9e8c8c"}
Jul 21 14:59:39.449785 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.449768    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:39.449839 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.449833    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:39.449895 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.449875    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:39.452121 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.452101    2562 generic.go:356] "Generic (PLEG): container finished" podID="039018e0-f1ad-4f11-aa6b-cb414d9c0c61" containerID="a1974b40fd249956d5b0425a09a2e011681249fa750c2ea4c9c9670e8b461378" exitCode=0
Jul 21 14:59:39.452211 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.452134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerDied","Data":"a1974b40fd249956d5b0425a09a2e011681249fa750c2ea4c9c9670e8b461378"}
Jul 21 14:59:39.466199 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.466178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:39.466284 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.466275    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 14:59:39.480714 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:39.480680    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr" podStartSLOduration=8.93265462 podStartE2EDuration="29.480648651s" totalImagesPullingTime="20.547994031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:39.480356595 +0000 UTC m=+30.624269587" watchObservedRunningTime="2026-07-21 14:59:39.480648651 +0000 UTC m=+30.624561622"
Jul 21 14:59:40.900572 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:40.900495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmwvs"]
Jul 21 14:59:40.901045 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:40.900684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:40.901045 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:40.900832    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:40.904037 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:40.904003    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6pbzp"]
Jul 21 14:59:40.904174 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:40.904108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:40.904234 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:40.904203    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:40.904555 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:40.904533    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wcwv"]
Jul 21 14:59:40.904714 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:40.904699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:40.904831 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:40.904808    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:41.458595 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:41.458568    2562 generic.go:356] "Generic (PLEG): container finished" podID="039018e0-f1ad-4f11-aa6b-cb414d9c0c61" containerID="c17bf6427d6f7e8aabda3e0ae04f78c77691b8337dc87fa7b7a5fc0f53e9b64f" exitCode=0
Jul 21 14:59:41.458777 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:41.458649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerDied","Data":"c17bf6427d6f7e8aabda3e0ae04f78c77691b8337dc87fa7b7a5fc0f53e9b64f"}
Jul 21 14:59:42.292933 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:42.292775    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:42.293423 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:42.292776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:42.293423 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:42.293000    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:42.293423 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:42.292796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:42.293423 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:42.293095    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:42.293423 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:42.293150    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:42.462413 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:42.462388    2562 generic.go:356] "Generic (PLEG): container finished" podID="039018e0-f1ad-4f11-aa6b-cb414d9c0c61" containerID="ec35040d287ef09b6c9ddc9e75122e6a1cef505e4f072386dd688dc9abeaf6a0" exitCode=0
Jul 21 14:59:42.462530 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:42.462436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerDied","Data":"ec35040d287ef09b6c9ddc9e75122e6a1cef505e4f072386dd688dc9abeaf6a0"}
Jul 21 14:59:43.042973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:43.042908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:43.042973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:43.042939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:43.043123 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.043040    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:43.043123 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.043040    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:43.043123 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.043083    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret podName:99807af6-909a-4ac3-bf97-3339c78bad27 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:15.043070375 +0000 UTC m=+66.186983324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret") pod "global-pull-secret-syncer-nmwvs" (UID: "99807af6-909a-4ac3-bf97-3339c78bad27") : object "kube-system"/"original-pull-secret" not registered
Jul 21 14:59:43.043123 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.043095    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:15.043088887 +0000 UTC m=+66.187001836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 14:59:43.143483 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:43.143455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:43.143673 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.143634    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 14:59:43.143731 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.143680    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 14:59:43.143731 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.143694    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fcvvp for pod openshift-network-diagnostics/network-check-target-6pbzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:43.143826 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:43.143750    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp podName:356ee3f6-ec80-4c90-b28d-8cf44d08bab6 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:15.14373005 +0000 UTC m=+66.287643030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcvvp" (UniqueName: "kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp") pod "network-check-target-6pbzp" (UID: "356ee3f6-ec80-4c90-b28d-8cf44d08bab6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 14:59:44.292379 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:44.292348    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:44.292965 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:44.292356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:44.292965 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:44.292453    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6pbzp" podUID="356ee3f6-ec80-4c90-b28d-8cf44d08bab6"
Jul 21 14:59:44.292965 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:44.292527    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmwvs" podUID="99807af6-909a-4ac3-bf97-3339c78bad27"
Jul 21 14:59:44.292965 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:44.292362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:44.292965 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:44.292622    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 14:59:45.709056 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.709031    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-165.ec2.internal" event="NodeReady"
Jul 21 14:59:45.709495 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.709158    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 14:59:45.746917 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.746892    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"]
Jul 21 14:59:45.751820 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.751797    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68dfbf45b4-5cqzs"]
Jul 21 14:59:45.751972 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.751954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:45.754453 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.754403    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4hrxn\""
Jul 21 14:59:45.754558 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.754488    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 21 14:59:45.754730 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.754717    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 21 14:59:45.755445 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.755423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.757949 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.757927    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 14:59:45.758048 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.757960    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q548f\""
Jul 21 14:59:45.758048 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.757962    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 14:59:45.758217 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.758203    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 14:59:45.759919 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.759899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"]
Jul 21 14:59:45.763995 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.763975    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 14:59:45.764615 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.764593    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8q8j2"]
Jul 21 14:59:45.768320 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.768295    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q65w7"]
Jul 21 14:59:45.769311 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.769091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.772059 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.772039    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 14:59:45.772268 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.772144    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 14:59:45.772329 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.772308    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-frd55\""
Jul 21 14:59:45.772874 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.772855    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68dfbf45b4-5cqzs"]
Jul 21 14:59:45.773050 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.773030    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 14:59:45.773175 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.773158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.775195 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.775181    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 14:59:45.775553 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.775507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 14:59:45.775645 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.775579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhwsr\""
Jul 21 14:59:45.777700 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.777685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q8j2"]
Jul 21 14:59:45.781492 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.781474    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q65w7"]
Jul 21 14:59:45.865339 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tl5x\" (UniqueName: \"kubernetes.io/projected/51c8e612-9d31-4a3f-a983-d7297aa3688f-kube-api-access-4tl5x\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.865491 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb5d9a82-59a4-4b43-9d12-2302aa4ee640-cert\") pod \"ingress-canary-8q8j2\" (UID: \"eb5d9a82-59a4-4b43-9d12-2302aa4ee640\") " pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.865491 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-trusted-ca\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.865491 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8e612-9d31-4a3f-a983-d7297aa3688f-config-volume\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.865689 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llxp8\" (UniqueName: \"kubernetes.io/projected/eb5d9a82-59a4-4b43-9d12-2302aa4ee640-kube-api-access-llxp8\") pod \"ingress-canary-8q8j2\" (UID: \"eb5d9a82-59a4-4b43-9d12-2302aa4ee640\") " pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.865689 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.865689 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.865689 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-image-registry-private-configuration\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.865833 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-installation-pull-secrets\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.865833 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-bound-sa-token\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.865833 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtnk\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-kube-api-access-wrtnk\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.865833 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51c8e612-9d31-4a3f-a983-d7297aa3688f-tmp-dir\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.865833 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:45.865833 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:45.866049 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82827dba-9c5f-46f7-868d-e1dac277e03e-ca-trust-extracted\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.866049 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.865868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-certificates\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.927708 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.927645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:45.966426 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51c8e612-9d31-4a3f-a983-d7297aa3688f-tmp-dir\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82827dba-9c5f-46f7-868d-e1dac277e03e-ca-trust-extracted\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-certificates\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tl5x\" (UniqueName: \"kubernetes.io/projected/51c8e612-9d31-4a3f-a983-d7297aa3688f-kube-api-access-4tl5x\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb5d9a82-59a4-4b43-9d12-2302aa4ee640-cert\") pod \"ingress-canary-8q8j2\" (UID: \"eb5d9a82-59a4-4b43-9d12-2302aa4ee640\") " pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.966574 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-trusted-ca\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.966583    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8e612-9d31-4a3f-a983-d7297aa3688f-config-volume\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llxp8\" (UniqueName: \"kubernetes.io/projected/eb5d9a82-59a4-4b43-9d12-2302aa4ee640-kube-api-access-llxp8\") pod \"ingress-canary-8q8j2\" (UID: \"eb5d9a82-59a4-4b43-9d12-2302aa4ee640\") " pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.966652    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 14:59:46.466631494 +0000 UTC m=+37.610544464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-image-registry-private-configuration\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-installation-pull-secrets\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51c8e612-9d31-4a3f-a983-d7297aa3688f-tmp-dir\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-bound-sa-token\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.966973 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.966923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtnk\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-kube-api-access-wrtnk\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.967530 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.967143    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 14:59:45.967530 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.967157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:45.967530 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.967184    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 14:59:46.467169397 +0000 UTC m=+37.611082355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 14:59:45.967530 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.967328    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-certificates\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.968050 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.968026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82827dba-9c5f-46f7-868d-e1dac277e03e-ca-trust-extracted\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.968118 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.968048    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 14:59:45.968118 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.968067    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 14:59:45.968198 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:45.968132    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:46.468112127 +0000 UTC m=+37.612025077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 14:59:45.968198 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.968150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51c8e612-9d31-4a3f-a983-d7297aa3688f-config-volume\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:45.968306 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.968285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-trusted-ca\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.971713 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.971689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-installation-pull-secrets\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.971809 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.971787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb5d9a82-59a4-4b43-9d12-2302aa4ee640-cert\") pod \"ingress-canary-8q8j2\" (UID: \"eb5d9a82-59a4-4b43-9d12-2302aa4ee640\") " pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.971860 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.971840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-image-registry-private-configuration\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.976838 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.976795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-bound-sa-token\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.977248 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.977206    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtnk\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-kube-api-access-wrtnk\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:45.977435 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.977415    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llxp8\" (UniqueName: \"kubernetes.io/projected/eb5d9a82-59a4-4b43-9d12-2302aa4ee640-kube-api-access-llxp8\") pod \"ingress-canary-8q8j2\" (UID: \"eb5d9a82-59a4-4b43-9d12-2302aa4ee640\") " pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:45.978062 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:45.978040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tl5x\" (UniqueName: \"kubernetes.io/projected/51c8e612-9d31-4a3f-a983-d7297aa3688f-kube-api-access-4tl5x\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:46.052806 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.052717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:46.083960 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.083933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q8j2"
Jul 21 14:59:46.292593 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.292556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 14:59:46.292773 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.292555    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 14:59:46.292773 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.292556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 14:59:46.295220 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.295196    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 14:59:46.295350 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.295278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 14:59:46.295350 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.295340    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 14:59:46.295441 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.295343    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2gv2\""
Jul 21 14:59:46.296006 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.295990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nplsp\""
Jul 21 14:59:46.296132 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.296106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 14:59:46.470446 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.470408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:46.470629 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.470472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:46.470629 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.470521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:46.470629 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470534    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 14:59:46.470629 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470596    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 14:59:47.470576901 +0000 UTC m=+38.614489867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 14:59:46.470884 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470648    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 14:59:46.470884 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470732    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 14:59:47.470713533 +0000 UTC m=+38.614626481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 14:59:46.470884 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470651    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 14:59:46.470884 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470754    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 14:59:46.470884 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:46.470795    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:47.470784805 +0000 UTC m=+38.614697760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 14:59:46.890948 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:46.890779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q8j2"]
Jul 21 14:59:46.896674 ip-10-0-130-165 kubenswrapper[2562]: W0721 14:59:46.896628    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5d9a82_59a4_4b43_9d12_2302aa4ee640.slice/crio-b5555a74ad70f6787c83a98b396fbcd54e8b82f00ac5cd8b7937bb68467bfe59 WatchSource:0}: Error finding container b5555a74ad70f6787c83a98b396fbcd54e8b82f00ac5cd8b7937bb68467bfe59: Status 404 returned error can't find the container with id b5555a74ad70f6787c83a98b396fbcd54e8b82f00ac5cd8b7937bb68467bfe59
Jul 21 14:59:47.142605 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.142581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:47.239598 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.239548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:47.478471 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.478443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.478487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.478533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478553    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478621    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 14:59:49.478600179 +0000 UTC m=+40.622513131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478636    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478648    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 14:59:47.478692 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478650    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 14:59:47.479031 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478712    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 14:59:49.478696553 +0000 UTC m=+40.622609502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 14:59:47.479031 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:47.478730    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:49.478720517 +0000 UTC m=+40.622633470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 14:59:47.479031 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.478731    2562 generic.go:356] "Generic (PLEG): container finished" podID="039018e0-f1ad-4f11-aa6b-cb414d9c0c61" containerID="4057c8193bb9de638c8f59428baba2c1f8a6b35450a59adc4f9f0ca16522b7a0" exitCode=0
Jul 21 14:59:47.479031 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.478840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerDied","Data":"4057c8193bb9de638c8f59428baba2c1f8a6b35450a59adc4f9f0ca16522b7a0"}
Jul 21 14:59:47.480307 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:47.480281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q8j2" event={"ID":"eb5d9a82-59a4-4b43-9d12-2302aa4ee640","Type":"ContainerStarted","Data":"b5555a74ad70f6787c83a98b396fbcd54e8b82f00ac5cd8b7937bb68467bfe59"}
Jul 21 14:59:48.485787 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:48.485752    2562 generic.go:356] "Generic (PLEG): container finished" podID="039018e0-f1ad-4f11-aa6b-cb414d9c0c61" containerID="c7a9aba68f38de308bd14d8ea960325979c5863f9aff5b757bfcb67b61c08191" exitCode=0
Jul 21 14:59:48.486254 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:48.485820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerDied","Data":"c7a9aba68f38de308bd14d8ea960325979c5863f9aff5b757bfcb67b61c08191"}
Jul 21 14:59:49.491315 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.491159    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" event={"ID":"039018e0-f1ad-4f11-aa6b-cb414d9c0c61","Type":"ContainerStarted","Data":"1898adc49aed4cba35ffa181fb4f013ecd1c504fa588f32f34709cb656abb6a5"}
Jul 21 14:59:49.498727 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.498706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:49.498816 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.498741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:49.498816 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.498769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:49.498931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498844    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 14:59:49.498931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498848    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 14:59:49.498931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498857    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 14:59:49.498931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498877    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 14:59:49.498931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498901    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 14:59:53.498887809 +0000 UTC m=+44.642800757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 14:59:49.498931 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498925    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 14:59:53.498906466 +0000 UTC m=+44.642819429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 14:59:49.499125 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:49.498943    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 14:59:53.498933641 +0000 UTC m=+44.642846591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 14:59:49.514143 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.514111    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gjtp6" podStartSLOduration=7.259703072 podStartE2EDuration="39.514098007s" totalImagesPullingTime="32.254394935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:49.513085956 +0000 UTC m=+40.656998927" watchObservedRunningTime="2026-07-21 14:59:49.514098007 +0000 UTC m=+40.658010957"
Jul 21 14:59:49.636715 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.636675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:49.698276 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:49.698250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:50.494691 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:50.494597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q8j2" event={"ID":"eb5d9a82-59a4-4b43-9d12-2302aa4ee640","Type":"ContainerStarted","Data":"7811f5b6a575ab937b580d14e6d80f52732d13494539489ecd914aa7b800ea0d"}
Jul 21 14:59:50.497360 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:50.497334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:50.514532 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:50.514491    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8q8j2" podStartSLOduration=2.710646933 podStartE2EDuration="5.514473127s" totalImagesPullingTime="2.803826194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:59:50.513078501 +0000 UTC m=+41.656991471" watchObservedRunningTime="2026-07-21 14:59:50.514473127 +0000 UTC m=+41.658386100"
Jul 21 14:59:50.598408 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:50.598379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:50.859307 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:50.859280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:50.958692 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:50.958670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:51.817572 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:51.817537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:52.825213 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:52.825177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:52.925605 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:52.925575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:53.528329 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:53.528304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 14:59:53.528483 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:53.528340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 14:59:53.528483 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:53.528370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 14:59:53.528483 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528456    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 14:59:53.528593 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528490    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 14:59:53.528593 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528512    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 15:00:01.528496284 +0000 UTC m=+52.672409237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 14:59:53.528593 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528531    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:01.528518704 +0000 UTC m=+52.672431652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 14:59:53.528593 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528457    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 14:59:53.528593 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528544    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 14:59:53.528593 ip-10-0-130-165 kubenswrapper[2562]: E0721 14:59:53.528579    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 15:00:01.528568838 +0000 UTC m=+52.672481788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 14:59:56.815184 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:56.815145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 14:59:57.631075 ip-10-0-130-165 kubenswrapper[2562]: I0721 14:59:57.631041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log" limit=1024
Jul 21 15:00:01.584848 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:01.584817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:01.584863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:01.584903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.584955    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.585016    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.585025    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 15:00:17.585006146 +0000 UTC m=+68.728919095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.585056    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.585078    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.585063    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:17.585050411 +0000 UTC m=+68.728963360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 15:00:01.585278 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:01.585144    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 15:00:17.585132601 +0000 UTC m=+68.729045555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 15:00:11.470999 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:11.470970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2chhr"
Jul 21 15:00:15.079482 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.079443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:00:15.079482 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.079490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 15:00:15.082397 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.082373    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 15:00:15.082466 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.082416    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 15:00:15.090571 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:15.090547    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 15:00:15.090705 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:15.090610    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.09059317 +0000 UTC m=+130.234506119 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : secret "metrics-daemon-secret" not found
Jul 21 15:00:15.095141 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.095098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99807af6-909a-4ac3-bf97-3339c78bad27-original-pull-secret\") pod \"global-pull-secret-syncer-nmwvs\" (UID: \"99807af6-909a-4ac3-bf97-3339c78bad27\") " pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 15:00:15.111233 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.111206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmwvs"
Jul 21 15:00:15.180148 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.180115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 15:00:15.183545 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.183523    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 15:00:15.193753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.193722    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 15:00:15.203243 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.203216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcvvp\" (UniqueName: \"kubernetes.io/projected/356ee3f6-ec80-4c90-b28d-8cf44d08bab6-kube-api-access-fcvvp\") pod \"network-check-target-6pbzp\" (UID: \"356ee3f6-ec80-4c90-b28d-8cf44d08bab6\") " pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 15:00:15.239403 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.239376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmwvs"]
Jul 21 15:00:15.242960 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:00:15.242935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99807af6_909a_4ac3_bf97_3339c78bad27.slice/crio-c2dc8a81149c06c7edad476cf974d2533b3ee17cc771d86f727921218e106d4d WatchSource:0}: Error finding container c2dc8a81149c06c7edad476cf974d2533b3ee17cc771d86f727921218e106d4d: Status 404 returned error can't find the container with id c2dc8a81149c06c7edad476cf974d2533b3ee17cc771d86f727921218e106d4d
Jul 21 15:00:15.419290 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.419264    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nplsp\""
Jul 21 15:00:15.427383 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.427363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 15:00:15.552787 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.552755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmwvs" event={"ID":"99807af6-909a-4ac3-bf97-3339c78bad27","Type":"ContainerStarted","Data":"c2dc8a81149c06c7edad476cf974d2533b3ee17cc771d86f727921218e106d4d"}
Jul 21 15:00:15.556606 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:15.556583    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6pbzp"]
Jul 21 15:00:15.559850 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:00:15.559816    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356ee3f6_ec80_4c90_b28d_8cf44d08bab6.slice/crio-0d80a2be3e008a027636b9427d383908686c29ec186570b7e27983e3020e780c WatchSource:0}: Error finding container 0d80a2be3e008a027636b9427d383908686c29ec186570b7e27983e3020e780c: Status 404 returned error can't find the container with id 0d80a2be3e008a027636b9427d383908686c29ec186570b7e27983e3020e780c
Jul 21 15:00:16.556425 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:16.556381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6pbzp" event={"ID":"356ee3f6-ec80-4c90-b28d-8cf44d08bab6","Type":"ContainerStarted","Data":"0d80a2be3e008a027636b9427d383908686c29ec186570b7e27983e3020e780c"}
Jul 21 15:00:17.596411 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:17.596372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 15:00:17.596411 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:17.596415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596530    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596531    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:17.596565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596545    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596607    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 15:00:49.59658739 +0000 UTC m=+100.740500354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596637    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 15:00:49.596619738 +0000 UTC m=+100.740532700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596713    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 15:00:17.596937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:17.596779    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:49.596764705 +0000 UTC m=+100.740677664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 15:00:20.570295 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:20.570174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6pbzp" event={"ID":"356ee3f6-ec80-4c90-b28d-8cf44d08bab6","Type":"ContainerStarted","Data":"2065e83a81fc74dd45cdaebf2fed801304aae0990325cc73629db4b9adfa954d"}
Jul 21 15:00:20.570295 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:20.570266    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 15:00:20.587739 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:20.587683    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6pbzp" podStartSLOduration=66.501465089 podStartE2EDuration="1m10.587645108s" totalImagesPullingTime="4.086180019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:20.587248078 +0000 UTC m=+71.731161049" watchObservedRunningTime="2026-07-21 15:00:20.587645108 +0000 UTC m=+71.731558107"
Jul 21 15:00:21.573766 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:21.573670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmwvs" event={"ID":"99807af6-909a-4ac3-bf97-3339c78bad27","Type":"ContainerStarted","Data":"a621f44b62c769040f8c947617f4fdd7dad55fa47902704bc011e1336c67e204"}
Jul 21 15:00:21.591369 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:21.591302    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nmwvs" podStartSLOduration=65.709978944 podStartE2EDuration="1m11.591287704s" totalImagesPullingTime="5.88130876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:21.590357637 +0000 UTC m=+72.734270620" watchObservedRunningTime="2026-07-21 15:00:21.591287704 +0000 UTC m=+72.735200675"
Jul 21 15:00:49.615178 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:49.615145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 15:00:49.615178 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:49.615182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:49.615209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615297    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615323    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615324    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615342    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615359    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 15:01:53.615344002 +0000 UTC m=+164.759256951 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615387    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:53.615371179 +0000 UTC m=+164.759284132 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 15:00:49.615748 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:00:49.615405    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:53.615397359 +0000 UTC m=+164.759310308 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 15:00:51.576449 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:00:51.576413    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6pbzp"
Jul 21 15:01:19.111750 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:19.111703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:01:19.112229 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:19.111830    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 15:01:19.112229 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:19.111901    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 15:03:21.11188369 +0000 UTC m=+252.255796660 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : secret "metrics-daemon-secret" not found
Jul 21 15:01:48.764722 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:48.764683    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59" podUID="90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c"
Jul 21 15:01:48.775555 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:48.775529    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e"
Jul 21 15:01:48.789681 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:48.789646    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q65w7" podUID="51c8e612-9d31-4a3f-a983-d7297aa3688f"
Jul 21 15:01:49.304265 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:49.304228    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 15:01:49.768041 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:49.768014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q65w7"
Jul 21 15:01:49.768336 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:49.768014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:01:49.768336 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:49.768014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:01:53.633435 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:53.633407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 15:01:53.633435 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:53.633435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:01:53.633461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633563    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633566    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633587    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfbf45b4-5cqzs: secret "image-registry-tls" not found
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633564    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633629    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert podName:90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c nodeName:}" failed. No retries permitted until 2026-07-21 15:03:55.63361107 +0000 UTC m=+286.777524089 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dnc59" (UID: "90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c") : secret "networking-console-plugin-cert" not found
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633648    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls podName:51c8e612-9d31-4a3f-a983-d7297aa3688f nodeName:}" failed. No retries permitted until 2026-07-21 15:03:55.633637296 +0000 UTC m=+286.777550262 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls") pod "dns-default-q65w7" (UID: "51c8e612-9d31-4a3f-a983-d7297aa3688f") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:53.633849 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:01:53.633682    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls podName:82827dba-9c5f-46f7-868d-e1dac277e03e nodeName:}" failed. No retries permitted until 2026-07-21 15:03:55.633654656 +0000 UTC m=+286.777567608 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls") pod "image-registry-68dfbf45b4-5cqzs" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e") : secret "image-registry-tls" not found
Jul 21 15:02:04.293161 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:02:04.293091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:03:21.200700 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:21.200637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:03:21.201299 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:21.200797    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 15:03:21.201299 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:21.200868    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs podName:ea14e970-a7bf-4b81-9bb1-787e49dfe3b0 nodeName:}" failed. No retries permitted until 2026-07-21 15:05:23.200851315 +0000 UTC m=+374.344764264 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs") pod "network-metrics-daemon-4wcwv" (UID: "ea14e970-a7bf-4b81-9bb1-787e49dfe3b0") : secret "metrics-daemon-secret" not found
Jul 21 15:03:30.332462 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.332427    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kjtds"]
Jul 21 15:03:30.335121 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.335102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.336735 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.336714    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nkk2n"]
Jul 21 15:03:30.337973 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.337953    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 15:03:30.338180 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.338166    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dwf75\""
Jul 21 15:03:30.338269 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.338169    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 15:03:30.339071 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.339056    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 15:03:30.339323 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.339307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.345494 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.345472    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 15:03:30.345815 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.345796    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:03:30.345936 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.345913    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 15:03:30.346171 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.345568    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 15:03:30.346543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.346519    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jgvx6\""
Jul 21 15:03:30.349368 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.347750    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 15:03:30.352199 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.352172    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 15:03:30.353282 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.353266    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 15:03:30.364183 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.364155    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nkk2n"]
Jul 21 15:03:30.368580 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.368556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kjtds"]
Jul 21 15:03:30.459975 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.459940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n62l\" (UniqueName: \"kubernetes.io/projected/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-kube-api-access-6n62l\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.459975 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.459978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc8ef140-2332-4448-8315-d526415f52ff-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.460195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-serving-cert\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.460195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc8ef140-2332-4448-8315-d526415f52ff-serving-cert\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.460195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc8ef140-2332-4448-8315-d526415f52ff-service-ca-bundle\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.460195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7px45\" (UniqueName: \"kubernetes.io/projected/fc8ef140-2332-4448-8315-d526415f52ff-kube-api-access-7px45\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.460195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-config\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.460353 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8ef140-2332-4448-8315-d526415f52ff-tmp\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.460353 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-trusted-ca\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.460353 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.460299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc8ef140-2332-4448-8315-d526415f52ff-snapshots\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561210 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc8ef140-2332-4448-8315-d526415f52ff-snapshots\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561377 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n62l\" (UniqueName: \"kubernetes.io/projected/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-kube-api-access-6n62l\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.561377 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc8ef140-2332-4448-8315-d526415f52ff-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561377 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-serving-cert\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.561534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc8ef140-2332-4448-8315-d526415f52ff-serving-cert\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc8ef140-2332-4448-8315-d526415f52ff-service-ca-bundle\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7px45\" (UniqueName: \"kubernetes.io/projected/fc8ef140-2332-4448-8315-d526415f52ff-kube-api-access-7px45\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-config\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.561759 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8ef140-2332-4448-8315-d526415f52ff-tmp\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.561759 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-trusted-ca\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.561964 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.561913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc8ef140-2332-4448-8315-d526415f52ff-snapshots\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.562184 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.562161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc8ef140-2332-4448-8315-d526415f52ff-service-ca-bundle\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.562259 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.562239    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8ef140-2332-4448-8315-d526415f52ff-tmp\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.562367 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.562350    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-config\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.562567 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.562544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc8ef140-2332-4448-8315-d526415f52ff-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.562927 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.562905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-trusted-ca\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.563912 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.563893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-serving-cert\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.563959 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.563937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc8ef140-2332-4448-8315-d526415f52ff-serving-cert\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.569639 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.569619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n62l\" (UniqueName: \"kubernetes.io/projected/967b8e42-1738-4a28-b2cd-fb4ff8e76eef-kube-api-access-6n62l\") pod \"console-operator-565b7b569d-nkk2n\" (UID: \"967b8e42-1738-4a28-b2cd-fb4ff8e76eef\") " pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.569879 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.569861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7px45\" (UniqueName: \"kubernetes.io/projected/fc8ef140-2332-4448-8315-d526415f52ff-kube-api-access-7px45\") pod \"insights-operator-555d9d7885-kjtds\" (UID: \"fc8ef140-2332-4448-8315-d526415f52ff\") " pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.645490 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.645466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-kjtds"
Jul 21 15:03:30.653642 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.653626    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:30.775718 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.775690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-kjtds"]
Jul 21 15:03:30.779200 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:30.779174    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8ef140_2332_4448_8315_d526415f52ff.slice/crio-c1f4affcc68dc893d9f7be6fea292308dfe4c7d73988508461c6b18d1a03757d WatchSource:0}: Error finding container c1f4affcc68dc893d9f7be6fea292308dfe4c7d73988508461c6b18d1a03757d: Status 404 returned error can't find the container with id c1f4affcc68dc893d9f7be6fea292308dfe4c7d73988508461c6b18d1a03757d
Jul 21 15:03:30.792815 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.792794    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nkk2n"]
Jul 21 15:03:30.795610 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:30.795588    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967b8e42_1738_4a28_b2cd_fb4ff8e76eef.slice/crio-249acdd2a7d057ff49e35bc73379b3e07d04e7e18d4fd0a0e1da83c01c58ee5f WatchSource:0}: Error finding container 249acdd2a7d057ff49e35bc73379b3e07d04e7e18d4fd0a0e1da83c01c58ee5f: Status 404 returned error can't find the container with id 249acdd2a7d057ff49e35bc73379b3e07d04e7e18d4fd0a0e1da83c01c58ee5f
Jul 21 15:03:30.985834 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.985714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kjtds" event={"ID":"fc8ef140-2332-4448-8315-d526415f52ff","Type":"ContainerStarted","Data":"c1f4affcc68dc893d9f7be6fea292308dfe4c7d73988508461c6b18d1a03757d"}
Jul 21 15:03:30.988628 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:30.988602    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" event={"ID":"967b8e42-1738-4a28-b2cd-fb4ff8e76eef","Type":"ContainerStarted","Data":"249acdd2a7d057ff49e35bc73379b3e07d04e7e18d4fd0a0e1da83c01c58ee5f"}
Jul 21 15:03:33.999372 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:33.999340    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/0.log"
Jul 21 15:03:33.999822 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:33.999382    2562 generic.go:356] "Generic (PLEG): container finished" podID="967b8e42-1738-4a28-b2cd-fb4ff8e76eef" containerID="534adb794bb70b749bbbc398ba24195bee312f4db2bf7549106e41ab49a34950" exitCode=255
Jul 21 15:03:33.999822 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:33.999450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" event={"ID":"967b8e42-1738-4a28-b2cd-fb4ff8e76eef","Type":"ContainerDied","Data":"534adb794bb70b749bbbc398ba24195bee312f4db2bf7549106e41ab49a34950"}
Jul 21 15:03:33.999822 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:33.999714    2562 scope.go:117] "RemoveContainer" containerID="534adb794bb70b749bbbc398ba24195bee312f4db2bf7549106e41ab49a34950"
Jul 21 15:03:35.003613 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.003585    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:03:35.004042 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.003985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/0.log"
Jul 21 15:03:35.004042 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.004018    2562 generic.go:356] "Generic (PLEG): container finished" podID="967b8e42-1738-4a28-b2cd-fb4ff8e76eef" containerID="178a2cfe4a49f22729ce3b7110b54716941e86d967b7a1f9732a862aa001d38d" exitCode=255
Jul 21 15:03:35.004152 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.004123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" event={"ID":"967b8e42-1738-4a28-b2cd-fb4ff8e76eef","Type":"ContainerDied","Data":"178a2cfe4a49f22729ce3b7110b54716941e86d967b7a1f9732a862aa001d38d"}
Jul 21 15:03:35.004240 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.004224    2562 scope.go:117] "RemoveContainer" containerID="534adb794bb70b749bbbc398ba24195bee312f4db2bf7549106e41ab49a34950"
Jul 21 15:03:35.004442 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.004419    2562 scope.go:117] "RemoveContainer" containerID="178a2cfe4a49f22729ce3b7110b54716941e86d967b7a1f9732a862aa001d38d"
Jul 21 15:03:35.004608 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:35.004588    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nkk2n_openshift-console-operator(967b8e42-1738-4a28-b2cd-fb4ff8e76eef)\"" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" podUID="967b8e42-1738-4a28-b2cd-fb4ff8e76eef"
Jul 21 15:03:35.005570 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.005547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kjtds" event={"ID":"fc8ef140-2332-4448-8315-d526415f52ff","Type":"ContainerStarted","Data":"b8b929775a8f94003d5988a0b9d2ca25be573cc07f11e79746557c5c4b9e3a24"}
Jul 21 15:03:35.039090 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:35.039055    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-kjtds" podStartSLOduration=1.5142471419999999 podStartE2EDuration="5.039041961s" totalImagesPullingTime="3.524794819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:35.037990082 +0000 UTC m=+266.181903052" watchObservedRunningTime="2026-07-21 15:03:35.039041961 +0000 UTC m=+266.182954932"
Jul 21 15:03:36.009582 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.009552    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:03:36.010038 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.009897    2562 scope.go:117] "RemoveContainer" containerID="178a2cfe4a49f22729ce3b7110b54716941e86d967b7a1f9732a862aa001d38d"
Jul 21 15:03:36.010082 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:36.010040    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nkk2n_openshift-console-operator(967b8e42-1738-4a28-b2cd-fb4ff8e76eef)\"" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" podUID="967b8e42-1738-4a28-b2cd-fb4ff8e76eef"
Jul 21 15:03:36.674944 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.674910    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q77kl"]
Jul 21 15:03:36.679433 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.679406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.681984 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.681958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 15:03:36.682118 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.681985    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 15:03:36.682118 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.682075    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zxxxn\""
Jul 21 15:03:36.690986 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.690961    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q77kl"]
Jul 21 15:03:36.813235 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.813207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.813338 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.813264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-crio-socket\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.813380 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.813352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.813424 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.813381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8nkn\" (UniqueName: \"kubernetes.io/projected/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-api-access-k8nkn\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.813473 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.813445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-data-volume\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914589 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.914563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-crio-socket\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914725 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.914609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914725 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.914627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8nkn\" (UniqueName: \"kubernetes.io/projected/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-api-access-k8nkn\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914725 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.914698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-data-volume\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914725 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.914711    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-crio-socket\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:36.914747    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:03:36.914937 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.914753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.914937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:36.914814    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:37.414796433 +0000 UTC m=+268.558709404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : configmap "kube-rbac-proxy" not found
Jul 21 15:03:36.914937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:36.914861    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:36.914937 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:36.914896    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:37.414884321 +0000 UTC m=+268.558797270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:36.915142 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.915027    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-data-volume\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:36.924144 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:36.924122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8nkn\" (UniqueName: \"kubernetes.io/projected/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-api-access-k8nkn\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:37.418166 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:37.418140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:37.418525 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:37.418192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:37.418525 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:37.418246    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:03:37.418525 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:37.418291    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:38.418279543 +0000 UTC m=+269.562192492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : configmap "kube-rbac-proxy" not found
Jul 21 15:03:37.418525 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:37.418306    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:37.418525 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:37.418367    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:38.418348384 +0000 UTC m=+269.562261335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:38.427020 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:38.426982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:38.427450 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:38.427070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:38.427450 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:38.427136    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:38.427450 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:38.427166    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:03:38.427450 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:38.427201    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:40.427186093 +0000 UTC m=+271.571099044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:38.427450 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:38.427224    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:40.427208792 +0000 UTC m=+271.571121744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : configmap "kube-rbac-proxy" not found
Jul 21 15:03:39.675023 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:39.674998    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9ddg_05bc38b3-36fc-4d42-9971-93a8eb9759a9/dns-node-resolver/0.log"
Jul 21 15:03:40.440450 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:40.440417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:40.440603 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:40.440495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:40.440603 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:40.440570    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:40.440603 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:40.440580    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:03:40.440727 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:40.440637    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:44.440621828 +0000 UTC m=+275.584534780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:40.440727 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:40.440651    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:44.440645611 +0000 UTC m=+275.584558559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : configmap "kube-rbac-proxy" not found
Jul 21 15:03:40.479528 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:40.479507    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8b46b_ff0624d0-aca7-4737-bc11-df19765067fd/node-ca/0.log"
Jul 21 15:03:40.654159 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:40.654085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:40.654159 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:40.654143    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:40.654480 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:40.654468    2562 scope.go:117] "RemoveContainer" containerID="178a2cfe4a49f22729ce3b7110b54716941e86d967b7a1f9732a862aa001d38d"
Jul 21 15:03:40.654633 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:40.654615    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nkk2n_openshift-console-operator(967b8e42-1738-4a28-b2cd-fb4ff8e76eef)\"" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" podUID="967b8e42-1738-4a28-b2cd-fb4ff8e76eef"
Jul 21 15:03:41.275238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:41.275208    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q8j2_eb5d9a82-59a4-4b43-9d12-2302aa4ee640/serve-healthcheck-canary/0.log"
Jul 21 15:03:44.475876 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:44.475840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:44.476273 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:44.475923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:44.476273 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:44.476006    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:44.476273 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:44.476021    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:03:44.476273 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:44.476071    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:52.476055597 +0000 UTC m=+283.619968546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:03:44.476273 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:44.476087    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm podName:f7e62b4d-5b73-400c-bd84-c5a3dc5cffba nodeName:}" failed. No retries permitted until 2026-07-21 15:03:52.476080005 +0000 UTC m=+283.619992954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q77kl" (UID: "f7e62b4d-5b73-400c-bd84-c5a3dc5cffba") : configmap "kube-rbac-proxy" not found
Jul 21 15:03:52.292902 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.292872    2562 scope.go:117] "RemoveContainer" containerID="178a2cfe4a49f22729ce3b7110b54716941e86d967b7a1f9732a862aa001d38d"
Jul 21 15:03:52.540881 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.540851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:52.541028 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.540905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:52.541299 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.541282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:52.543171 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.543129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e62b4d-5b73-400c-bd84-c5a3dc5cffba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q77kl\" (UID: \"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba\") " pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:52.593138 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.593117    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q77kl"
Jul 21 15:03:52.725538 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:52.725508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q77kl"]
Jul 21 15:03:52.728215 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:52.728188    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e62b4d_5b73_400c_bd84_c5a3dc5cffba.slice/crio-ea197c1a3098036d583360c1572a9af85645a4d7210e1929c3cabcd0c8535cae WatchSource:0}: Error finding container ea197c1a3098036d583360c1572a9af85645a4d7210e1929c3cabcd0c8535cae: Status 404 returned error can't find the container with id ea197c1a3098036d583360c1572a9af85645a4d7210e1929c3cabcd0c8535cae
Jul 21 15:03:52.769418 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:52.769387    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e"
Jul 21 15:03:52.769520 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:52.769387    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-q65w7" podUID="51c8e612-9d31-4a3f-a983-d7297aa3688f"
Jul 21 15:03:52.769520 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:03:52.769387    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59" podUID="90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c"
Jul 21 15:03:53.049925 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.049899    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:03:53.050112 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.049987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" event={"ID":"967b8e42-1738-4a28-b2cd-fb4ff8e76eef","Type":"ContainerStarted","Data":"ae5582b36351639d724b294751db6885102c2ac76e5a1bb1f11794903030359b"}
Jul 21 15:03:53.050340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.050310    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:53.051261 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.051232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:03:53.051261 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.051243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q77kl" event={"ID":"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba","Type":"ContainerStarted","Data":"ea197c1a3098036d583360c1572a9af85645a4d7210e1929c3cabcd0c8535cae"}
Jul 21 15:03:53.051444 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.051341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:03:53.051444 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.051385    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q65w7"
Jul 21 15:03:53.055240 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.055217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n"
Jul 21 15:03:53.069506 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:53.069411    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-nkk2n" podStartSLOduration=20.65887713 podStartE2EDuration="23.069360899s" totalImagesPullingTime="2.410483769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:53.068225979 +0000 UTC m=+284.212138963" watchObservedRunningTime="2026-07-21 15:03:53.069360899 +0000 UTC m=+284.213273869"
Jul 21 15:03:55.669434 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.669385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:03:55.669937 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.669479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 15:03:55.669937 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.669513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:03:55.672404 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.672374    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51c8e612-9d31-4a3f-a983-d7297aa3688f-metrics-tls\") pod \"dns-default-q65w7\" (UID: \"51c8e612-9d31-4a3f-a983-d7297aa3688f\") " pod="openshift-dns/dns-default-q65w7"
Jul 21 15:03:55.672546 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.672434    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"image-registry-68dfbf45b4-5cqzs\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") " pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:03:55.672546 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.672445    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dnc59\" (UID: \"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:03:55.757746 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.757712    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4hrxn\""
Jul 21 15:03:55.757928 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.757688    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhwsr\""
Jul 21 15:03:55.757928 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.757758    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q548f\""
Jul 21 15:03:55.763145 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.763088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:03:55.763145 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.763132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"
Jul 21 15:03:55.763359 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:55.763109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q65w7"
Jul 21 15:03:57.443344 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:57.443312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68dfbf45b4-5cqzs"]
Jul 21 15:03:57.668599 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:57.668564    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82827dba_9c5f_46f7_868d_e1dac277e03e.slice/crio-9177e9e2835dcf103fd16a244c6b1dadefd42cadc4d4ed726ac5c06ef358148f WatchSource:0}: Error finding container 9177e9e2835dcf103fd16a244c6b1dadefd42cadc4d4ed726ac5c06ef358148f: Status 404 returned error can't find the container with id 9177e9e2835dcf103fd16a244c6b1dadefd42cadc4d4ed726ac5c06ef358148f
Jul 21 15:03:57.803847 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:57.803805    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q65w7"]
Jul 21 15:03:57.807049 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:57.807025    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c8e612_9d31_4a3f_a983_d7297aa3688f.slice/crio-9d51683684874849b48a542066b84e90a5ee06ff5b7ffa086fc14673d5e88bc8 WatchSource:0}: Error finding container 9d51683684874849b48a542066b84e90a5ee06ff5b7ffa086fc14673d5e88bc8: Status 404 returned error can't find the container with id 9d51683684874849b48a542066b84e90a5ee06ff5b7ffa086fc14673d5e88bc8
Jul 21 15:03:57.829343 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:57.829310    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59"]
Jul 21 15:03:57.832559 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:57.832535    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e7113f_2cd9_4fb7_b632_e95c2dcc0e9c.slice/crio-a792c4f5e34e6e83c75ae5f4c6d233ac99b9f6684af6c87bd401e4106a96b152 WatchSource:0}: Error finding container a792c4f5e34e6e83c75ae5f4c6d233ac99b9f6684af6c87bd401e4106a96b152: Status 404 returned error can't find the container with id a792c4f5e34e6e83c75ae5f4c6d233ac99b9f6684af6c87bd401e4106a96b152
Jul 21 15:03:58.070902 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.070825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q77kl" event={"ID":"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba","Type":"ContainerStarted","Data":"4cd5014d454a7f95803a6ae93c6f8d01f1b5c2e0d3c01d9ec67c90a15c643f33"}
Jul 21 15:03:58.072194 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.072161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q65w7" event={"ID":"51c8e612-9d31-4a3f-a983-d7297aa3688f","Type":"ContainerStarted","Data":"9d51683684874849b48a542066b84e90a5ee06ff5b7ffa086fc14673d5e88bc8"}
Jul 21 15:03:58.073920 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.073889    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" event={"ID":"82827dba-9c5f-46f7-868d-e1dac277e03e","Type":"ContainerStarted","Data":"fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2"}
Jul 21 15:03:58.074058 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.073938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" event={"ID":"82827dba-9c5f-46f7-868d-e1dac277e03e","Type":"ContainerStarted","Data":"9177e9e2835dcf103fd16a244c6b1dadefd42cadc4d4ed726ac5c06ef358148f"}
Jul 21 15:03:58.074058 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.074043    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:03:58.075134 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.075095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59" event={"ID":"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c","Type":"ContainerStarted","Data":"a792c4f5e34e6e83c75ae5f4c6d233ac99b9f6684af6c87bd401e4106a96b152"}
Jul 21 15:03:58.110899 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.110852    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" podStartSLOduration=288.1108359 podStartE2EDuration="4m48.1108359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:58.108810023 +0000 UTC m=+289.252723023" watchObservedRunningTime="2026-07-21 15:03:58.1108359 +0000 UTC m=+289.254748849"
Jul 21 15:03:58.137002 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.136974    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"]
Jul 21 15:03:58.141313 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.141292    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-x7c6s"]
Jul 21 15:03:58.141438 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.141419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:03:58.143801 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.143782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vrm78\""
Jul 21 15:03:58.144101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.144089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:03:58.144969 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.144950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 15:03:58.146298 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.146278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 15:03:58.146405 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.146282    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-47jhb\""
Jul 21 15:03:58.146608 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.146592    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 15:03:58.163459 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.163443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"]
Jul 21 15:03:58.164200 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.164183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-x7c6s"]
Jul 21 15:03:58.192946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.192923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhv4p\" (UniqueName: \"kubernetes.io/projected/10c11601-ffc9-4175-9c34-000b074d87a4-kube-api-access-nhv4p\") pod \"downloads-5bc67dcd46-x7c6s\" (UID: \"10c11601-ffc9-4175-9c34-000b074d87a4\") " pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:03:58.193026 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.192966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c550e675-b322-43fe-8d82-d506581190a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-wxvpj\" (UID: \"c550e675-b322-43fe-8d82-d506581190a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:03:58.293483 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.293454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhv4p\" (UniqueName: \"kubernetes.io/projected/10c11601-ffc9-4175-9c34-000b074d87a4-kube-api-access-nhv4p\") pod \"downloads-5bc67dcd46-x7c6s\" (UID: \"10c11601-ffc9-4175-9c34-000b074d87a4\") " pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:03:58.293592 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.293504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c550e675-b322-43fe-8d82-d506581190a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-wxvpj\" (UID: \"c550e675-b322-43fe-8d82-d506581190a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:03:58.295996 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.295978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c550e675-b322-43fe-8d82-d506581190a2-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-wxvpj\" (UID: \"c550e675-b322-43fe-8d82-d506581190a2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:03:58.319126 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.319104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhv4p\" (UniqueName: \"kubernetes.io/projected/10c11601-ffc9-4175-9c34-000b074d87a4-kube-api-access-nhv4p\") pod \"downloads-5bc67dcd46-x7c6s\" (UID: \"10c11601-ffc9-4175-9c34-000b074d87a4\") " pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:03:58.451109 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.451082    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:03:58.456403 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.456217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:03:58.632491 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.632459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-x7c6s"]
Jul 21 15:03:58.638221 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:58.638194    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c11601_ffc9_4175_9c34_000b074d87a4.slice/crio-09f4e641365f7e0b312b8bcd558ed8720dd945a115ef31282bfe2263fcf65645 WatchSource:0}: Error finding container 09f4e641365f7e0b312b8bcd558ed8720dd945a115ef31282bfe2263fcf65645: Status 404 returned error can't find the container with id 09f4e641365f7e0b312b8bcd558ed8720dd945a115ef31282bfe2263fcf65645
Jul 21 15:03:58.652249 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:58.652218    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"]
Jul 21 15:03:58.656484 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:03:58.656458    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc550e675_b322_43fe_8d82_d506581190a2.slice/crio-3e09c83917468763e747675a88c254a5001e5a570eca87252e448d098b488735 WatchSource:0}: Error finding container 3e09c83917468763e747675a88c254a5001e5a570eca87252e448d098b488735: Status 404 returned error can't find the container with id 3e09c83917468763e747675a88c254a5001e5a570eca87252e448d098b488735
Jul 21 15:03:59.080533 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:59.080454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-x7c6s" event={"ID":"10c11601-ffc9-4175-9c34-000b074d87a4","Type":"ContainerStarted","Data":"09f4e641365f7e0b312b8bcd558ed8720dd945a115ef31282bfe2263fcf65645"}
Jul 21 15:03:59.081845 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:03:59.081806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj" event={"ID":"c550e675-b322-43fe-8d82-d506581190a2","Type":"ContainerStarted","Data":"3e09c83917468763e747675a88c254a5001e5a570eca87252e448d098b488735"}
Jul 21 15:04:00.087875 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:00.087808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59" event={"ID":"90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c","Type":"ContainerStarted","Data":"4a4ff2d483cd8b6a444fa368c46cd6773e59e75a9dd7f4bff38b4f4886e0d7e5"}
Jul 21 15:04:00.104794 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:00.104741    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dnc59" podStartSLOduration=276.681009989 podStartE2EDuration="4m38.104722218s" totalImagesPullingTime="1.423712229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:00.103045528 +0000 UTC m=+291.246958504" watchObservedRunningTime="2026-07-21 15:04:00.104722218 +0000 UTC m=+291.248635191"
Jul 21 15:04:02.339145 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.339109    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bcd6b88b4-n2529"]
Jul 21 15:04:02.342203 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.342183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.344784 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.344760    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 15:04:02.345908 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.345827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 15:04:02.345908 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.345827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 15:04:02.346045 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.345914    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 15:04:02.346045 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.345933    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 15:04:02.346045 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.345898    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q9zfc\""
Jul 21 15:04:02.352490 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.352469    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bcd6b88b4-n2529"]
Jul 21 15:04:02.426808 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.426771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-serving-cert\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.426960 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.426819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-oauth-serving-cert\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.426960 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.426859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-oauth-config\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.426960 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.426886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-service-ca\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.426960 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.426922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzhg\" (UniqueName: \"kubernetes.io/projected/164e9266-008d-444f-929f-a024a4b567f4-kube-api-access-fgzhg\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.427175 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.426962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-console-config\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.528251 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.528212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-oauth-config\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.528419 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.528258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-service-ca\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.528419 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.528297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzhg\" (UniqueName: \"kubernetes.io/projected/164e9266-008d-444f-929f-a024a4b567f4-kube-api-access-fgzhg\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.528419 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.528347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-console-config\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.528419 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.528390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-serving-cert\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.528419 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.528418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-oauth-serving-cert\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.529213 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.529178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-service-ca\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.529487 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.529307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-console-config\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.529546 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.529485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-oauth-serving-cert\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.531592 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.531570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-oauth-config\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.531727 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.531706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-serving-cert\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.537969 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.537946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzhg\" (UniqueName: \"kubernetes.io/projected/164e9266-008d-444f-929f-a024a4b567f4-kube-api-access-fgzhg\") pod \"console-6bcd6b88b4-n2529\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") " pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.653347 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.653321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:02.844751 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:02.844689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bcd6b88b4-n2529"]
Jul 21 15:04:02.848912 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:04:02.848885    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164e9266_008d_444f_929f_a024a4b567f4.slice/crio-1ab52821140fa569b1fcbbc6d3d47eb0866046773a375773f943a5dfdd30d849 WatchSource:0}: Error finding container 1ab52821140fa569b1fcbbc6d3d47eb0866046773a375773f943a5dfdd30d849: Status 404 returned error can't find the container with id 1ab52821140fa569b1fcbbc6d3d47eb0866046773a375773f943a5dfdd30d849
Jul 21 15:04:03.100451 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.100406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj" event={"ID":"c550e675-b322-43fe-8d82-d506581190a2","Type":"ContainerStarted","Data":"fc7d83935555a0080e97f2b7c54659449312f79c8bdcfcb5a513123a65419c12"}
Jul 21 15:04:03.100611 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.100598    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:04:03.101858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.101805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcd6b88b4-n2529" event={"ID":"164e9266-008d-444f-929f-a024a4b567f4","Type":"ContainerStarted","Data":"1ab52821140fa569b1fcbbc6d3d47eb0866046773a375773f943a5dfdd30d849"}
Jul 21 15:04:03.104194 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.104140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q77kl" event={"ID":"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba","Type":"ContainerStarted","Data":"6d36e259827a8a52546d300062f58edce9a160fbff17272bbd986d1bba714080"}
Jul 21 15:04:03.106010 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.105971    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj"
Jul 21 15:04:03.106923 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.106905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q65w7" event={"ID":"51c8e612-9d31-4a3f-a983-d7297aa3688f","Type":"ContainerStarted","Data":"95894aa51bd14781f5a60b1e4908eba35ae9fcf58afd56b5de955292972a4951"}
Jul 21 15:04:03.107012 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.106945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q65w7" event={"ID":"51c8e612-9d31-4a3f-a983-d7297aa3688f","Type":"ContainerStarted","Data":"326435c29a3f8d008b6a0a602483ace827edfb431dd4107ae1ab4ee5842a853e"}
Jul 21 15:04:03.107079 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.107039    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q65w7"
Jul 21 15:04:03.120686 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.120624    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-wxvpj" podStartSLOduration=1.083390751 podStartE2EDuration="5.120607835s" totalImagesPullingTime="4.037217084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:03.118634664 +0000 UTC m=+294.262547626" watchObservedRunningTime="2026-07-21 15:04:03.120607835 +0000 UTC m=+294.264520807"
Jul 21 15:04:03.159173 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:03.159131    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q65w7" podStartSLOduration=253.642000002 podStartE2EDuration="4m18.159117796s" totalImagesPullingTime="4.517117794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:03.157705256 +0000 UTC m=+294.301618227" watchObservedRunningTime="2026-07-21 15:04:03.159117796 +0000 UTC m=+294.303030766"
Jul 21 15:04:04.055681 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.055471    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-h5987"]
Jul 21 15:04:04.059895 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.059269    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.063995 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.063973    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m4ptm\""
Jul 21 15:04:04.064259 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.064240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 15:04:04.064441 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.064425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 15:04:04.065746 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.065129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 15:04:04.065746 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.065345    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 15:04:04.065746 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.065579    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 15:04:04.071641 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.070694    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-h5987"]
Jul 21 15:04:04.142443 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.142409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vq7n\" (UniqueName: \"kubernetes.io/projected/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-kube-api-access-4vq7n\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.142642 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.142490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.142642 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.142529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.142642 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.142550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.244961 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.243545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.244961 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.243592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vq7n\" (UniqueName: \"kubernetes.io/projected/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-kube-api-access-4vq7n\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.244961 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.243690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.244961 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.243783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.244961 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:04:04.243922    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 21 15:04:04.244961 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:04:04.243982    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-tls podName:35b10e3c-3fd2-4ad9-a8ac-909eec2fd229 nodeName:}" failed. No retries permitted until 2026-07-21 15:04:04.743964155 +0000 UTC m=+295.887877106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-h5987" (UID: "35b10e3c-3fd2-4ad9-a8ac-909eec2fd229") : secret "prometheus-operator-tls" not found
Jul 21 15:04:04.245508 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.245488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.247346 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.247302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.257435 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.257414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vq7n\" (UniqueName: \"kubernetes.io/projected/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-kube-api-access-4vq7n\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.749220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.749133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.756818 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.756787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/35b10e3c-3fd2-4ad9-a8ac-909eec2fd229-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-h5987\" (UID: \"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:04.975438 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:04.975401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987"
Jul 21 15:04:05.134322 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:05.134251    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-h5987"]
Jul 21 15:04:06.268466 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:04:06.268426    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b10e3c_3fd2_4ad9_a8ac_909eec2fd229.slice/crio-9298b3ed799432e9c58c15f6abcfdbcc26526a5c1eb851ff31fd389378e2e640 WatchSource:0}: Error finding container 9298b3ed799432e9c58c15f6abcfdbcc26526a5c1eb851ff31fd389378e2e640: Status 404 returned error can't find the container with id 9298b3ed799432e9c58c15f6abcfdbcc26526a5c1eb851ff31fd389378e2e640
Jul 21 15:04:07.126250 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:07.126203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987" event={"ID":"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229","Type":"ContainerStarted","Data":"9298b3ed799432e9c58c15f6abcfdbcc26526a5c1eb851ff31fd389378e2e640"}
Jul 21 15:04:07.294204 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:04:07.294149    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4wcwv" podUID="ea14e970-a7bf-4b81-9bb1-787e49dfe3b0"
Jul 21 15:04:09.136345 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.136313    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q77kl" event={"ID":"f7e62b4d-5b73-400c-bd84-c5a3dc5cffba","Type":"ContainerStarted","Data":"64602ea97cb9d3aa3d4a79172703606e9de9b4a140d358be5535fea03097fab1"}
Jul 21 15:04:09.138178 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.138146    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcd6b88b4-n2529" event={"ID":"164e9266-008d-444f-929f-a024a4b567f4","Type":"ContainerStarted","Data":"f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b"}
Jul 21 15:04:09.156624 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.156321    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q77kl" podStartSLOduration=17.899896308 podStartE2EDuration="33.156302014s" totalImagesPullingTime="15.256405706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:03:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:09.155586697 +0000 UTC m=+300.299499671" watchObservedRunningTime="2026-07-21 15:04:09.156302014 +0000 UTC m=+300.300214986"
Jul 21 15:04:09.176048 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.174877    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bcd6b88b4-n2529" podStartSLOduration=1.867697433 podStartE2EDuration="7.174858692s" totalImagesPullingTime="5.307161259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:09.174449917 +0000 UTC m=+300.318362880" watchObservedRunningTime="2026-07-21 15:04:09.174858692 +0000 UTC m=+300.318771661"
Jul 21 15:04:09.193994 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.193936    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:04:09.194867 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.194844    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:04:09.216077 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:09.216058    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 15:04:10.143815 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:10.143759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987" event={"ID":"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229","Type":"ContainerStarted","Data":"ab7f153903bb89efc9b36f80a74184b58f3f0c453e7edb55410812372f4a69a9"}
Jul 21 15:04:10.144315 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:10.143823    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987" event={"ID":"35b10e3c-3fd2-4ad9-a8ac-909eec2fd229","Type":"ContainerStarted","Data":"8b33448938c11c5f2aae6a7cdae4be1e46888cdd18abb3c8f5f79c785cabbef9"}
Jul 21 15:04:10.162432 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:10.162384    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-h5987" podStartSLOduration=3.331831302 podStartE2EDuration="6.162367024s" totalImagesPullingTime="2.830535722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:10.161536763 +0000 UTC m=+301.305449738" watchObservedRunningTime="2026-07-21 15:04:10.162367024 +0000 UTC m=+301.306279994"
Jul 21 15:04:12.444005 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.443970    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6b4dk"]
Jul 21 15:04:12.448458 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.448438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.450799 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.450774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5j684\""
Jul 21 15:04:12.451203 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.451175    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 15:04:12.451320 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.451299    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 15:04:12.451507 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.451490    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 15:04:12.516087 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-wtmp\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-root\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f1f18a-3573-4254-ad2f-baaa99a28101-metrics-client-ca\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516385 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-accelerators-collector-config\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516385 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-tls\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-sys\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-textfile\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.516573 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.516495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nr7b\" (UniqueName: \"kubernetes.io/projected/62f1f18a-3573-4254-ad2f-baaa99a28101-kube-api-access-7nr7b\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.616920 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.616883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.616920 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.616922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-accelerators-collector-config\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.616949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-tls\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.616978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-sys\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-textfile\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nr7b\" (UniqueName: \"kubernetes.io/projected/62f1f18a-3573-4254-ad2f-baaa99a28101-kube-api-access-7nr7b\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-wtmp\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-sys\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-root\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f1f18a-3573-4254-ad2f-baaa99a28101-metrics-client-ca\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617437 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-wtmp\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.617720 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.617629    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f1f18a-3573-4254-ad2f-baaa99a28101-root\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.618045 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.618018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-accelerators-collector-config\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.618195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.618172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-textfile\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.618268 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.618217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f1f18a-3573-4254-ad2f-baaa99a28101-metrics-client-ca\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.619351 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.619329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.619935 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.619911    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f1f18a-3573-4254-ad2f-baaa99a28101-node-exporter-tls\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.628355 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.628337    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nr7b\" (UniqueName: \"kubernetes.io/projected/62f1f18a-3573-4254-ad2f-baaa99a28101-kube-api-access-7nr7b\") pod \"node-exporter-6b4dk\" (UID: \"62f1f18a-3573-4254-ad2f-baaa99a28101\") " pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:12.654288 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.654260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:12.654392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.654317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:12.655845 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.655824    2562 patch_prober.go:28] interesting pod/console-6bcd6b88b4-n2529 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body=
Jul 21 15:04:12.655946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.655882    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6bcd6b88b4-n2529" podUID="164e9266-008d-444f-929f-a024a4b567f4" containerName="console" probeResult="failure" output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused"
Jul 21 15:04:12.760405 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:12.760337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6b4dk"
Jul 21 15:04:13.113906 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:13.113877    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q65w7"
Jul 21 15:04:15.768534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:15.768489    2562 patch_prober.go:28] interesting pod/image-registry-68dfbf45b4-5cqzs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 15:04:15.768967 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:15.768549    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 15:04:17.188633 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.188593    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"]
Jul 21 15:04:17.366177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.366146    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"]
Jul 21 15:04:17.366353 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.366279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.370007 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.369923    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k6lg6\""
Jul 21 15:04:17.370007 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.369985    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 15:04:17.463172 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.463095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31385bd2-0a97-4328-869b-ac5b9614c346-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-6r5m5\" (UID: \"31385bd2-0a97-4328-869b-ac5b9614c346\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.463317 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.463237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgtml\" (UniqueName: \"kubernetes.io/projected/31385bd2-0a97-4328-869b-ac5b9614c346-kube-api-access-vgtml\") pod \"monitoring-plugin-7b7b7bc8bf-6r5m5\" (UID: \"31385bd2-0a97-4328-869b-ac5b9614c346\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.535830 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:04:17.535801    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f1f18a_3573_4254_ad2f_baaa99a28101.slice/crio-d9cd7846bb9159a9101673c3d4b64af84a97dd91549607f2541ee3a6af62c2e8 WatchSource:0}: Error finding container d9cd7846bb9159a9101673c3d4b64af84a97dd91549607f2541ee3a6af62c2e8: Status 404 returned error can't find the container with id d9cd7846bb9159a9101673c3d4b64af84a97dd91549607f2541ee3a6af62c2e8
Jul 21 15:04:17.537814 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.537798    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:04:17.564643 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.564616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31385bd2-0a97-4328-869b-ac5b9614c346-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-6r5m5\" (UID: \"31385bd2-0a97-4328-869b-ac5b9614c346\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.564755 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.564690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgtml\" (UniqueName: \"kubernetes.io/projected/31385bd2-0a97-4328-869b-ac5b9614c346-kube-api-access-vgtml\") pod \"monitoring-plugin-7b7b7bc8bf-6r5m5\" (UID: \"31385bd2-0a97-4328-869b-ac5b9614c346\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.566979 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.566958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31385bd2-0a97-4328-869b-ac5b9614c346-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-6r5m5\" (UID: \"31385bd2-0a97-4328-869b-ac5b9614c346\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.572762 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.572739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgtml\" (UniqueName: \"kubernetes.io/projected/31385bd2-0a97-4328-869b-ac5b9614c346-kube-api-access-vgtml\") pod \"monitoring-plugin-7b7b7bc8bf-6r5m5\" (UID: \"31385bd2-0a97-4328-869b-ac5b9614c346\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.677462 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.677437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:17.952693 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:17.952652    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"]
Jul 21 15:04:17.955385 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:04:17.955362    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31385bd2_0a97_4328_869b_ac5b9614c346.slice/crio-d88531846cf9482b4e108f7dbfb6b48068705c7cbf61bf0de556382d9fcc1335 WatchSource:0}: Error finding container d88531846cf9482b4e108f7dbfb6b48068705c7cbf61bf0de556382d9fcc1335: Status 404 returned error can't find the container with id d88531846cf9482b4e108f7dbfb6b48068705c7cbf61bf0de556382d9fcc1335
Jul 21 15:04:18.174390 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.174348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5" event={"ID":"31385bd2-0a97-4328-869b-ac5b9614c346","Type":"ContainerStarted","Data":"d88531846cf9482b4e108f7dbfb6b48068705c7cbf61bf0de556382d9fcc1335"}
Jul 21 15:04:18.175801 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.175759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b4dk" event={"ID":"62f1f18a-3573-4254-ad2f-baaa99a28101","Type":"ContainerStarted","Data":"d9cd7846bb9159a9101673c3d4b64af84a97dd91549607f2541ee3a6af62c2e8"}
Jul 21 15:04:18.177469 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.177439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-x7c6s" event={"ID":"10c11601-ffc9-4175-9c34-000b074d87a4","Type":"ContainerStarted","Data":"cf27ef27014499719dbfdcbc711dee122d56e61a7d52b99c2ad8586c96ce04d6"}
Jul 21 15:04:18.177705 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.177681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:04:18.196108 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.196062    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-x7c6s" podStartSLOduration=0.962921165 podStartE2EDuration="20.196047772s" totalImagesPullingTime="19.233126607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:18.194292021 +0000 UTC m=+309.338205017" watchObservedRunningTime="2026-07-21 15:04:18.196047772 +0000 UTC m=+309.339960743"
Jul 21 15:04:18.196730 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.196705    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-x7c6s"
Jul 21 15:04:18.678285 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.678156    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:04:18.683986 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.683961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.689337 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.688739    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 15:04:18.689337 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.689011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 15:04:18.689337 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.689025    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wq6zw\""
Jul 21 15:04:18.689337 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.689203    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 15:04:18.689337 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.689242    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 15:04:18.689778 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.689413    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 15:04:18.689778 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.689602    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.691776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.691925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.692117    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.692342    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.692550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.692755    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.691776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.693011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.693200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fgqqksap1rsu2\""
Jul 21 15:04:18.697177 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.694926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 15:04:18.705071 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.705047    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.774895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.774947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.774980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config-out\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dvn\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-kube-api-access-n8dvn\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.775946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.776974 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-web-config\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.776974 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.776974 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.776974 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.775536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.877100 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.877052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.877886 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.877860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.878821 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.878802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.878961 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.878947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dvn\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-kube-api-access-n8dvn\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.879924 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.879907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.880052 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.880164 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.880499 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.879865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.880708 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.878743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-web-config\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.880996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.881106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.881216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.881252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config-out\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.881284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.881308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.881470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.881337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.882833 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.882808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.884947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.885591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.886151    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.887271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.889069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.889154    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.889204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.890021    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config-out\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.892672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.891510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.893232 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.893111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.893899 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.893851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.895554 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.895468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.896031 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.895985    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dvn\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-kube-api-access-n8dvn\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.899629 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.899605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.900323 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.900289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.901517 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.901472    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-web-config\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.902141 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.902115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:18.902608 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:18.902563    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:19.006518 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:19.006425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:19.093698 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:19.093466    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:04:19.413040 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:19.413002    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:04:19.418233 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:04:19.418202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c32f44_ebdd_4f49_9fe7_8d889b1f6671.slice/crio-46aa1da4578482266c60b8ad7421848a7d9889dc9d0bc0e8bae58c42f95a15c0 WatchSource:0}: Error finding container 46aa1da4578482266c60b8ad7421848a7d9889dc9d0bc0e8bae58c42f95a15c0: Status 404 returned error can't find the container with id 46aa1da4578482266c60b8ad7421848a7d9889dc9d0bc0e8bae58c42f95a15c0
Jul 21 15:04:20.191068 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.191033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"46aa1da4578482266c60b8ad7421848a7d9889dc9d0bc0e8bae58c42f95a15c0"}
Jul 21 15:04:20.341074 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.341030    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bcd6b88b4-n2529"]
Jul 21 15:04:20.375330 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.375286    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ffb657b9f-vddxn"]
Jul 21 15:04:20.390108 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.390033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.390271 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.390148    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ffb657b9f-vddxn"]
Jul 21 15:04:20.398454 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.398423    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 15:04:20.459613 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.459577    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68dfbf45b4-5cqzs"]
Jul 21 15:04:20.507233 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-trusted-ca-bundle\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.507392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-config\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.507392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-serving-cert\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.507392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-oauth-serving-cert\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.507392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-oauth-config\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.507600 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vz2\" (UniqueName: \"kubernetes.io/projected/7e63dc97-b02a-423f-b205-40f0d6c96d7c-kube-api-access-m4vz2\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.507600 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.507502    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-service-ca\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608024 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.607990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-trusted-ca-bundle\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-config\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-serving-cert\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-oauth-serving-cert\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-oauth-config\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vz2\" (UniqueName: \"kubernetes.io/projected/7e63dc97-b02a-423f-b205-40f0d6c96d7c-kube-api-access-m4vz2\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.608483 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-service-ca\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.609031 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-config\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.609031 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.608997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-oauth-serving-cert\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.609031 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.609012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-service-ca\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.609252 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.609104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-trusted-ca-bundle\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.611345 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.611318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-serving-cert\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.611602 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.611578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-oauth-config\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.618373 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.618345    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vz2\" (UniqueName: \"kubernetes.io/projected/7e63dc97-b02a-423f-b205-40f0d6c96d7c-kube-api-access-m4vz2\") pod \"console-ffb657b9f-vddxn\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") " pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.739451 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.739365    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:20.919682 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:20.919618    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ffb657b9f-vddxn"]
Jul 21 15:04:20.923745 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:04:20.923712    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e63dc97_b02a_423f_b205_40f0d6c96d7c.slice/crio-83a87820cfb0bf91313138f9f49e2c8f51dea32874aa9c494f7d179a425b48f1 WatchSource:0}: Error finding container 83a87820cfb0bf91313138f9f49e2c8f51dea32874aa9c494f7d179a425b48f1: Status 404 returned error can't find the container with id 83a87820cfb0bf91313138f9f49e2c8f51dea32874aa9c494f7d179a425b48f1
Jul 21 15:04:21.197285 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.197249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffb657b9f-vddxn" event={"ID":"7e63dc97-b02a-423f-b205-40f0d6c96d7c","Type":"ContainerStarted","Data":"08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321"}
Jul 21 15:04:21.197453 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.197301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffb657b9f-vddxn" event={"ID":"7e63dc97-b02a-423f-b205-40f0d6c96d7c","Type":"ContainerStarted","Data":"83a87820cfb0bf91313138f9f49e2c8f51dea32874aa9c494f7d179a425b48f1"}
Jul 21 15:04:21.199262 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.199230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5" event={"ID":"31385bd2-0a97-4328-869b-ac5b9614c346","Type":"ContainerStarted","Data":"601c57eed4eeeba9f17dae110bf4cc6f9ba22bb4be262c5667928cf699db269c"}
Jul 21 15:04:21.199403 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.199386    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:21.201281 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.201257    2562 generic.go:356] "Generic (PLEG): container finished" podID="62f1f18a-3573-4254-ad2f-baaa99a28101" containerID="0bbb485294725085219c2f83ab81a7030baa1552a3656474ce126f5a51cbdd64" exitCode=0
Jul 21 15:04:21.201496 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.201408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b4dk" event={"ID":"62f1f18a-3573-4254-ad2f-baaa99a28101","Type":"ContainerDied","Data":"0bbb485294725085219c2f83ab81a7030baa1552a3656474ce126f5a51cbdd64"}
Jul 21 15:04:21.205468 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.205447    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5"
Jul 21 15:04:21.246429 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.246347    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ffb657b9f-vddxn" podStartSLOduration=1.2463279329999999 podStartE2EDuration="1.246327933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:21.219730125 +0000 UTC m=+312.363643098" watchObservedRunningTime="2026-07-21 15:04:21.246327933 +0000 UTC m=+312.390240905"
Jul 21 15:04:21.262770 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.262674    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-6r5m5" podStartSLOduration=1.708757502 podStartE2EDuration="4.262638022s" totalImagesPullingTime="2.55388052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:21.262077252 +0000 UTC m=+312.405990416" watchObservedRunningTime="2026-07-21 15:04:21.262638022 +0000 UTC m=+312.406551008"
Jul 21 15:04:21.298680 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:21.298617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:04:22.208692 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:22.208633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b4dk" event={"ID":"62f1f18a-3573-4254-ad2f-baaa99a28101","Type":"ContainerStarted","Data":"dc23daec9ae9a6383a0a96ef9b5cf6676f0a55e9c07a3805a44cb3d5c5ff4ad2"}
Jul 21 15:04:22.209142 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:22.208715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b4dk" event={"ID":"62f1f18a-3573-4254-ad2f-baaa99a28101","Type":"ContainerStarted","Data":"94b32780c93d4d271dd55d230109209fe84a3a458e36ea46dca8b5fcc6be676b"}
Jul 21 15:04:22.233253 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:22.233201    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6b4dk" podStartSLOduration=7.535372831 podStartE2EDuration="10.233187153s" totalImagesPullingTime="2.598032045s" totalInitContainerRuntime="99.782277ms" isStatefulPod=true podCreationTimestamp="2026-07-21 15:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:22.231615512 +0000 UTC m=+313.375528487" watchObservedRunningTime="2026-07-21 15:04:22.233187153 +0000 UTC m=+313.377100123"
Jul 21 15:04:23.214490 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:23.214456    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61" exitCode=0
Jul 21 15:04:23.214943 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:23.214555    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61"}
Jul 21 15:04:28.241517 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:28.241466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030"}
Jul 21 15:04:28.242026 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:28.241567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9"}
Jul 21 15:04:30.254584 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:30.254553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a"}
Jul 21 15:04:30.739853 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:30.739783    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:30.739853 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:30.739832    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:30.744379 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:30.744348    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:31.261884 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:31.261851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d"}
Jul 21 15:04:31.262315 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:31.261916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b"}
Jul 21 15:04:31.262315 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:31.261945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerStarted","Data":"bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030"}
Jul 21 15:04:31.265722 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:31.265703    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:04:31.294331 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:31.294262    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.858176862 podStartE2EDuration="13.294240652s" totalImagesPullingTime="9.406807379s" totalInitContainerRuntime="29.256411ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:04:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:04:31.291627781 +0000 UTC m=+322.435540762" watchObservedRunningTime="2026-07-21 15:04:31.294240652 +0000 UTC m=+322.438153623"
Jul 21 15:04:34.007227 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:34.007192    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:45.367751 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.367676    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bcd6b88b4-n2529" podUID="164e9266-008d-444f-929f-a024a4b567f4" containerName="console" containerID="cri-o://f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b" gracePeriod=15
Jul 21 15:04:45.486145 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.486097    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e" containerName="registry" containerID="cri-o://fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2" gracePeriod=30
Jul 21 15:04:45.638633 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.638607    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:45.724204 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724168    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-oauth-serving-cert\") pod \"164e9266-008d-444f-929f-a024a4b567f4\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") "
Jul 21 15:04:45.724343 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724240    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-console-config\") pod \"164e9266-008d-444f-929f-a024a4b567f4\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") "
Jul 21 15:04:45.724343 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-service-ca\") pod \"164e9266-008d-444f-929f-a024a4b567f4\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") "
Jul 21 15:04:45.724343 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724288    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-oauth-config\") pod \"164e9266-008d-444f-929f-a024a4b567f4\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") "
Jul 21 15:04:45.724343 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724304    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgzhg\" (UniqueName: \"kubernetes.io/projected/164e9266-008d-444f-929f-a024a4b567f4-kube-api-access-fgzhg\") pod \"164e9266-008d-444f-929f-a024a4b567f4\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") "
Jul 21 15:04:45.724552 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724346    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-serving-cert\") pod \"164e9266-008d-444f-929f-a024a4b567f4\" (UID: \"164e9266-008d-444f-929f-a024a4b567f4\") "
Jul 21 15:04:45.724697 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724632    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "164e9266-008d-444f-929f-a024a4b567f4" (UID: "164e9266-008d-444f-929f-a024a4b567f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:04:45.724790 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724637    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-console-config" (OuterVolumeSpecName: "console-config") pod "164e9266-008d-444f-929f-a024a4b567f4" (UID: "164e9266-008d-444f-929f-a024a4b567f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:04:45.724790 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.724769    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "164e9266-008d-444f-929f-a024a4b567f4" (UID: "164e9266-008d-444f-929f-a024a4b567f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:04:45.726814 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.726789    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164e9266-008d-444f-929f-a024a4b567f4-kube-api-access-fgzhg" (OuterVolumeSpecName: "kube-api-access-fgzhg") pod "164e9266-008d-444f-929f-a024a4b567f4" (UID: "164e9266-008d-444f-929f-a024a4b567f4"). InnerVolumeSpecName "kube-api-access-fgzhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:04:45.728070 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.728048    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "164e9266-008d-444f-929f-a024a4b567f4" (UID: "164e9266-008d-444f-929f-a024a4b567f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:04:45.728146 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.728111    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "164e9266-008d-444f-929f-a024a4b567f4" (UID: "164e9266-008d-444f-929f-a024a4b567f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:04:45.772050 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.772028    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:04:45.825373 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825351    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-image-registry-private-configuration\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825462 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825386    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrtnk\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-kube-api-access-wrtnk\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825462 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825403    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82827dba-9c5f-46f7-868d-e1dac277e03e-ca-trust-extracted\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825551 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825537    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825599 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825583    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-bound-sa-token\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825646    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-trusted-ca\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825722 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825705    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-certificates\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.825775 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.825759    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-installation-pull-secrets\") pod \"82827dba-9c5f-46f7-868d-e1dac277e03e\" (UID: \"82827dba-9c5f-46f7-868d-e1dac277e03e\") "
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826039    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-oauth-config\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826062    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgzhg\" (UniqueName: \"kubernetes.io/projected/164e9266-008d-444f-929f-a024a4b567f4-kube-api-access-fgzhg\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826076    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/164e9266-008d-444f-929f-a024a4b567f4-console-serving-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826088    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-oauth-serving-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826100    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-console-config\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826113    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/164e9266-008d-444f-929f-a024a4b567f4-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826186    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:04:45.826220 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.826170    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:04:45.828278 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.828240    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:04:45.828278 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.828267    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:04:45.828430 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.828389    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:04:45.828491 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.828477    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-kube-api-access-wrtnk" (OuterVolumeSpecName: "kube-api-access-wrtnk") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "kube-api-access-wrtnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:04:45.828550 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.828510    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:04:45.833946 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.833922    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82827dba-9c5f-46f7-868d-e1dac277e03e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "82827dba-9c5f-46f7-868d-e1dac277e03e" (UID: "82827dba-9c5f-46f7-868d-e1dac277e03e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:04:45.927247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927192    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-installation-pull-secrets\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927215    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82827dba-9c5f-46f7-868d-e1dac277e03e-image-registry-private-configuration\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927224    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrtnk\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-kube-api-access-wrtnk\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927232    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82827dba-9c5f-46f7-868d-e1dac277e03e-ca-trust-extracted\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927241    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927247 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927250    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82827dba-9c5f-46f7-868d-e1dac277e03e-bound-sa-token\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927257    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-trusted-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:45.927470 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:45.927265    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82827dba-9c5f-46f7-868d-e1dac277e03e-registry-certificates\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:04:46.323276 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.323218    2562 generic.go:356] "Generic (PLEG): container finished" podID="82827dba-9c5f-46f7-868d-e1dac277e03e" containerID="fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2" exitCode=0
Jul 21 15:04:46.323276 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.323265    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs"
Jul 21 15:04:46.323493 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.323311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" event={"ID":"82827dba-9c5f-46f7-868d-e1dac277e03e","Type":"ContainerDied","Data":"fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2"}
Jul 21 15:04:46.323493 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.323356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfbf45b4-5cqzs" event={"ID":"82827dba-9c5f-46f7-868d-e1dac277e03e","Type":"ContainerDied","Data":"9177e9e2835dcf103fd16a244c6b1dadefd42cadc4d4ed726ac5c06ef358148f"}
Jul 21 15:04:46.323493 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.323383    2562 scope.go:117] "RemoveContainer" containerID="fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2"
Jul 21 15:04:46.324872 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.324848    2562 generic.go:356] "Generic (PLEG): container finished" podID="164e9266-008d-444f-929f-a024a4b567f4" containerID="f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b" exitCode=0
Jul 21 15:04:46.324976 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.324897    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcd6b88b4-n2529"
Jul 21 15:04:46.324976 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.324934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcd6b88b4-n2529" event={"ID":"164e9266-008d-444f-929f-a024a4b567f4","Type":"ContainerDied","Data":"f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b"}
Jul 21 15:04:46.325092 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.324976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcd6b88b4-n2529" event={"ID":"164e9266-008d-444f-929f-a024a4b567f4","Type":"ContainerDied","Data":"1ab52821140fa569b1fcbbc6d3d47eb0866046773a375773f943a5dfdd30d849"}
Jul 21 15:04:46.332641 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.332479    2562 scope.go:117] "RemoveContainer" containerID="fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2"
Jul 21 15:04:46.332950 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:04:46.332909    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2\": container with ID starting with fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2 not found: ID does not exist" containerID="fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2"
Jul 21 15:04:46.333044 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.332962    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2"} err="failed to get container status \"fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2\": rpc error: code = NotFound desc = could not find container \"fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2\": container with ID starting with fa2f1bf18fc2f5a181b65de6208a3c4d15682989c8af8896199599c5f7c8cde2 not found: ID does not exist"
Jul 21 15:04:46.333044 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.333003    2562 scope.go:117] "RemoveContainer" containerID="f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b"
Jul 21 15:04:46.340748 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.340638    2562 scope.go:117] "RemoveContainer" containerID="f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b"
Jul 21 15:04:46.340968 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:04:46.340951    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b\": container with ID starting with f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b not found: ID does not exist" containerID="f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b"
Jul 21 15:04:46.341026 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.340974    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b"} err="failed to get container status \"f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b\": rpc error: code = NotFound desc = could not find container \"f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b\": container with ID starting with f2387703826f76b7a1e3b20f3ef0cf1261cca166db17b319b57162e9b72bef1b not found: ID does not exist"
Jul 21 15:04:46.346202 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.346181    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68dfbf45b4-5cqzs"]
Jul 21 15:04:46.350048 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.350025    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68dfbf45b4-5cqzs"]
Jul 21 15:04:46.360950 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.360932    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bcd6b88b4-n2529"]
Jul 21 15:04:46.362874 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:46.362852    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bcd6b88b4-n2529"]
Jul 21 15:04:47.299467 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:47.299432    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164e9266-008d-444f-929f-a024a4b567f4" path="/var/lib/kubelet/pods/164e9266-008d-444f-929f-a024a4b567f4/volumes"
Jul 21 15:04:47.299966 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:04:47.299856    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e" path="/var/lib/kubelet/pods/82827dba-9c5f-46f7-868d-e1dac277e03e/volumes"
Jul 21 15:05:05.395778 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:05.395749    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc8ef140-2332-4448-8315-d526415f52ff" containerID="b8b929775a8f94003d5988a0b9d2ca25be573cc07f11e79746557c5c4b9e3a24" exitCode=0
Jul 21 15:05:05.396113 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:05.395820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kjtds" event={"ID":"fc8ef140-2332-4448-8315-d526415f52ff","Type":"ContainerDied","Data":"b8b929775a8f94003d5988a0b9d2ca25be573cc07f11e79746557c5c4b9e3a24"}
Jul 21 15:05:05.396162 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:05.396116    2562 scope.go:117] "RemoveContainer" containerID="b8b929775a8f94003d5988a0b9d2ca25be573cc07f11e79746557c5c4b9e3a24"
Jul 21 15:05:06.401763 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:06.401728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-kjtds" event={"ID":"fc8ef140-2332-4448-8315-d526415f52ff","Type":"ContainerStarted","Data":"da4e50f77d8bee22ddbab0398a5bcc33e8caa8be83aa604803e880201df4b157"}
Jul 21 15:05:19.007746 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:19.007711    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:19.031971 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:19.031944    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:19.473679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:19.473633    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:23.210351 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:23.210321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:05:23.212587 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:23.212566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea14e970-a7bf-4b81-9bb1-787e49dfe3b0-metrics-certs\") pod \"network-metrics-daemon-4wcwv\" (UID: \"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0\") " pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:05:23.401587 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:23.401563    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2gv2\""
Jul 21 15:05:23.409489 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:23.409472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wcwv"
Jul 21 15:05:23.533237 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:23.533206    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wcwv"]
Jul 21 15:05:23.536430 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:05:23.536410    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea14e970_a7bf_4b81_9bb1_787e49dfe3b0.slice/crio-c8a88dc6b4abd7e05f829bf79e53439298612be8d8e2cd6de12a401b292a0c80 WatchSource:0}: Error finding container c8a88dc6b4abd7e05f829bf79e53439298612be8d8e2cd6de12a401b292a0c80: Status 404 returned error can't find the container with id c8a88dc6b4abd7e05f829bf79e53439298612be8d8e2cd6de12a401b292a0c80
Jul 21 15:05:24.476789 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:24.476755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wcwv" event={"ID":"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0","Type":"ContainerStarted","Data":"c8a88dc6b4abd7e05f829bf79e53439298612be8d8e2cd6de12a401b292a0c80"}
Jul 21 15:05:25.482125 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:25.482095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wcwv" event={"ID":"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0","Type":"ContainerStarted","Data":"1f7c781655259b4e7ff79bd873ff158b30dabde57c75ebcd45aca2b13454bab1"}
Jul 21 15:05:25.482445 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:25.482156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wcwv" event={"ID":"ea14e970-a7bf-4b81-9bb1-787e49dfe3b0","Type":"ContainerStarted","Data":"1b694ae48bf710b45ed10ebb87bc93e670b1d7ef89993eccb74437c1f70b903a"}
Jul 21 15:05:25.503662 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:25.503622    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4wcwv" podStartSLOduration=374.494915097 podStartE2EDuration="6m15.503608032s" totalImagesPullingTime="1.008692935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:05:25.502028444 +0000 UTC m=+376.645941417" watchObservedRunningTime="2026-07-21 15:05:25.503608032 +0000 UTC m=+376.647521001"
Jul 21 15:05:36.982199 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982159    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:05:36.982679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982492    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy" containerID="cri-o://221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b" gracePeriod=600
Jul 21 15:05:36.982679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982554    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="thanos-sidecar" containerID="cri-o://edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a" gracePeriod=600
Jul 21 15:05:36.982679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982586    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d" gracePeriod=600
Jul 21 15:05:36.982679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982492    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="prometheus" containerID="cri-o://465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9" gracePeriod=600
Jul 21 15:05:36.982679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982628    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-web" containerID="cri-o://bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030" gracePeriod=600
Jul 21 15:05:36.982931 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:36.982599    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="config-reloader" containerID="cri-o://5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030" gracePeriod=600
Jul 21 15:05:37.527086 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527051    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d" exitCode=0
Jul 21 15:05:37.527086 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527078    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b" exitCode=0
Jul 21 15:05:37.527086 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527087    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a" exitCode=0
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527096    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030" exitCode=0
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527103    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9" exitCode=0
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d"}
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527177    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b"}
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a"}
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030"}
Jul 21 15:05:37.527306 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:37.527248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9"}
Jul 21 15:05:38.225753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.225731    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.318384 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318360    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-kubelet-serving-ca-bundle\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-2\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config-out\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8dvn\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-kube-api-access-n8dvn\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318484    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-tls\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318518    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-metrics-client-certs\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318542    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-trusted-ca-bundle\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318568    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-0\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318604    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-1\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318682    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-tls-assets\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-metrics-client-ca\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318759    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-kube-rbac-proxy\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318798    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318822    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-db\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.318862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318847    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-grpc-tls\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318870    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-web-config\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318938    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-thanos-prometheus-http-client-file\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.318973    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.319005    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-serving-certs-ca-bundle\") pod \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\" (UID: \"36c32f44-ebdd-4f49-9fe7-8d889b1f6671\") "
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.319242    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.319247    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.319258    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.319294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.319281    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.319753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.319540    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.320635 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.320605    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.321101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.321077    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:05:38.321430 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.321405    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:05:38.321518 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.321484    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.322274 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.322245    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-kube-api-access-n8dvn" (OuterVolumeSpecName: "kube-api-access-n8dvn") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "kube-api-access-n8dvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:05:38.322362 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.322283    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config-out" (OuterVolumeSpecName: "config-out") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:05:38.322619 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.322576    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:05:38.323295 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.323260    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config" (OuterVolumeSpecName: "config") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.323795 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.323764    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.323881 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.323800    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.324062 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.324027    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.324161 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.324087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.324583 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.324556    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.324709 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.324597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.334321 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.334295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-web-config" (OuterVolumeSpecName: "web-config") pod "36c32f44-ebdd-4f49-9fe7-8d889b1f6671" (UID: "36c32f44-ebdd-4f49-9fe7-8d889b1f6671"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:05:38.420304 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420283    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420304 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420301    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420312    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420321    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420329    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-config-out\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420337    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8dvn\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-kube-api-access-n8dvn\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420345    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420354    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-metrics-client-certs\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420362    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420370    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420377    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420385    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420393    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-tls-assets\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420401    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-configmap-metrics-client-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420408    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-kube-rbac-proxy\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420416    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-prometheus-k8s-db\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420424    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-secret-grpc-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.420440 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.420431    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36c32f44-ebdd-4f49-9fe7-8d889b1f6671-web-config\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:05:38.533397 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.533370    2562 generic.go:356] "Generic (PLEG): container finished" podID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerID="bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030" exitCode=0
Jul 21 15:05:38.533475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.533462    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.533553 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.533455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030"}
Jul 21 15:05:38.533610 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.533599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36c32f44-ebdd-4f49-9fe7-8d889b1f6671","Type":"ContainerDied","Data":"46aa1da4578482266c60b8ad7421848a7d9889dc9d0bc0e8bae58c42f95a15c0"}
Jul 21 15:05:38.533650 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.533633    2562 scope.go:117] "RemoveContainer" containerID="8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d"
Jul 21 15:05:38.540967 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.540954    2562 scope.go:117] "RemoveContainer" containerID="221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b"
Jul 21 15:05:38.547639 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.547625    2562 scope.go:117] "RemoveContainer" containerID="bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030"
Jul 21 15:05:38.553962 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.553945    2562 scope.go:117] "RemoveContainer" containerID="edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a"
Jul 21 15:05:38.560245 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.560228    2562 scope.go:117] "RemoveContainer" containerID="5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030"
Jul 21 15:05:38.564620 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.564602    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:05:38.567418 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.567401    2562 scope.go:117] "RemoveContainer" containerID="465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9"
Jul 21 15:05:38.568700 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.568681    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:05:38.574015 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.574001    2562 scope.go:117] "RemoveContainer" containerID="dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61"
Jul 21 15:05:38.580036 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580022    2562 scope.go:117] "RemoveContainer" containerID="8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d"
Jul 21 15:05:38.580253 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.580236    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d\": container with ID starting with 8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d not found: ID does not exist" containerID="8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d"
Jul 21 15:05:38.580308 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580261    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d"} err="failed to get container status \"8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d\": rpc error: code = NotFound desc = could not find container \"8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d\": container with ID starting with 8084273310aaa6ee8af969ff6a117e10f093b4b9947e14cb0c56e89990ddb86d not found: ID does not exist"
Jul 21 15:05:38.580308 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580279    2562 scope.go:117] "RemoveContainer" containerID="221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b"
Jul 21 15:05:38.580518 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.580501    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b\": container with ID starting with 221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b not found: ID does not exist" containerID="221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b"
Jul 21 15:05:38.580570 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580525    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b"} err="failed to get container status \"221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b\": rpc error: code = NotFound desc = could not find container \"221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b\": container with ID starting with 221346f93852cef7b1c0a342124607d050016ec415d029bc42cb20758e48968b not found: ID does not exist"
Jul 21 15:05:38.580570 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580541    2562 scope.go:117] "RemoveContainer" containerID="bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030"
Jul 21 15:05:38.580807 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.580790    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030\": container with ID starting with bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030 not found: ID does not exist" containerID="bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030"
Jul 21 15:05:38.580859 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580813    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030"} err="failed to get container status \"bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030\": rpc error: code = NotFound desc = could not find container \"bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030\": container with ID starting with bcf5f3c1d2e62a7992d5eb2b72bcf6ba863976756fd0da336dab095da1b7e030 not found: ID does not exist"
Jul 21 15:05:38.580859 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.580827    2562 scope.go:117] "RemoveContainer" containerID="edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a"
Jul 21 15:05:38.581057 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.581042    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a\": container with ID starting with edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a not found: ID does not exist" containerID="edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a"
Jul 21 15:05:38.581101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.581060    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a"} err="failed to get container status \"edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a\": rpc error: code = NotFound desc = could not find container \"edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a\": container with ID starting with edd2ece2e94ce6dc0389960359712201141f8953ec7a3f5e65872e30f12bb48a not found: ID does not exist"
Jul 21 15:05:38.581101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.581074    2562 scope.go:117] "RemoveContainer" containerID="5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030"
Jul 21 15:05:38.581277 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.581261    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030\": container with ID starting with 5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030 not found: ID does not exist" containerID="5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030"
Jul 21 15:05:38.581313 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.581281    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030"} err="failed to get container status \"5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030\": rpc error: code = NotFound desc = could not find container \"5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030\": container with ID starting with 5d27b2b9d6f18bc2833ff6426d89031ad2cabac5281cba24c21aa70831910030 not found: ID does not exist"
Jul 21 15:05:38.581313 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.581293    2562 scope.go:117] "RemoveContainer" containerID="465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9"
Jul 21 15:05:38.583651 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.583632    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9\": container with ID starting with 465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9 not found: ID does not exist" containerID="465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9"
Jul 21 15:05:38.583762 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.583676    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9"} err="failed to get container status \"465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9\": rpc error: code = NotFound desc = could not find container \"465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9\": container with ID starting with 465745d4ef6a838250edd7298e14ba2b14abfccf12ae036732e21a44606dede9 not found: ID does not exist"
Jul 21 15:05:38.583762 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.583697    2562 scope.go:117] "RemoveContainer" containerID="dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61"
Jul 21 15:05:38.584161 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:05:38.584143    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61\": container with ID starting with dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61 not found: ID does not exist" containerID="dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61"
Jul 21 15:05:38.584238 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.584164    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61"} err="failed to get container status \"dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61\": rpc error: code = NotFound desc = could not find container \"dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61\": container with ID starting with dacfede2d04fedc3dad3cf76c132c40899eb3d53c5b9dc89c0a55921be065a61 not found: ID does not exist"
Jul 21 15:05:38.604126 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604102    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:05:38.604426 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604411    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164e9266-008d-444f-929f-a024a4b567f4" containerName="console"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604431    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="164e9266-008d-444f-929f-a024a4b567f4" containerName="console"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604451    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="thanos-sidecar"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604460    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="thanos-sidecar"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604470    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e" containerName="registry"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604478    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e" containerName="registry"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604488    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-web"
Jul 21 15:05:38.604497 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604496    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-web"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604509    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="config-reloader"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604517    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="config-reloader"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604526    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="prometheus"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604533    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="prometheus"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604540    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604545    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604550    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-thanos"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604555    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-thanos"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604563    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="init-config-reloader"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604568    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="init-config-reloader"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604611    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-web"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604618    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="164e9266-008d-444f-929f-a024a4b567f4" containerName="console"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604623    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="config-reloader"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604629    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="82827dba-9c5f-46f7-868d-e1dac277e03e" containerName="registry"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604634    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604639    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="thanos-sidecar"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604644    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="kube-rbac-proxy-thanos"
Jul 21 15:05:38.604753 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.604649    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" containerName="prometheus"
Jul 21 15:05:38.607987 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.607973    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.611450 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.611433    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 15:05:38.611529 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.611509    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 15:05:38.611602 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.611582    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wq6zw\""
Jul 21 15:05:38.614694 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.614566    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 15:05:38.614694 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.614632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fgqqksap1rsu2\""
Jul 21 15:05:38.614862 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.614567    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.615438    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.615547    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.615626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.615768    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.616049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.616060    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.616371    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 15:05:38.616858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.616490    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 15:05:38.617240 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.616965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 15:05:38.617761 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.617742    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 15:05:38.621604 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621721 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621721 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621721 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621871 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621871 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621871 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-config\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621993 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621993 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621993 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.621993 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.621969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp98d\" (UniqueName: \"kubernetes.io/projected/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-kube-api-access-kp98d\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622406 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622406 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.622406 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.622237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.624014 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.623995    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 15:05:38.644543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.644519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:05:38.723457 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723552 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723552 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723552 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723552 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723552 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-config\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp98d\" (UniqueName: \"kubernetes.io/projected/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-kube-api-access-kp98d\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.723811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.723970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.724180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724635 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.724267    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.724635 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.724284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.725174 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.725150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.725747 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.725721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.726983 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.726929    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.727607 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.727193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.727607 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.727549    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.727764 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.727681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.727764 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.727699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.728312 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.728290    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-web-config\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.728404 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.728388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-config-out\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.728456 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.728440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.728766 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.728742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.728836 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.728785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.729263 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.729244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.729366 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.729342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.729636 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.729622    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.729964 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.729949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-config\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.732711 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.732693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp98d\" (UniqueName: \"kubernetes.io/projected/e1dfaca6-8d9a-4504-b1a3-f40eac75cecb-kube-api-access-kp98d\") pod \"prometheus-k8s-0\" (UID: \"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:38.919450 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:38.919426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:39.071507 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:39.071352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:05:39.073255 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:05:39.073229    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dfaca6_8d9a_4504_b1a3_f40eac75cecb.slice/crio-4c49efd380773fc5bbe277bcc597dbeca8b109724a5c7528a69783d06d3515fd WatchSource:0}: Error finding container 4c49efd380773fc5bbe277bcc597dbeca8b109724a5c7528a69783d06d3515fd: Status 404 returned error can't find the container with id 4c49efd380773fc5bbe277bcc597dbeca8b109724a5c7528a69783d06d3515fd
Jul 21 15:05:39.297117 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:39.297061    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c32f44-ebdd-4f49-9fe7-8d889b1f6671" path="/var/lib/kubelet/pods/36c32f44-ebdd-4f49-9fe7-8d889b1f6671/volumes"
Jul 21 15:05:39.538578 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:39.538550    2562 generic.go:356] "Generic (PLEG): container finished" podID="e1dfaca6-8d9a-4504-b1a3-f40eac75cecb" containerID="7f2638b3f3e92b0d426fce044a40bdc35928dcdcda27d012df59c9c031e06ecd" exitCode=0
Jul 21 15:05:39.538578 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:39.538580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerDied","Data":"7f2638b3f3e92b0d426fce044a40bdc35928dcdcda27d012df59c9c031e06ecd"}
Jul 21 15:05:39.538758 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:39.538629    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"4c49efd380773fc5bbe277bcc597dbeca8b109724a5c7528a69783d06d3515fd"}
Jul 21 15:05:40.545025 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.544996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"c84258514c84cf5fb4c373aa905e9b6542436716d3ef89d43ac71a4d9b3787f9"}
Jul 21 15:05:40.545340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.545052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"d933e545ede55a43454adc5e35595abd7bee07fea73a6f6dbf79675f21fee77b"}
Jul 21 15:05:40.545340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.545077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"e9796e632a0dea32f1b8e3b9c2ccc348f613a8eca60802297b38a04d2deead6c"}
Jul 21 15:05:40.545340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.545099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"709c30ed0a56f68bbd4cea91301a884e4b277668c96949b8df2d386b9ef110fb"}
Jul 21 15:05:40.545340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.545121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"13936b998991a4d0349efb38d0b543efdc46d91b418d513cb29b45ea40015b99"}
Jul 21 15:05:40.545340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.545143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e1dfaca6-8d9a-4504-b1a3-f40eac75cecb","Type":"ContainerStarted","Data":"36cf3cad1bb2efdd8835b3c664ce581add1febb94b486696604f2321f28ae7ae"}
Jul 21 15:05:40.592466 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:40.592423    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.574654534 podStartE2EDuration="2.592408708s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.754174ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:05:40.588612991 +0000 UTC m=+391.732525978" watchObservedRunningTime="2026-07-21 15:05:40.592408708 +0000 UTC m=+391.736321677"
Jul 21 15:05:43.919523 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:43.919491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:53.850075 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:05:53.850042    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ffb657b9f-vddxn"]
Jul 21 15:06:18.873284 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:18.873224    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-ffb657b9f-vddxn" podUID="7e63dc97-b02a-423f-b205-40f0d6c96d7c" containerName="console" containerID="cri-o://08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321" gracePeriod=15
Jul 21 15:06:19.112053 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.112023    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.198440    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-service-ca\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.198915    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-serving-cert\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.198982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-trusted-ca-bundle\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199023    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-config\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199060    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4vz2\" (UniqueName: \"kubernetes.io/projected/7e63dc97-b02a-423f-b205-40f0d6c96d7c-kube-api-access-m4vz2\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199100    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-oauth-serving-cert\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199130    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-oauth-config\") pod \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\" (UID: \"7e63dc97-b02a-423f-b205-40f0d6c96d7c\") "
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199165    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199473    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.199521    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-config" (OuterVolumeSpecName: "console-config") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:06:19.200325 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.200311    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:06:19.200908 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.200623    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:06:19.203255 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.203218    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:06:19.204328 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.204302    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e63dc97-b02a-423f-b205-40f0d6c96d7c-kube-api-access-m4vz2" (OuterVolumeSpecName: "kube-api-access-m4vz2") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "kube-api-access-m4vz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:06:19.204846 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.204816    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e63dc97-b02a-423f-b205-40f0d6c96d7c" (UID: "7e63dc97-b02a-423f-b205-40f0d6c96d7c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:06:19.299836 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.299814    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-serving-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.299940 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.299840    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-trusted-ca-bundle\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.299940 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.299854    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-config\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.299940 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.299867    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4vz2\" (UniqueName: \"kubernetes.io/projected/7e63dc97-b02a-423f-b205-40f0d6c96d7c-kube-api-access-m4vz2\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.299940 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.299879    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e63dc97-b02a-423f-b205-40f0d6c96d7c-oauth-serving-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.299940 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.299891    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e63dc97-b02a-423f-b205-40f0d6c96d7c-console-oauth-config\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:06:19.683202 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.683177    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e63dc97-b02a-423f-b205-40f0d6c96d7c" containerID="08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321" exitCode=0
Jul 21 15:06:19.683302 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.683221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffb657b9f-vddxn" event={"ID":"7e63dc97-b02a-423f-b205-40f0d6c96d7c","Type":"ContainerDied","Data":"08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321"}
Jul 21 15:06:19.683302 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.683232    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffb657b9f-vddxn"
Jul 21 15:06:19.683302 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.683265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffb657b9f-vddxn" event={"ID":"7e63dc97-b02a-423f-b205-40f0d6c96d7c","Type":"ContainerDied","Data":"83a87820cfb0bf91313138f9f49e2c8f51dea32874aa9c494f7d179a425b48f1"}
Jul 21 15:06:19.683302 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.683292    2562 scope.go:117] "RemoveContainer" containerID="08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321"
Jul 21 15:06:19.690906 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.690889    2562 scope.go:117] "RemoveContainer" containerID="08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321"
Jul 21 15:06:19.691174 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:06:19.691157    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321\": container with ID starting with 08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321 not found: ID does not exist" containerID="08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321"
Jul 21 15:06:19.691213 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.691182    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321"} err="failed to get container status \"08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321\": rpc error: code = NotFound desc = could not find container \"08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321\": container with ID starting with 08ff3df7d00f1939ae7889855674f26f48977c6307ac927e950385e15fc45321 not found: ID does not exist"
Jul 21 15:06:19.702066 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.702048    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ffb657b9f-vddxn"]
Jul 21 15:06:19.709475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:19.709452    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ffb657b9f-vddxn"]
Jul 21 15:06:21.297315 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:21.297279    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e63dc97-b02a-423f-b205-40f0d6c96d7c" path="/var/lib/kubelet/pods/7e63dc97-b02a-423f-b205-40f0d6c96d7c/volumes"
Jul 21 15:06:38.920338 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:38.920264    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:06:38.935858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:38.935829    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:06:39.763719 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:06:39.763691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:09:09.227112 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:09.227082    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:09:09.228505 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:09.228486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:09:13.592432 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.592397    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"]
Jul 21 15:09:13.594786 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.592676    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e63dc97-b02a-423f-b205-40f0d6c96d7c" containerName="console"
Jul 21 15:09:13.594786 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.592691    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e63dc97-b02a-423f-b205-40f0d6c96d7c" containerName="console"
Jul 21 15:09:13.594786 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.592749    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e63dc97-b02a-423f-b205-40f0d6c96d7c" containerName="console"
Jul 21 15:09:13.595643 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.595628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.597975 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.597948    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 15:09:13.598089 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.598064    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 15:09:13.598951 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.598928    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wgqrx\""
Jul 21 15:09:13.605678 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.605620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"]
Jul 21 15:09:13.695116 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.695095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brzxt\" (UniqueName: \"kubernetes.io/projected/2452ded9-16df-4953-8b53-171898f79f61-kube-api-access-brzxt\") pod \"cert-manager-cainjector-559cdd8c87-qqqqj\" (UID: \"2452ded9-16df-4953-8b53-171898f79f61\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.695214 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.695144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2452ded9-16df-4953-8b53-171898f79f61-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qqqqj\" (UID: \"2452ded9-16df-4953-8b53-171898f79f61\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.795419 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.795391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2452ded9-16df-4953-8b53-171898f79f61-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qqqqj\" (UID: \"2452ded9-16df-4953-8b53-171898f79f61\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.795513 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.795437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brzxt\" (UniqueName: \"kubernetes.io/projected/2452ded9-16df-4953-8b53-171898f79f61-kube-api-access-brzxt\") pod \"cert-manager-cainjector-559cdd8c87-qqqqj\" (UID: \"2452ded9-16df-4953-8b53-171898f79f61\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.803641 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.803608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2452ded9-16df-4953-8b53-171898f79f61-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qqqqj\" (UID: \"2452ded9-16df-4953-8b53-171898f79f61\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.803750 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.803695    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brzxt\" (UniqueName: \"kubernetes.io/projected/2452ded9-16df-4953-8b53-171898f79f61-kube-api-access-brzxt\") pod \"cert-manager-cainjector-559cdd8c87-qqqqj\" (UID: \"2452ded9-16df-4953-8b53-171898f79f61\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:13.910510 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:13.910457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"
Jul 21 15:09:14.036043 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:14.035997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj"]
Jul 21 15:09:14.038892 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:09:14.038867    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2452ded9_16df_4953_8b53_171898f79f61.slice/crio-2ccaecb907eb1906992d057c0bc7201beb0f6513d90eba6869444f431b891950 WatchSource:0}: Error finding container 2ccaecb907eb1906992d057c0bc7201beb0f6513d90eba6869444f431b891950: Status 404 returned error can't find the container with id 2ccaecb907eb1906992d057c0bc7201beb0f6513d90eba6869444f431b891950
Jul 21 15:09:14.290229 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:14.290160    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj" event={"ID":"2452ded9-16df-4953-8b53-171898f79f61","Type":"ContainerStarted","Data":"2ccaecb907eb1906992d057c0bc7201beb0f6513d90eba6869444f431b891950"}
Jul 21 15:09:19.312549 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:19.312440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj" event={"ID":"2452ded9-16df-4953-8b53-171898f79f61","Type":"ContainerStarted","Data":"cd5860d47575e1bba3b68d2896987d9ffea03eacbe6fac2112afbeb7121e9477"}
Jul 21 15:09:19.328386 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:19.328329    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qqqqj" podStartSLOduration=1.342474486 podStartE2EDuration="6.328314139s" totalImagesPullingTime="4.985839653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:19.326805467 +0000 UTC m=+610.470718435" watchObservedRunningTime="2026-07-21 15:09:19.328314139 +0000 UTC m=+610.472227110"
Jul 21 15:09:22.006219 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.006185    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"]
Jul 21 15:09:22.009272 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.009257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.011718 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.011694    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:09:22.011841 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.011720    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 15:09:22.012791 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.012772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g8wg4\""
Jul 21 15:09:22.017892 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.017870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"]
Jul 21 15:09:22.060016 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.059986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49krf\" (UniqueName: \"kubernetes.io/projected/730a2754-f157-4793-a0bb-a207d5179c8b-kube-api-access-49krf\") pod \"openshift-lws-operator-fd8ccff4c-dqwpv\" (UID: \"730a2754-f157-4793-a0bb-a207d5179c8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.060185 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.060066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730a2754-f157-4793-a0bb-a207d5179c8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dqwpv\" (UID: \"730a2754-f157-4793-a0bb-a207d5179c8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.160748 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.160713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730a2754-f157-4793-a0bb-a207d5179c8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dqwpv\" (UID: \"730a2754-f157-4793-a0bb-a207d5179c8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.160916 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.160755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49krf\" (UniqueName: \"kubernetes.io/projected/730a2754-f157-4793-a0bb-a207d5179c8b-kube-api-access-49krf\") pod \"openshift-lws-operator-fd8ccff4c-dqwpv\" (UID: \"730a2754-f157-4793-a0bb-a207d5179c8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.161092 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.161071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730a2754-f157-4793-a0bb-a207d5179c8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dqwpv\" (UID: \"730a2754-f157-4793-a0bb-a207d5179c8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.170041 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.170015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49krf\" (UniqueName: \"kubernetes.io/projected/730a2754-f157-4793-a0bb-a207d5179c8b-kube-api-access-49krf\") pod \"openshift-lws-operator-fd8ccff4c-dqwpv\" (UID: \"730a2754-f157-4793-a0bb-a207d5179c8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.318702 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.318594    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"
Jul 21 15:09:22.450668 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.450627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv"]
Jul 21 15:09:22.453313 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:09:22.453279    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod730a2754_f157_4793_a0bb_a207d5179c8b.slice/crio-b4019ac2623a3a03f423a7f5bb74f7744f7fb60289d101b6deb97f0fd63366fc WatchSource:0}: Error finding container b4019ac2623a3a03f423a7f5bb74f7744f7fb60289d101b6deb97f0fd63366fc: Status 404 returned error can't find the container with id b4019ac2623a3a03f423a7f5bb74f7744f7fb60289d101b6deb97f0fd63366fc
Jul 21 15:09:22.455058 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:22.455040    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:09:23.329118 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:23.329073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv" event={"ID":"730a2754-f157-4793-a0bb-a207d5179c8b","Type":"ContainerStarted","Data":"b4019ac2623a3a03f423a7f5bb74f7744f7fb60289d101b6deb97f0fd63366fc"}
Jul 21 15:09:25.338751 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:25.338717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv" event={"ID":"730a2754-f157-4793-a0bb-a207d5179c8b","Type":"ContainerStarted","Data":"02f3db0331a2a69b48a6f44a49229f79fc93216c11ef3f40cb48c97727533253"}
Jul 21 15:09:25.354842 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:25.354804    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dqwpv" podStartSLOduration=1.8056436900000001 podStartE2EDuration="4.354789729s" totalImagesPullingTime="2.549146039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:25.352896072 +0000 UTC m=+616.496809042" watchObservedRunningTime="2026-07-21 15:09:25.354789729 +0000 UTC m=+616.498702700"
Jul 21 15:09:41.415056 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.415026    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"]
Jul 21 15:09:41.482140 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.482118    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"]
Jul 21 15:09:41.482279 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.482214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.484847 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.484826    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 15:09:41.484971 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.484957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 15:09:41.490376 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.490360    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 15:09:41.490545 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.490526    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2sbsb\""
Jul 21 15:09:41.490611 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.490583    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 15:09:41.503475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.503456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38aebe51-4576-4674-b85a-30c2705dfc5f-tmp\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.503621 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.503489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38aebe51-4576-4674-b85a-30c2705dfc5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.503621 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.503538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/38aebe51-4576-4674-b85a-30c2705dfc5f-manifests\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.503621 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.503573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/38aebe51-4576-4674-b85a-30c2705dfc5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.503621 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.503604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2gz\" (UniqueName: \"kubernetes.io/projected/38aebe51-4576-4674-b85a-30c2705dfc5f-kube-api-access-2r2gz\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.604644 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.604616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/38aebe51-4576-4674-b85a-30c2705dfc5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.604794 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.604649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2gz\" (UniqueName: \"kubernetes.io/projected/38aebe51-4576-4674-b85a-30c2705dfc5f-kube-api-access-2r2gz\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.604794 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.604700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38aebe51-4576-4674-b85a-30c2705dfc5f-tmp\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.604794 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.604717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38aebe51-4576-4674-b85a-30c2705dfc5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.604794 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.604747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/38aebe51-4576-4674-b85a-30c2705dfc5f-manifests\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.605149 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.605130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/38aebe51-4576-4674-b85a-30c2705dfc5f-manifests\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.606978 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.606951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38aebe51-4576-4674-b85a-30c2705dfc5f-tmp\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.607248 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.607230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/38aebe51-4576-4674-b85a-30c2705dfc5f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.607311 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.607258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38aebe51-4576-4674-b85a-30c2705dfc5f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.613260 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.613234    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2gz\" (UniqueName: \"kubernetes.io/projected/38aebe51-4576-4674-b85a-30c2705dfc5f-kube-api-access-2r2gz\") pod \"opendatahub-operator-controller-manager-85b74964cc-xkqsn\" (UID: \"38aebe51-4576-4674-b85a-30c2705dfc5f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.792137 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.792083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:41.944477 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:41.944443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"]
Jul 21 15:09:41.948412 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:09:41.948383    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38aebe51_4576_4674_b85a_30c2705dfc5f.slice/crio-ecce5cd48ff74918f7788f13cca2fda88d6880d22b4f49bacbf88b153dc8ffd4 WatchSource:0}: Error finding container ecce5cd48ff74918f7788f13cca2fda88d6880d22b4f49bacbf88b153dc8ffd4: Status 404 returned error can't find the container with id ecce5cd48ff74918f7788f13cca2fda88d6880d22b4f49bacbf88b153dc8ffd4
Jul 21 15:09:42.402803 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:42.402772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn" event={"ID":"38aebe51-4576-4674-b85a-30c2705dfc5f","Type":"ContainerStarted","Data":"ecce5cd48ff74918f7788f13cca2fda88d6880d22b4f49bacbf88b153dc8ffd4"}
Jul 21 15:09:45.417320 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:45.417290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn" event={"ID":"38aebe51-4576-4674-b85a-30c2705dfc5f","Type":"ContainerStarted","Data":"50e4a53fbc989f2d01937beef6a90d06dff61d9170ba3b7e7d5a3e7e3b6e13d2"}
Jul 21 15:09:46.422891 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:46.422860    2562 generic.go:356] "Generic (PLEG): container finished" podID="38aebe51-4576-4674-b85a-30c2705dfc5f" containerID="50e4a53fbc989f2d01937beef6a90d06dff61d9170ba3b7e7d5a3e7e3b6e13d2" exitCode=0
Jul 21 15:09:46.423254 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:46.422952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn" event={"ID":"38aebe51-4576-4674-b85a-30c2705dfc5f","Type":"ContainerDied","Data":"50e4a53fbc989f2d01937beef6a90d06dff61d9170ba3b7e7d5a3e7e3b6e13d2"}
Jul 21 15:09:47.430269 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:47.430233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn" event={"ID":"38aebe51-4576-4674-b85a-30c2705dfc5f","Type":"ContainerStarted","Data":"1706a865b66a2dace62579f48554bd2bf12145c92810e9cc7bb111fc90700bc0"}
Jul 21 15:09:47.430852 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:47.430341    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:58.439241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:58.439206    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn"
Jul 21 15:09:58.460908 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:09:58.460849    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b74964cc-xkqsn" podStartSLOduration=12.850948023 podStartE2EDuration="17.460829183s" totalImagesPullingTime="3.533798652s" totalInitContainerRuntime="1.076082508s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:47.454057787 +0000 UTC m=+638.597970759" watchObservedRunningTime="2026-07-21 15:09:58.460829183 +0000 UTC m=+649.604742154"
Jul 21 15:10:00.697547 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.697510    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"]
Jul 21 15:10:00.705695 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.705675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.709092 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.709073    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 15:10:00.709197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.709121    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zdfng\""
Jul 21 15:10:00.709197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.709151    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 15:10:00.709197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.709186    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 15:10:00.713699 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.713652    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"]
Jul 21 15:10:00.756342 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.756316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7vf4\" (UniqueName: \"kubernetes.io/projected/255c234e-6ad9-433d-9bfd-978f4fa1d478-kube-api-access-s7vf4\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.756342 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.756342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/255c234e-6ad9-433d-9bfd-978f4fa1d478-cert\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.756464 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.756382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/255c234e-6ad9-433d-9bfd-978f4fa1d478-metrics-cert\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.756563 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.756474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/255c234e-6ad9-433d-9bfd-978f4fa1d478-manager-config\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.857182 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.857158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7vf4\" (UniqueName: \"kubernetes.io/projected/255c234e-6ad9-433d-9bfd-978f4fa1d478-kube-api-access-s7vf4\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.857182 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.857183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/255c234e-6ad9-433d-9bfd-978f4fa1d478-cert\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.857299 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.857223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/255c234e-6ad9-433d-9bfd-978f4fa1d478-metrics-cert\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.857299 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.857251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/255c234e-6ad9-433d-9bfd-978f4fa1d478-manager-config\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.857944 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.857925    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/255c234e-6ad9-433d-9bfd-978f4fa1d478-manager-config\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.859834 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.859815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/255c234e-6ad9-433d-9bfd-978f4fa1d478-cert\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.859957 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.859940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/255c234e-6ad9-433d-9bfd-978f4fa1d478-metrics-cert\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:00.875239 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:00.875213    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7vf4\" (UniqueName: \"kubernetes.io/projected/255c234e-6ad9-433d-9bfd-978f4fa1d478-kube-api-access-s7vf4\") pod \"lws-controller-manager-c4b7cdb88-k5px5\" (UID: \"255c234e-6ad9-433d-9bfd-978f4fa1d478\") " pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:01.015040 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.014989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:01.155693 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.155640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"]
Jul 21 15:10:01.158707 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:10:01.158674    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255c234e_6ad9_433d_9bfd_978f4fa1d478.slice/crio-c8841580bd79d025bd8431f814d54654c07ba74f77b136a60710844a0b3d179d WatchSource:0}: Error finding container c8841580bd79d025bd8431f814d54654c07ba74f77b136a60710844a0b3d179d: Status 404 returned error can't find the container with id c8841580bd79d025bd8431f814d54654c07ba74f77b136a60710844a0b3d179d
Jul 21 15:10:01.489811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.489779    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5" event={"ID":"255c234e-6ad9-433d-9bfd-978f4fa1d478","Type":"ContainerStarted","Data":"c8841580bd79d025bd8431f814d54654c07ba74f77b136a60710844a0b3d179d"}
Jul 21 15:10:01.977426 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.977393    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"]
Jul 21 15:10:01.982197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.982176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:01.985217 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.985193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 15:10:01.985340 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.985201    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 15:10:01.986151 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.986136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-h9hwh\""
Jul 21 15:10:01.986232 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.986155    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 15:10:01.986232 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.986193    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 15:10:01.995717 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:01.995686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"]
Jul 21 15:10:02.066188 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.066163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h28l\" (UniqueName: \"kubernetes.io/projected/20232e27-cf2d-4f98-9673-49435b317214-kube-api-access-7h28l\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.066294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.066193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20232e27-cf2d-4f98-9673-49435b317214-tmp\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.066294 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.066216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20232e27-cf2d-4f98-9673-49435b317214-tls-certs\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.166967 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.166936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h28l\" (UniqueName: \"kubernetes.io/projected/20232e27-cf2d-4f98-9673-49435b317214-kube-api-access-7h28l\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.167093 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.166980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20232e27-cf2d-4f98-9673-49435b317214-tmp\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.167093 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.167014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20232e27-cf2d-4f98-9673-49435b317214-tls-certs\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.170006 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.169980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20232e27-cf2d-4f98-9673-49435b317214-tmp\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.170195 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.170176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20232e27-cf2d-4f98-9673-49435b317214-tls-certs\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.181318 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.181296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h28l\" (UniqueName: \"kubernetes.io/projected/20232e27-cf2d-4f98-9673-49435b317214-kube-api-access-7h28l\") pod \"kube-auth-proxy-7db96775b-9h2tr\" (UID: \"20232e27-cf2d-4f98-9673-49435b317214\") " pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.293353 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.293274    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"
Jul 21 15:10:02.494478 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:02.494438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7db96775b-9h2tr"]
Jul 21 15:10:02.498624 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:10:02.498597    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20232e27_cf2d_4f98_9673_49435b317214.slice/crio-fc4fa6ee8b47aab0cdf642d01769bb67b51e3595a067fdaf84e20863c1b62035 WatchSource:0}: Error finding container fc4fa6ee8b47aab0cdf642d01769bb67b51e3595a067fdaf84e20863c1b62035: Status 404 returned error can't find the container with id fc4fa6ee8b47aab0cdf642d01769bb67b51e3595a067fdaf84e20863c1b62035
Jul 21 15:10:03.503839 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:03.503744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5" event={"ID":"255c234e-6ad9-433d-9bfd-978f4fa1d478","Type":"ContainerStarted","Data":"f218091dbcae335c10f41b142a44cf55d50f565a8dda21e450d97cb25acbb4c8"}
Jul 21 15:10:03.503839 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:03.503829    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:10:03.505096 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:03.505068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr" event={"ID":"20232e27-cf2d-4f98-9673-49435b317214","Type":"ContainerStarted","Data":"fc4fa6ee8b47aab0cdf642d01769bb67b51e3595a067fdaf84e20863c1b62035"}
Jul 21 15:10:03.522279 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:03.522234    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5" podStartSLOduration=1.457394845 podStartE2EDuration="3.522218758s" totalImagesPullingTime="2.064823913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:03.52077341 +0000 UTC m=+654.664686419" watchObservedRunningTime="2026-07-21 15:10:03.522218758 +0000 UTC m=+654.666131729"
Jul 21 15:10:07.525252 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:07.525216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr" event={"ID":"20232e27-cf2d-4f98-9673-49435b317214","Type":"ContainerStarted","Data":"5e97d22f371fbb035a34f5e6b2ba5e94f6da7e83c70ba950f7c8e4613b2ed90f"}
Jul 21 15:10:07.547342 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:07.547292    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7db96775b-9h2tr" podStartSLOduration=2.28658872 podStartE2EDuration="6.547274692s" totalImagesPullingTime="4.260685972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:07.547004761 +0000 UTC m=+658.690917734" watchObservedRunningTime="2026-07-21 15:10:07.547274692 +0000 UTC m=+658.691187664"
Jul 21 15:10:14.512122 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:10:14.512088    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c4b7cdb88-k5px5"
Jul 21 15:11:28.810011 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.809916    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"]
Jul 21 15:11:28.813248 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.813228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:28.817532 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.817496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 15:11:28.817735 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.817575    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4j6sk\""
Jul 21 15:11:28.817735 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.817594    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 15:11:28.818418 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.818392    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 15:11:28.829912 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.829884    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"]
Jul 21 15:11:28.869299 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.869271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxmx\" (UniqueName: \"kubernetes.io/projected/f5de869f-aab0-4333-a5a6-451b0b2c06b0-kube-api-access-2nxmx\") pod \"dns-operator-controller-manager-5546559d7-6q4tb\" (UID: \"f5de869f-aab0-4333-a5a6-451b0b2c06b0\") " pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:28.969772 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.969744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxmx\" (UniqueName: \"kubernetes.io/projected/f5de869f-aab0-4333-a5a6-451b0b2c06b0-kube-api-access-2nxmx\") pod \"dns-operator-controller-manager-5546559d7-6q4tb\" (UID: \"f5de869f-aab0-4333-a5a6-451b0b2c06b0\") " pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:28.985408 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:28.985386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxmx\" (UniqueName: \"kubernetes.io/projected/f5de869f-aab0-4333-a5a6-451b0b2c06b0-kube-api-access-2nxmx\") pod \"dns-operator-controller-manager-5546559d7-6q4tb\" (UID: \"f5de869f-aab0-4333-a5a6-451b0b2c06b0\") " pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:29.124777 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:29.124759    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:29.255479 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:29.255444    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"]
Jul 21 15:11:29.258646 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:11:29.258621    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5de869f_aab0_4333_a5a6_451b0b2c06b0.slice/crio-643472f14e3816f34d175cdaf2a066334792bfd3443ef7a5f86443514eace4c9 WatchSource:0}: Error finding container 643472f14e3816f34d175cdaf2a066334792bfd3443ef7a5f86443514eace4c9: Status 404 returned error can't find the container with id 643472f14e3816f34d175cdaf2a066334792bfd3443ef7a5f86443514eace4c9
Jul 21 15:11:29.865392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:29.865359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb" event={"ID":"f5de869f-aab0-4333-a5a6-451b0b2c06b0","Type":"ContainerStarted","Data":"643472f14e3816f34d175cdaf2a066334792bfd3443ef7a5f86443514eace4c9"}
Jul 21 15:11:31.875000 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:31.874959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb" event={"ID":"f5de869f-aab0-4333-a5a6-451b0b2c06b0","Type":"ContainerStarted","Data":"257724bf75afab0e54edbe910a1802db6b0dd86ee30a2828f0eacca0031f46b6"}
Jul 21 15:11:31.875319 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:31.875095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:31.894827 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:31.894779    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb" podStartSLOduration=1.364402489 podStartE2EDuration="3.894764546s" totalImagesPullingTime="2.530362057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:31.893535445 +0000 UTC m=+743.037448434" watchObservedRunningTime="2026-07-21 15:11:31.894764546 +0000 UTC m=+743.038677516"
Jul 21 15:11:42.882132 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:42.882093    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5546559d7-6q4tb"
Jul 21 15:11:47.697388 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.697355    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"]
Jul 21 15:11:47.700465 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.700449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:47.703553 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.703533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkrwq\""
Jul 21 15:11:47.721314 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.721283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"]
Jul 21 15:11:47.810346 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.810313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brd5l\" (UniqueName: \"kubernetes.io/projected/ab047c1c-4e71-4498-817f-8351129660ea-kube-api-access-brd5l\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:47.810513 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.810353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab047c1c-4e71-4498-817f-8351129660ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:47.911825 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.911785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brd5l\" (UniqueName: \"kubernetes.io/projected/ab047c1c-4e71-4498-817f-8351129660ea-kube-api-access-brd5l\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:47.911825 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.911829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab047c1c-4e71-4498-817f-8351129660ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:47.912212 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.912195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab047c1c-4e71-4498-817f-8351129660ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:47.920208 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:47.920182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brd5l\" (UniqueName: \"kubernetes.io/projected/ab047c1c-4e71-4498-817f-8351129660ea-kube-api-access-brd5l\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:48.010284 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.010195    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:48.146074 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.146042    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"]
Jul 21 15:11:48.149535 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:11:48.149500    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab047c1c_4e71_4498_817f_8351129660ea.slice/crio-4e056aa9fd86f7db4b332515c87b9b6eb1e5fa30703507e3b248750c6ebb3a49 WatchSource:0}: Error finding container 4e056aa9fd86f7db4b332515c87b9b6eb1e5fa30703507e3b248750c6ebb3a49: Status 404 returned error can't find the container with id 4e056aa9fd86f7db4b332515c87b9b6eb1e5fa30703507e3b248750c6ebb3a49
Jul 21 15:11:48.246854 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.246816    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"]
Jul 21 15:11:48.254034 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.254004    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"]
Jul 21 15:11:48.273174 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.273107    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"]
Jul 21 15:11:48.277618 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.277595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.296939 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.296908    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"]
Jul 21 15:11:48.314895 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.314863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w7j4\" (UniqueName: \"kubernetes.io/projected/0641cddf-f254-483a-9662-37a20fc46430-kube-api-access-9w7j4\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-kpk97\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.315032 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.314914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0641cddf-f254-483a-9662-37a20fc46430-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-kpk97\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.415542 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.415505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w7j4\" (UniqueName: \"kubernetes.io/projected/0641cddf-f254-483a-9662-37a20fc46430-kube-api-access-9w7j4\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-kpk97\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.415787 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.415562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0641cddf-f254-483a-9662-37a20fc46430-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-kpk97\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.415928 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.415911    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0641cddf-f254-483a-9662-37a20fc46430-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-kpk97\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.424061 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.424034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w7j4\" (UniqueName: \"kubernetes.io/projected/0641cddf-f254-483a-9662-37a20fc46430-kube-api-access-9w7j4\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-kpk97\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.589812 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.589782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:48.728949 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.728921    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"]
Jul 21 15:11:48.731347 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:11:48.731321    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0641cddf_f254_483a_9662_37a20fc46430.slice/crio-ec84f3b6319534fc15a6470958113a0a1e81677dcde89010421951a606f4d9ce WatchSource:0}: Error finding container ec84f3b6319534fc15a6470958113a0a1e81677dcde89010421951a606f4d9ce: Status 404 returned error can't find the container with id ec84f3b6319534fc15a6470958113a0a1e81677dcde89010421951a606f4d9ce
Jul 21 15:11:48.951949 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:48.951863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97" event={"ID":"0641cddf-f254-483a-9662-37a20fc46430","Type":"ContainerStarted","Data":"ec84f3b6319534fc15a6470958113a0a1e81677dcde89010421951a606f4d9ce"}
Jul 21 15:11:52.979992 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:52.979847    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx" podUID="ab047c1c-4e71-4498-817f-8351129660ea" containerName="manager" containerID="cri-o://f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e" gracePeriod=2
Jul 21 15:11:53.242064 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.242012    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:53.244324 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:11:53.244297    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" is forbidden: User \"system:node:ip-10-0-130-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-165.ec2.internal' and this object" podUID="ab047c1c-4e71-4498-817f-8351129660ea" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:53.358851 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.358817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab047c1c-4e71-4498-817f-8351129660ea-extensions-socket-volume\") pod \"ab047c1c-4e71-4498-817f-8351129660ea\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") "
Jul 21 15:11:53.358989 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.358871    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brd5l\" (UniqueName: \"kubernetes.io/projected/ab047c1c-4e71-4498-817f-8351129660ea-kube-api-access-brd5l\") pod \"ab047c1c-4e71-4498-817f-8351129660ea\" (UID: \"ab047c1c-4e71-4498-817f-8351129660ea\") "
Jul 21 15:11:53.359089 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.359058    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab047c1c-4e71-4498-817f-8351129660ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab047c1c-4e71-4498-817f-8351129660ea" (UID: "ab047c1c-4e71-4498-817f-8351129660ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:11:53.361049 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.361031    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab047c1c-4e71-4498-817f-8351129660ea-kube-api-access-brd5l" (OuterVolumeSpecName: "kube-api-access-brd5l") pod "ab047c1c-4e71-4498-817f-8351129660ea" (UID: "ab047c1c-4e71-4498-817f-8351129660ea"). InnerVolumeSpecName "kube-api-access-brd5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:11:53.459477 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.459442    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab047c1c-4e71-4498-817f-8351129660ea-extensions-socket-volume\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:11:53.459477 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.459470    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brd5l\" (UniqueName: \"kubernetes.io/projected/ab047c1c-4e71-4498-817f-8351129660ea-kube-api-access-brd5l\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:11:53.986359 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.986318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97" event={"ID":"0641cddf-f254-483a-9662-37a20fc46430","Type":"ContainerStarted","Data":"e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc"}
Jul 21 15:11:53.986880 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.986394    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:11:53.987639 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.987611    2562 generic.go:356] "Generic (PLEG): container finished" podID="ab047c1c-4e71-4498-817f-8351129660ea" containerID="f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e" exitCode=2
Jul 21 15:11:53.987768 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.987641    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:53.987768 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.987684    2562 scope.go:117] "RemoveContainer" containerID="f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e"
Jul 21 15:11:53.995859 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.995837    2562 scope.go:117] "RemoveContainer" containerID="f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e"
Jul 21 15:11:53.996094 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:11:53.996076    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e\": container with ID starting with f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e not found: ID does not exist" containerID="f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e"
Jul 21 15:11:53.996146 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:53.996102    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e"} err="failed to get container status \"f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e\": rpc error: code = NotFound desc = could not find container \"f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e\": container with ID starting with f6a624145d70ae69d4503bcd9c4016dca35e98dfad2350e0d0632613f7b87f3e not found: ID does not exist"
Jul 21 15:11:54.012936 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:11:54.012901    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-b54fbbf4c-qdxvx\" is forbidden: User \"system:node:ip-10-0-130-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-165.ec2.internal' and this object" podUID="ab047c1c-4e71-4498-817f-8351129660ea" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-qdxvx"
Jul 21 15:11:54.013173 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:54.013137    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97" podStartSLOduration=1.467807068 podStartE2EDuration="6.01311912s" totalImagesPullingTime="4.545312052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:54.01057899 +0000 UTC m=+765.154491960" watchObservedRunningTime="2026-07-21 15:11:54.01311912 +0000 UTC m=+765.157032091"
Jul 21 15:11:55.298457 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:11:55.298427    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab047c1c-4e71-4498-817f-8351129660ea" path="/var/lib/kubelet/pods/ab047c1c-4e71-4498-817f-8351129660ea/volumes"
Jul 21 15:12:04.995976 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:04.995936    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:12:17.633076 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.633038    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"]
Jul 21 15:12:17.633602 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.633250    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97" podUID="0641cddf-f254-483a-9662-37a20fc46430" containerName="manager" containerID="cri-o://e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc" gracePeriod=10
Jul 21 15:12:17.885748 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.885694    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:12:17.956736 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.956707    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0641cddf-f254-483a-9662-37a20fc46430-extensions-socket-volume\") pod \"0641cddf-f254-483a-9662-37a20fc46430\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") "
Jul 21 15:12:17.956842 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.956758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w7j4\" (UniqueName: \"kubernetes.io/projected/0641cddf-f254-483a-9662-37a20fc46430-kube-api-access-9w7j4\") pod \"0641cddf-f254-483a-9662-37a20fc46430\" (UID: \"0641cddf-f254-483a-9662-37a20fc46430\") "
Jul 21 15:12:17.957045 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.957018    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0641cddf-f254-483a-9662-37a20fc46430-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0641cddf-f254-483a-9662-37a20fc46430" (UID: "0641cddf-f254-483a-9662-37a20fc46430"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:12:17.958877 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:17.958853    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0641cddf-f254-483a-9662-37a20fc46430-kube-api-access-9w7j4" (OuterVolumeSpecName: "kube-api-access-9w7j4") pod "0641cddf-f254-483a-9662-37a20fc46430" (UID: "0641cddf-f254-483a-9662-37a20fc46430"). InnerVolumeSpecName "kube-api-access-9w7j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:12:18.057738 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.057715    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0641cddf-f254-483a-9662-37a20fc46430-extensions-socket-volume\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:12:18.057738 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.057735    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w7j4\" (UniqueName: \"kubernetes.io/projected/0641cddf-f254-483a-9662-37a20fc46430-kube-api-access-9w7j4\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:12:18.102621 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.102594    2562 generic.go:356] "Generic (PLEG): container finished" podID="0641cddf-f254-483a-9662-37a20fc46430" containerID="e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc" exitCode=0
Jul 21 15:12:18.102737 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.102628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97" event={"ID":"0641cddf-f254-483a-9662-37a20fc46430","Type":"ContainerDied","Data":"e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc"}
Jul 21 15:12:18.102737 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.102636    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"
Jul 21 15:12:18.102737 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.102683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97" event={"ID":"0641cddf-f254-483a-9662-37a20fc46430","Type":"ContainerDied","Data":"ec84f3b6319534fc15a6470958113a0a1e81677dcde89010421951a606f4d9ce"}
Jul 21 15:12:18.102737 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.102704    2562 scope.go:117] "RemoveContainer" containerID="e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc"
Jul 21 15:12:18.111207 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.111186    2562 scope.go:117] "RemoveContainer" containerID="e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc"
Jul 21 15:12:18.111479 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:12:18.111459    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc\": container with ID starting with e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc not found: ID does not exist" containerID="e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc"
Jul 21 15:12:18.111536 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.111487    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc"} err="failed to get container status \"e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc\": rpc error: code = NotFound desc = could not find container \"e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc\": container with ID starting with e45e7a5ea272f068f1e5570c045e02b4cf9e8c49dfe5e6d45c211b304f5f42dc not found: ID does not exist"
Jul 21 15:12:18.128693 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.128674    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"]
Jul 21 15:12:18.131678 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:18.131636    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-kpk97"]
Jul 21 15:12:19.297861 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:19.297822    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0641cddf-f254-483a-9662-37a20fc46430" path="/var/lib/kubelet/pods/0641cddf-f254-483a-9662-37a20fc46430/volumes"
Jul 21 15:12:37.047510 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047429    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:37.047982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047779    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab047c1c-4e71-4498-817f-8351129660ea" containerName="manager"
Jul 21 15:12:37.047982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047791    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab047c1c-4e71-4498-817f-8351129660ea" containerName="manager"
Jul 21 15:12:37.047982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047807    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0641cddf-f254-483a-9662-37a20fc46430" containerName="manager"
Jul 21 15:12:37.047982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047813    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0641cddf-f254-483a-9662-37a20fc46430" containerName="manager"
Jul 21 15:12:37.047982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047862    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0641cddf-f254-483a-9662-37a20fc46430" containerName="manager"
Jul 21 15:12:37.047982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.047871    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab047c1c-4e71-4498-817f-8351129660ea" containerName="manager"
Jul 21 15:12:37.050997 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.050977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.053486 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.053466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8gjhb\""
Jul 21 15:12:37.053596 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.053506    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 15:12:37.058881 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.058861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:37.148308 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.148278    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:37.212254 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.212221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e82ec759-20a5-4906-8bd1-44e66d30b8ea-config-file\") pod \"limitador-limitador-ff68ff5cb-sdqxl\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.212429 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.212317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd8qp\" (UniqueName: \"kubernetes.io/projected/e82ec759-20a5-4906-8bd1-44e66d30b8ea-kube-api-access-wd8qp\") pod \"limitador-limitador-ff68ff5cb-sdqxl\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.313688 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.313589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e82ec759-20a5-4906-8bd1-44e66d30b8ea-config-file\") pod \"limitador-limitador-ff68ff5cb-sdqxl\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.313688 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.313682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd8qp\" (UniqueName: \"kubernetes.io/projected/e82ec759-20a5-4906-8bd1-44e66d30b8ea-kube-api-access-wd8qp\") pod \"limitador-limitador-ff68ff5cb-sdqxl\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.314202 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.314182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e82ec759-20a5-4906-8bd1-44e66d30b8ea-config-file\") pod \"limitador-limitador-ff68ff5cb-sdqxl\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.321924 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.321903    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd8qp\" (UniqueName: \"kubernetes.io/projected/e82ec759-20a5-4906-8bd1-44e66d30b8ea-kube-api-access-wd8qp\") pod \"limitador-limitador-ff68ff5cb-sdqxl\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.361952 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.361922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:37.495102 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.495075    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:37.497540 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:12:37.497506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82ec759_20a5_4906_8bd1_44e66d30b8ea.slice/crio-da4345f33c5397b8d8f26ce0981e4075a42542fcddaea867df2886e16c6dad08 WatchSource:0}: Error finding container da4345f33c5397b8d8f26ce0981e4075a42542fcddaea867df2886e16c6dad08: Status 404 returned error can't find the container with id da4345f33c5397b8d8f26ce0981e4075a42542fcddaea867df2886e16c6dad08
Jul 21 15:12:37.843336 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.843301    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6c89bb85-8lw5p"]
Jul 21 15:12:37.847778 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.847758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:37.850350 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.850330    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rmczl\""
Jul 21 15:12:37.862459 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.862436    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-8lw5p"]
Jul 21 15:12:37.975991 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.975952    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8df697c9f-dg4js"]
Jul 21 15:12:37.979153 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.979130    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:12:37.985717 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:37.985691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-dg4js"]
Jul 21 15:12:38.019775 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.019749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxhkt\" (UniqueName: \"kubernetes.io/projected/a918261f-d0d2-4254-9d12-35c148c647a4-kube-api-access-bxhkt\") pod \"authorino-b6c89bb85-8lw5p\" (UID: \"a918261f-d0d2-4254-9d12-35c148c647a4\") " pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:38.121053 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.120963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxhkt\" (UniqueName: \"kubernetes.io/projected/a918261f-d0d2-4254-9d12-35c148c647a4-kube-api-access-bxhkt\") pod \"authorino-b6c89bb85-8lw5p\" (UID: \"a918261f-d0d2-4254-9d12-35c148c647a4\") " pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:38.121053 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.121024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt2db\" (UniqueName: \"kubernetes.io/projected/3d7ff22d-f0fb-43ea-be8e-3f57976ab606-kube-api-access-rt2db\") pod \"authorino-8df697c9f-dg4js\" (UID: \"3d7ff22d-f0fb-43ea-be8e-3f57976ab606\") " pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:12:38.129705 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.129672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxhkt\" (UniqueName: \"kubernetes.io/projected/a918261f-d0d2-4254-9d12-35c148c647a4-kube-api-access-bxhkt\") pod \"authorino-b6c89bb85-8lw5p\" (UID: \"a918261f-d0d2-4254-9d12-35c148c647a4\") " pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:38.157566 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.157533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:38.198176 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.198080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl" event={"ID":"e82ec759-20a5-4906-8bd1-44e66d30b8ea","Type":"ContainerStarted","Data":"da4345f33c5397b8d8f26ce0981e4075a42542fcddaea867df2886e16c6dad08"}
Jul 21 15:12:38.221771 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.221741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt2db\" (UniqueName: \"kubernetes.io/projected/3d7ff22d-f0fb-43ea-be8e-3f57976ab606-kube-api-access-rt2db\") pod \"authorino-8df697c9f-dg4js\" (UID: \"3d7ff22d-f0fb-43ea-be8e-3f57976ab606\") " pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:12:38.230550 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.230528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt2db\" (UniqueName: \"kubernetes.io/projected/3d7ff22d-f0fb-43ea-be8e-3f57976ab606-kube-api-access-rt2db\") pod \"authorino-8df697c9f-dg4js\" (UID: \"3d7ff22d-f0fb-43ea-be8e-3f57976ab606\") " pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:12:38.285593 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.285559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-8lw5p"]
Jul 21 15:12:38.288258 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.288236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:12:38.288469 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:12:38.288441    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda918261f_d0d2_4254_9d12_35c148c647a4.slice/crio-e0e4cd2bf267a267e8f66b9358505872566bf6968a2daa20cd00bb2eef012cac WatchSource:0}: Error finding container e0e4cd2bf267a267e8f66b9358505872566bf6968a2daa20cd00bb2eef012cac: Status 404 returned error can't find the container with id e0e4cd2bf267a267e8f66b9358505872566bf6968a2daa20cd00bb2eef012cac
Jul 21 15:12:38.422002 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:38.421779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-dg4js"]
Jul 21 15:12:38.424490 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:12:38.424467    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d7ff22d_f0fb_43ea_be8e_3f57976ab606.slice/crio-c7bef573d3f1d18446b2fa0054fb1a15c9dbe69ccde1a177bdae29243a18fbf6 WatchSource:0}: Error finding container c7bef573d3f1d18446b2fa0054fb1a15c9dbe69ccde1a177bdae29243a18fbf6: Status 404 returned error can't find the container with id c7bef573d3f1d18446b2fa0054fb1a15c9dbe69ccde1a177bdae29243a18fbf6
Jul 21 15:12:39.205556 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:39.205516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-8lw5p" event={"ID":"a918261f-d0d2-4254-9d12-35c148c647a4","Type":"ContainerStarted","Data":"e0e4cd2bf267a267e8f66b9358505872566bf6968a2daa20cd00bb2eef012cac"}
Jul 21 15:12:39.206994 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:39.206964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-dg4js" event={"ID":"3d7ff22d-f0fb-43ea-be8e-3f57976ab606","Type":"ContainerStarted","Data":"c7bef573d3f1d18446b2fa0054fb1a15c9dbe69ccde1a177bdae29243a18fbf6"}
Jul 21 15:12:44.236893 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.236850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-8lw5p" event={"ID":"a918261f-d0d2-4254-9d12-35c148c647a4","Type":"ContainerStarted","Data":"8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59"}
Jul 21 15:12:44.238808 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.238778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl" event={"ID":"e82ec759-20a5-4906-8bd1-44e66d30b8ea","Type":"ContainerStarted","Data":"35a751ace9afb64abf6f66b5798c53fe029239d081fb84bed668325e6dc75b23"}
Jul 21 15:12:44.238966 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.238894    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:44.240526 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.240502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-dg4js" event={"ID":"3d7ff22d-f0fb-43ea-be8e-3f57976ab606","Type":"ContainerStarted","Data":"4871ac76a89696ebb3a24aa63b89d216bbecc22d77716087908bdf9a315ed6c5"}
Jul 21 15:12:44.253923 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.253879    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6c89bb85-8lw5p" podStartSLOduration=2.250208323 podStartE2EDuration="7.253865817s" totalImagesPullingTime="5.003657494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:44.253101469 +0000 UTC m=+815.397014443" watchObservedRunningTime="2026-07-21 15:12:44.253865817 +0000 UTC m=+815.397778787"
Jul 21 15:12:44.267870 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.267826    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8df697c9f-dg4js" podStartSLOduration=2.4102645 podStartE2EDuration="7.267814375s" totalImagesPullingTime="4.857549875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:44.266751802 +0000 UTC m=+815.410664774" watchObservedRunningTime="2026-07-21 15:12:44.267814375 +0000 UTC m=+815.411727346"
Jul 21 15:12:44.285985 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.285939    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl" podStartSLOduration=1.5017746010000002 podStartE2EDuration="7.285926122s" totalImagesPullingTime="5.784151521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:44.284731025 +0000 UTC m=+815.428643998" watchObservedRunningTime="2026-07-21 15:12:44.285926122 +0000 UTC m=+815.429839094"
Jul 21 15:12:44.296376 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:44.296353    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-8lw5p"]
Jul 21 15:12:46.250125 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:46.250079    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b6c89bb85-8lw5p" podUID="a918261f-d0d2-4254-9d12-35c148c647a4" containerName="authorino" containerID="cri-o://8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59" gracePeriod=30
Jul 21 15:12:46.494864 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:46.494839    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:46.594727 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:46.594696    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxhkt\" (UniqueName: \"kubernetes.io/projected/a918261f-d0d2-4254-9d12-35c148c647a4-kube-api-access-bxhkt\") pod \"a918261f-d0d2-4254-9d12-35c148c647a4\" (UID: \"a918261f-d0d2-4254-9d12-35c148c647a4\") "
Jul 21 15:12:46.596809 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:46.596783    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a918261f-d0d2-4254-9d12-35c148c647a4-kube-api-access-bxhkt" (OuterVolumeSpecName: "kube-api-access-bxhkt") pod "a918261f-d0d2-4254-9d12-35c148c647a4" (UID: "a918261f-d0d2-4254-9d12-35c148c647a4"). InnerVolumeSpecName "kube-api-access-bxhkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:12:46.695335 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:46.695309    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxhkt\" (UniqueName: \"kubernetes.io/projected/a918261f-d0d2-4254-9d12-35c148c647a4-kube-api-access-bxhkt\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:12:47.255990 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.255960    2562 generic.go:356] "Generic (PLEG): container finished" podID="a918261f-d0d2-4254-9d12-35c148c647a4" containerID="8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59" exitCode=0
Jul 21 15:12:47.256366 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.256007    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-8lw5p"
Jul 21 15:12:47.256366 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.256050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-8lw5p" event={"ID":"a918261f-d0d2-4254-9d12-35c148c647a4","Type":"ContainerDied","Data":"8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59"}
Jul 21 15:12:47.256366 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.256087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-8lw5p" event={"ID":"a918261f-d0d2-4254-9d12-35c148c647a4","Type":"ContainerDied","Data":"e0e4cd2bf267a267e8f66b9358505872566bf6968a2daa20cd00bb2eef012cac"}
Jul 21 15:12:47.256366 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.256106    2562 scope.go:117] "RemoveContainer" containerID="8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59"
Jul 21 15:12:47.264563 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.264549    2562 scope.go:117] "RemoveContainer" containerID="8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59"
Jul 21 15:12:47.264822 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:12:47.264804    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59\": container with ID starting with 8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59 not found: ID does not exist" containerID="8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59"
Jul 21 15:12:47.264884 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.264831    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59"} err="failed to get container status \"8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59\": rpc error: code = NotFound desc = could not find container \"8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59\": container with ID starting with 8675f442bbe2ee87a76d8be836bc4a45f075e3cb2e7b4182904151ceb2694a59 not found: ID does not exist"
Jul 21 15:12:47.276540 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.276516    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-8lw5p"]
Jul 21 15:12:47.279185 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.279167    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-8lw5p"]
Jul 21 15:12:47.298014 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:47.297986    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a918261f-d0d2-4254-9d12-35c148c647a4" path="/var/lib/kubelet/pods/a918261f-d0d2-4254-9d12-35c148c647a4/volumes"
Jul 21 15:12:53.803927 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:53.803887    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:53.804412 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:53.804110    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl" podUID="e82ec759-20a5-4906-8bd1-44e66d30b8ea" containerName="limitador" containerID="cri-o://35a751ace9afb64abf6f66b5798c53fe029239d081fb84bed668325e6dc75b23" gracePeriod=30
Jul 21 15:12:53.806288 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:53.806264    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:54.292973 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.292946    2562 generic.go:356] "Generic (PLEG): container finished" podID="e82ec759-20a5-4906-8bd1-44e66d30b8ea" containerID="35a751ace9afb64abf6f66b5798c53fe029239d081fb84bed668325e6dc75b23" exitCode=0
Jul 21 15:12:54.293122 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.292985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl" event={"ID":"e82ec759-20a5-4906-8bd1-44e66d30b8ea","Type":"ContainerDied","Data":"35a751ace9afb64abf6f66b5798c53fe029239d081fb84bed668325e6dc75b23"}
Jul 21 15:12:54.351910 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.351883    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:54.452983 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.452899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd8qp\" (UniqueName: \"kubernetes.io/projected/e82ec759-20a5-4906-8bd1-44e66d30b8ea-kube-api-access-wd8qp\") pod \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") "
Jul 21 15:12:54.452983 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.452953    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e82ec759-20a5-4906-8bd1-44e66d30b8ea-config-file\") pod \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\" (UID: \"e82ec759-20a5-4906-8bd1-44e66d30b8ea\") "
Jul 21 15:12:54.453326 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.453295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e82ec759-20a5-4906-8bd1-44e66d30b8ea-config-file" (OuterVolumeSpecName: "config-file") pod "e82ec759-20a5-4906-8bd1-44e66d30b8ea" (UID: "e82ec759-20a5-4906-8bd1-44e66d30b8ea"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:12:54.455183 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.455159    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e82ec759-20a5-4906-8bd1-44e66d30b8ea-kube-api-access-wd8qp" (OuterVolumeSpecName: "kube-api-access-wd8qp") pod "e82ec759-20a5-4906-8bd1-44e66d30b8ea" (UID: "e82ec759-20a5-4906-8bd1-44e66d30b8ea"). InnerVolumeSpecName "kube-api-access-wd8qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:12:54.553590 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.553551    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd8qp\" (UniqueName: \"kubernetes.io/projected/e82ec759-20a5-4906-8bd1-44e66d30b8ea-kube-api-access-wd8qp\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:12:54.553590 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:54.553587    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e82ec759-20a5-4906-8bd1-44e66d30b8ea-config-file\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:12:55.297985 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.297945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl" event={"ID":"e82ec759-20a5-4906-8bd1-44e66d30b8ea","Type":"ContainerDied","Data":"da4345f33c5397b8d8f26ce0981e4075a42542fcddaea867df2886e16c6dad08"}
Jul 21 15:12:55.298458 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.298007    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"
Jul 21 15:12:55.298458 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.298016    2562 scope.go:117] "RemoveContainer" containerID="35a751ace9afb64abf6f66b5798c53fe029239d081fb84bed668325e6dc75b23"
Jul 21 15:12:55.338098 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.338065    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:55.347598 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.347447    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-sdqxl"]
Jul 21 15:12:55.658796 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.658758    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"]
Jul 21 15:12:55.659100 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.659088    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e82ec759-20a5-4906-8bd1-44e66d30b8ea" containerName="limitador"
Jul 21 15:12:55.659139 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.659102    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e82ec759-20a5-4906-8bd1-44e66d30b8ea" containerName="limitador"
Jul 21 15:12:55.659139 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.659109    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a918261f-d0d2-4254-9d12-35c148c647a4" containerName="authorino"
Jul 21 15:12:55.659139 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.659114    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a918261f-d0d2-4254-9d12-35c148c647a4" containerName="authorino"
Jul 21 15:12:55.659230 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.659174    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a918261f-d0d2-4254-9d12-35c148c647a4" containerName="authorino"
Jul 21 15:12:55.659230 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.659182    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e82ec759-20a5-4906-8bd1-44e66d30b8ea" containerName="limitador"
Jul 21 15:12:55.663297 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.663277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.665890 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.665871    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-d68wb\""
Jul 21 15:12:55.665987 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.665885    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 15:12:55.665987 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.665926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 15:12:55.665987 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.665943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 15:12:55.670436 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.670379    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"]
Jul 21 15:12:55.762943 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.762915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgwk\" (UniqueName: \"kubernetes.io/projected/f310ab49-9476-42c2-a732-0f5a65d010ac-kube-api-access-4zgwk\") pod \"postgres-69fb4594cf-tzz66\" (UID: \"f310ab49-9476-42c2-a732-0f5a65d010ac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.763123 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.762953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f310ab49-9476-42c2-a732-0f5a65d010ac-data\") pod \"postgres-69fb4594cf-tzz66\" (UID: \"f310ab49-9476-42c2-a732-0f5a65d010ac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.864335 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.864298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgwk\" (UniqueName: \"kubernetes.io/projected/f310ab49-9476-42c2-a732-0f5a65d010ac-kube-api-access-4zgwk\") pod \"postgres-69fb4594cf-tzz66\" (UID: \"f310ab49-9476-42c2-a732-0f5a65d010ac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.864507 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.864346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f310ab49-9476-42c2-a732-0f5a65d010ac-data\") pod \"postgres-69fb4594cf-tzz66\" (UID: \"f310ab49-9476-42c2-a732-0f5a65d010ac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.864775 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.864755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f310ab49-9476-42c2-a732-0f5a65d010ac-data\") pod \"postgres-69fb4594cf-tzz66\" (UID: \"f310ab49-9476-42c2-a732-0f5a65d010ac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.872792 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.872770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgwk\" (UniqueName: \"kubernetes.io/projected/f310ab49-9476-42c2-a732-0f5a65d010ac-kube-api-access-4zgwk\") pod \"postgres-69fb4594cf-tzz66\" (UID: \"f310ab49-9476-42c2-a732-0f5a65d010ac\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:55.973907 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:55.973813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:12:56.106114 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:56.106077    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"]
Jul 21 15:12:56.109339 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:12:56.109312    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf310ab49_9476_42c2_a732_0f5a65d010ac.slice/crio-f8ce7f3d97734ee81f3912bfaf4787d6fead9cd9c901e91ce510ae5a9b110b2d WatchSource:0}: Error finding container f8ce7f3d97734ee81f3912bfaf4787d6fead9cd9c901e91ce510ae5a9b110b2d: Status 404 returned error can't find the container with id f8ce7f3d97734ee81f3912bfaf4787d6fead9cd9c901e91ce510ae5a9b110b2d
Jul 21 15:12:56.304749 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:56.304639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66" event={"ID":"f310ab49-9476-42c2-a732-0f5a65d010ac","Type":"ContainerStarted","Data":"f8ce7f3d97734ee81f3912bfaf4787d6fead9cd9c901e91ce510ae5a9b110b2d"}
Jul 21 15:12:57.305345 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:12:57.304997    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e82ec759-20a5-4906-8bd1-44e66d30b8ea" path="/var/lib/kubelet/pods/e82ec759-20a5-4906-8bd1-44e66d30b8ea/volumes"
Jul 21 15:13:02.337196 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:02.337158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66" event={"ID":"f310ab49-9476-42c2-a732-0f5a65d010ac","Type":"ContainerStarted","Data":"7910977db663ad9e942c03cacd4709cb00c4db3c8e0a47ea1924d67ce620cabe"}
Jul 21 15:13:02.337546 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:02.337235    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:13:02.353562 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:02.353518    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66" podStartSLOduration=2.175034589 podStartE2EDuration="7.353498445s" totalImagesPullingTime="5.178463856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:02.352157524 +0000 UTC m=+833.496070495" watchObservedRunningTime="2026-07-21 15:13:02.353498445 +0000 UTC m=+833.497411415"
Jul 21 15:13:08.371999 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:08.371966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tzz66"
Jul 21 15:13:08.984801 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:08.984766    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-vcpg4"]
Jul 21 15:13:08.989807 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:08.989788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:08.998812 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:08.998791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-vcpg4"]
Jul 21 15:13:09.062320 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.062290    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-vcpg4"]
Jul 21 15:13:09.062552 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:13:09.062532    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s86hx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4" podUID="c5e22d84-1540-4133-9c4e-05bcca563fc4"
Jul 21 15:13:09.082019 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.081987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86hx\" (UniqueName: \"kubernetes.io/projected/c5e22d84-1540-4133-9c4e-05bcca563fc4-kube-api-access-s86hx\") pod \"authorino-6dbc6c7c8d-vcpg4\" (UID: \"c5e22d84-1540-4133-9c4e-05bcca563fc4\") " pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:09.093185 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.093163    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76dd94b454-9l8z9"]
Jul 21 15:13:09.096349 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.096319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.098629 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.098611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 15:13:09.104709 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.104686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76dd94b454-9l8z9"]
Jul 21 15:13:09.182362 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.182336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9cc773b5-bb02-45e3-89f2-db0c127924f7-tls-cert\") pod \"authorino-76dd94b454-9l8z9\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") " pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.182508 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.182377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfbk\" (UniqueName: \"kubernetes.io/projected/9cc773b5-bb02-45e3-89f2-db0c127924f7-kube-api-access-fwfbk\") pod \"authorino-76dd94b454-9l8z9\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") " pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.182508 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.182399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s86hx\" (UniqueName: \"kubernetes.io/projected/c5e22d84-1540-4133-9c4e-05bcca563fc4-kube-api-access-s86hx\") pod \"authorino-6dbc6c7c8d-vcpg4\" (UID: \"c5e22d84-1540-4133-9c4e-05bcca563fc4\") " pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:09.193185 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.193160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86hx\" (UniqueName: \"kubernetes.io/projected/c5e22d84-1540-4133-9c4e-05bcca563fc4-kube-api-access-s86hx\") pod \"authorino-6dbc6c7c8d-vcpg4\" (UID: \"c5e22d84-1540-4133-9c4e-05bcca563fc4\") " pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:09.231139 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.231107    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dd94b454-9l8z9"]
Jul 21 15:13:09.231357 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:13:09.231338    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fwfbk tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76dd94b454-9l8z9" podUID="9cc773b5-bb02-45e3-89f2-db0c127924f7"
Jul 21 15:13:09.283067 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.283041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9cc773b5-bb02-45e3-89f2-db0c127924f7-tls-cert\") pod \"authorino-76dd94b454-9l8z9\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") " pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.283165 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.283087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfbk\" (UniqueName: \"kubernetes.io/projected/9cc773b5-bb02-45e3-89f2-db0c127924f7-kube-api-access-fwfbk\") pod \"authorino-76dd94b454-9l8z9\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") " pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.285436 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.285416    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 15:13:09.292026 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.292008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfbk\" (UniqueName: \"kubernetes.io/projected/9cc773b5-bb02-45e3-89f2-db0c127924f7-kube-api-access-fwfbk\") pod \"authorino-76dd94b454-9l8z9\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") " pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.296155 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.296132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9cc773b5-bb02-45e3-89f2-db0c127924f7-tls-cert\") pod \"authorino-76dd94b454-9l8z9\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") " pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.367783 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.367758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.367911 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.367789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:09.376036 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.376020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:09.378085 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.378070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:09.484323 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.484293    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwfbk\" (UniqueName: \"kubernetes.io/projected/9cc773b5-bb02-45e3-89f2-db0c127924f7-kube-api-access-fwfbk\") pod \"9cc773b5-bb02-45e3-89f2-db0c127924f7\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") "
Jul 21 15:13:09.484476 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.484346    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s86hx\" (UniqueName: \"kubernetes.io/projected/c5e22d84-1540-4133-9c4e-05bcca563fc4-kube-api-access-s86hx\") pod \"c5e22d84-1540-4133-9c4e-05bcca563fc4\" (UID: \"c5e22d84-1540-4133-9c4e-05bcca563fc4\") "
Jul 21 15:13:09.484476 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.484419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9cc773b5-bb02-45e3-89f2-db0c127924f7-tls-cert\") pod \"9cc773b5-bb02-45e3-89f2-db0c127924f7\" (UID: \"9cc773b5-bb02-45e3-89f2-db0c127924f7\") "
Jul 21 15:13:09.486686 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.486622    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc773b5-bb02-45e3-89f2-db0c127924f7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9cc773b5-bb02-45e3-89f2-db0c127924f7" (UID: "9cc773b5-bb02-45e3-89f2-db0c127924f7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:13:09.486828 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.486679    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e22d84-1540-4133-9c4e-05bcca563fc4-kube-api-access-s86hx" (OuterVolumeSpecName: "kube-api-access-s86hx") pod "c5e22d84-1540-4133-9c4e-05bcca563fc4" (UID: "c5e22d84-1540-4133-9c4e-05bcca563fc4"). InnerVolumeSpecName "kube-api-access-s86hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:13:09.486828 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.486763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc773b5-bb02-45e3-89f2-db0c127924f7-kube-api-access-fwfbk" (OuterVolumeSpecName: "kube-api-access-fwfbk") pod "9cc773b5-bb02-45e3-89f2-db0c127924f7" (UID: "9cc773b5-bb02-45e3-89f2-db0c127924f7"). InnerVolumeSpecName "kube-api-access-fwfbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:13:09.585197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.585119    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9cc773b5-bb02-45e3-89f2-db0c127924f7-tls-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:13:09.585197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.585157    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwfbk\" (UniqueName: \"kubernetes.io/projected/9cc773b5-bb02-45e3-89f2-db0c127924f7-kube-api-access-fwfbk\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:13:09.585197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:09.585170    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s86hx\" (UniqueName: \"kubernetes.io/projected/c5e22d84-1540-4133-9c4e-05bcca563fc4-kube-api-access-s86hx\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:13:10.372392 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:10.372362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-9l8z9"
Jul 21 15:13:10.372539 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:10.372366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-vcpg4"
Jul 21 15:13:10.406640 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:10.406613    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-vcpg4"]
Jul 21 15:13:10.410337 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:10.410314    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-vcpg4"]
Jul 21 15:13:10.434044 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:10.434017    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dd94b454-9l8z9"]
Jul 21 15:13:10.436154 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:10.436128    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76dd94b454-9l8z9"]
Jul 21 15:13:11.298961 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:11.298918    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc773b5-bb02-45e3-89f2-db0c127924f7" path="/var/lib/kubelet/pods/9cc773b5-bb02-45e3-89f2-db0c127924f7/volumes"
Jul 21 15:13:11.299201 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:11.299182    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5e22d84-1540-4133-9c4e-05bcca563fc4" path="/var/lib/kubelet/pods/c5e22d84-1540-4133-9c4e-05bcca563fc4/volumes"
Jul 21 15:13:12.964182 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:12.964150    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-dg4js"]
Jul 21 15:13:12.964549 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:12.964361    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8df697c9f-dg4js" podUID="3d7ff22d-f0fb-43ea-be8e-3f57976ab606" containerName="authorino" containerID="cri-o://4871ac76a89696ebb3a24aa63b89d216bbecc22d77716087908bdf9a315ed6c5" gracePeriod=30
Jul 21 15:13:13.386413 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:13.386384    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d7ff22d-f0fb-43ea-be8e-3f57976ab606" containerID="4871ac76a89696ebb3a24aa63b89d216bbecc22d77716087908bdf9a315ed6c5" exitCode=0
Jul 21 15:13:13.386539 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:13.386456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-dg4js" event={"ID":"3d7ff22d-f0fb-43ea-be8e-3f57976ab606","Type":"ContainerDied","Data":"4871ac76a89696ebb3a24aa63b89d216bbecc22d77716087908bdf9a315ed6c5"}
Jul 21 15:13:13.777880 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:13.777853    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:13:13.920690 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:13.920585    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt2db\" (UniqueName: \"kubernetes.io/projected/3d7ff22d-f0fb-43ea-be8e-3f57976ab606-kube-api-access-rt2db\") pod \"3d7ff22d-f0fb-43ea-be8e-3f57976ab606\" (UID: \"3d7ff22d-f0fb-43ea-be8e-3f57976ab606\") "
Jul 21 15:13:13.922940 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:13.922909    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7ff22d-f0fb-43ea-be8e-3f57976ab606-kube-api-access-rt2db" (OuterVolumeSpecName: "kube-api-access-rt2db") pod "3d7ff22d-f0fb-43ea-be8e-3f57976ab606" (UID: "3d7ff22d-f0fb-43ea-be8e-3f57976ab606"). InnerVolumeSpecName "kube-api-access-rt2db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:13:14.021736 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:14.021712    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt2db\" (UniqueName: \"kubernetes.io/projected/3d7ff22d-f0fb-43ea-be8e-3f57976ab606-kube-api-access-rt2db\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:13:14.392237 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:14.392208    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-dg4js"
Jul 21 15:13:14.392415 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:14.392253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-dg4js" event={"ID":"3d7ff22d-f0fb-43ea-be8e-3f57976ab606","Type":"ContainerDied","Data":"c7bef573d3f1d18446b2fa0054fb1a15c9dbe69ccde1a177bdae29243a18fbf6"}
Jul 21 15:13:14.392415 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:14.392305    2562 scope.go:117] "RemoveContainer" containerID="4871ac76a89696ebb3a24aa63b89d216bbecc22d77716087908bdf9a315ed6c5"
Jul 21 15:13:14.413393 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:14.413367    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-dg4js"]
Jul 21 15:13:14.416960 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:14.416934    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8df697c9f-dg4js"]
Jul 21 15:13:15.297972 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:15.297945    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7ff22d-f0fb-43ea-be8e-3f57976ab606" path="/var/lib/kubelet/pods/3d7ff22d-f0fb-43ea-be8e-3f57976ab606/volumes"
Jul 21 15:13:18.124009 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.123979    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76d74cbb86-v5bz6"]
Jul 21 15:13:18.124373 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.124299    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7ff22d-f0fb-43ea-be8e-3f57976ab606" containerName="authorino"
Jul 21 15:13:18.124373 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.124310    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7ff22d-f0fb-43ea-be8e-3f57976ab606" containerName="authorino"
Jul 21 15:13:18.124373 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.124369    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7ff22d-f0fb-43ea-be8e-3f57976ab606" containerName="authorino"
Jul 21 15:13:18.128941 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.128918    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.133413 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.133394    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 15:13:18.133535 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.133434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mc9vp\""
Jul 21 15:13:18.133791 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.133776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 15:13:18.140314 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.140291    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d74cbb86-v5bz6"]
Jul 21 15:13:18.250613 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.250578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.250613 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.250621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w9qb\" (UniqueName: \"kubernetes.io/projected/9e12ca83-dee7-4045-a8c2-1ebe2c889344-kube-api-access-8w9qb\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.316509 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.316471    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65db74b7cb-8bk2t"]
Jul 21 15:13:18.318887 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.318865    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.330035 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.330006    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-8bk2t"]
Jul 21 15:13:18.351888 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.351848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.351888 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.351887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w9qb\" (UniqueName: \"kubernetes.io/projected/9e12ca83-dee7-4045-a8c2-1ebe2c889344-kube-api-access-8w9qb\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.352159 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:13:18.351991    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 15:13:18.352159 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:13:18.352061    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert podName:9e12ca83-dee7-4045-a8c2-1ebe2c889344 nodeName:}" failed. No retries permitted until 2026-07-21 15:13:18.852041138 +0000 UTC m=+849.995954098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert") pod "maas-controller-76d74cbb86-v5bz6" (UID: "9e12ca83-dee7-4045-a8c2-1ebe2c889344") : secret "maas-controller-webhook-cert" not found
Jul 21 15:13:18.361050 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.361017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w9qb\" (UniqueName: \"kubernetes.io/projected/9e12ca83-dee7-4045-a8c2-1ebe2c889344-kube-api-access-8w9qb\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.453255 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.453166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wph5l\" (UniqueName: \"kubernetes.io/projected/48dbce92-01f4-48e9-8855-636f10539c1d-kube-api-access-wph5l\") pod \"maas-controller-65db74b7cb-8bk2t\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") " pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.453255 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.453223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48dbce92-01f4-48e9-8855-636f10539c1d-webhook-cert\") pod \"maas-controller-65db74b7cb-8bk2t\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") " pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.554232 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.554193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48dbce92-01f4-48e9-8855-636f10539c1d-webhook-cert\") pod \"maas-controller-65db74b7cb-8bk2t\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") " pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.554410 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.554305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wph5l\" (UniqueName: \"kubernetes.io/projected/48dbce92-01f4-48e9-8855-636f10539c1d-kube-api-access-wph5l\") pod \"maas-controller-65db74b7cb-8bk2t\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") " pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.556958 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.556935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48dbce92-01f4-48e9-8855-636f10539c1d-webhook-cert\") pod \"maas-controller-65db74b7cb-8bk2t\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") " pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.563034 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.563002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wph5l\" (UniqueName: \"kubernetes.io/projected/48dbce92-01f4-48e9-8855-636f10539c1d-kube-api-access-wph5l\") pod \"maas-controller-65db74b7cb-8bk2t\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") " pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.628823 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.628782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:18.766735 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.766703    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-8bk2t"]
Jul 21 15:13:18.770215 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:13:18.770188    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dbce92_01f4_48e9_8855_636f10539c1d.slice/crio-44a1e705feb3d0475277c32d52d1cd3d82948786aea14fb7bbb3f3d7bee884a9 WatchSource:0}: Error finding container 44a1e705feb3d0475277c32d52d1cd3d82948786aea14fb7bbb3f3d7bee884a9: Status 404 returned error can't find the container with id 44a1e705feb3d0475277c32d52d1cd3d82948786aea14fb7bbb3f3d7bee884a9
Jul 21 15:13:18.857411 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.857373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:18.859962 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:18.859944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert\") pod \"maas-controller-76d74cbb86-v5bz6\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") " pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:19.039732 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:19.039628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:19.175938 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:19.175860    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d74cbb86-v5bz6"]
Jul 21 15:13:19.178053 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:13:19.178025    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e12ca83_dee7_4045_a8c2_1ebe2c889344.slice/crio-84cb2422c6e4623e5bcb55d890f8b19a309ce7f1c0b912e432082f57576f152b WatchSource:0}: Error finding container 84cb2422c6e4623e5bcb55d890f8b19a309ce7f1c0b912e432082f57576f152b: Status 404 returned error can't find the container with id 84cb2422c6e4623e5bcb55d890f8b19a309ce7f1c0b912e432082f57576f152b
Jul 21 15:13:19.415057 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:19.415023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-8bk2t" event={"ID":"48dbce92-01f4-48e9-8855-636f10539c1d","Type":"ContainerStarted","Data":"44a1e705feb3d0475277c32d52d1cd3d82948786aea14fb7bbb3f3d7bee884a9"}
Jul 21 15:13:19.416341 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:19.416316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d74cbb86-v5bz6" event={"ID":"9e12ca83-dee7-4045-a8c2-1ebe2c889344","Type":"ContainerStarted","Data":"84cb2422c6e4623e5bcb55d890f8b19a309ce7f1c0b912e432082f57576f152b"}
Jul 21 15:13:22.433843 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:22.433801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d74cbb86-v5bz6" event={"ID":"9e12ca83-dee7-4045-a8c2-1ebe2c889344","Type":"ContainerStarted","Data":"78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e"}
Jul 21 15:13:22.434317 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:22.433872    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:22.435349 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:22.435323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-8bk2t" event={"ID":"48dbce92-01f4-48e9-8855-636f10539c1d","Type":"ContainerStarted","Data":"ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c"}
Jul 21 15:13:22.435444 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:22.435382    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:22.456651 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:22.456606    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76d74cbb86-v5bz6" podStartSLOduration=1.600107817 podStartE2EDuration="4.456591332s" totalImagesPullingTime="2.856483515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:22.454283266 +0000 UTC m=+853.598196237" watchObservedRunningTime="2026-07-21 15:13:22.456591332 +0000 UTC m=+853.600504302"
Jul 21 15:13:22.474768 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:22.474722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65db74b7cb-8bk2t" podStartSLOduration=1.200751485 podStartE2EDuration="4.474709336s" totalImagesPullingTime="3.273957851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:22.472847853 +0000 UTC m=+853.616760824" watchObservedRunningTime="2026-07-21 15:13:22.474709336 +0000 UTC m=+853.618622307"
Jul 21 15:13:33.442364 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.442335    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:33.442754 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.442410    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:13:33.506971 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.506940    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d74cbb86-v5bz6"]
Jul 21 15:13:33.507147 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.507122    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76d74cbb86-v5bz6" podUID="9e12ca83-dee7-4045-a8c2-1ebe2c889344" containerName="manager" containerID="cri-o://78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e" gracePeriod=30
Jul 21 15:13:33.752563 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.752541    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:33.885051 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.885014    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert\") pod \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") "
Jul 21 15:13:33.885241 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.885077    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w9qb\" (UniqueName: \"kubernetes.io/projected/9e12ca83-dee7-4045-a8c2-1ebe2c889344-kube-api-access-8w9qb\") pod \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\" (UID: \"9e12ca83-dee7-4045-a8c2-1ebe2c889344\") "
Jul 21 15:13:33.887375 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.887337    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9e12ca83-dee7-4045-a8c2-1ebe2c889344" (UID: "9e12ca83-dee7-4045-a8c2-1ebe2c889344"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:13:33.887375 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.887351    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e12ca83-dee7-4045-a8c2-1ebe2c889344-kube-api-access-8w9qb" (OuterVolumeSpecName: "kube-api-access-8w9qb") pod "9e12ca83-dee7-4045-a8c2-1ebe2c889344" (UID: "9e12ca83-dee7-4045-a8c2-1ebe2c889344"). InnerVolumeSpecName "kube-api-access-8w9qb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:13:33.986099 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.986010    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e12ca83-dee7-4045-a8c2-1ebe2c889344-webhook-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:13:33.986099 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:33.986041    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w9qb\" (UniqueName: \"kubernetes.io/projected/9e12ca83-dee7-4045-a8c2-1ebe2c889344-kube-api-access-8w9qb\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:13:34.489601 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.489569    2562 generic.go:356] "Generic (PLEG): container finished" podID="9e12ca83-dee7-4045-a8c2-1ebe2c889344" containerID="78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e" exitCode=0
Jul 21 15:13:34.490167 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.489605    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d74cbb86-v5bz6"
Jul 21 15:13:34.490167 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.489632    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d74cbb86-v5bz6" event={"ID":"9e12ca83-dee7-4045-a8c2-1ebe2c889344","Type":"ContainerDied","Data":"78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e"}
Jul 21 15:13:34.490167 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.489696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d74cbb86-v5bz6" event={"ID":"9e12ca83-dee7-4045-a8c2-1ebe2c889344","Type":"ContainerDied","Data":"84cb2422c6e4623e5bcb55d890f8b19a309ce7f1c0b912e432082f57576f152b"}
Jul 21 15:13:34.490167 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.489721    2562 scope.go:117] "RemoveContainer" containerID="78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e"
Jul 21 15:13:34.498774 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.498756    2562 scope.go:117] "RemoveContainer" containerID="78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e"
Jul 21 15:13:34.499008 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:13:34.498990    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e\": container with ID starting with 78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e not found: ID does not exist" containerID="78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e"
Jul 21 15:13:34.499064 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.499016    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e"} err="failed to get container status \"78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e\": rpc error: code = NotFound desc = could not find container \"78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e\": container with ID starting with 78a10715308a18dc3419f299fb3e1fcab7f4d8b1357ea827345e1ffdbf881b9e not found: ID does not exist"
Jul 21 15:13:34.510354 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.510331    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d74cbb86-v5bz6"]
Jul 21 15:13:34.514380 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:34.514362    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76d74cbb86-v5bz6"]
Jul 21 15:13:35.297737 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:35.297703    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e12ca83-dee7-4045-a8c2-1ebe2c889344" path="/var/lib/kubelet/pods/9e12ca83-dee7-4045-a8c2-1ebe2c889344/volumes"
Jul 21 15:13:54.947907 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.947872    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"]
Jul 21 15:13:54.948357 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.948177    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e12ca83-dee7-4045-a8c2-1ebe2c889344" containerName="manager"
Jul 21 15:13:54.948357 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.948187    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e12ca83-dee7-4045-a8c2-1ebe2c889344" containerName="manager"
Jul 21 15:13:54.948357 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.948253    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e12ca83-dee7-4045-a8c2-1ebe2c889344" containerName="manager"
Jul 21 15:13:54.953835 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.953813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:54.956272 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.956249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 15:13:54.956416 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.956255    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tbjb2\""
Jul 21 15:13:54.959996 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:54.959974    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"]
Jul 21 15:13:55.059879 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.059842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zww84\" (UniqueName: \"kubernetes.io/projected/16945e27-5a37-492e-a775-d8f31177c4d5-kube-api-access-zww84\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.060035 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.059898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16945e27-5a37-492e-a775-d8f31177c4d5-maas-api-tls\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.060035 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.059978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16945e27-5a37-492e-a775-d8f31177c4d5-openshift-service-ca\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.160543 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.160514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16945e27-5a37-492e-a775-d8f31177c4d5-maas-api-tls\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.160754 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.160573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16945e27-5a37-492e-a775-d8f31177c4d5-openshift-service-ca\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.160754 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.160618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zww84\" (UniqueName: \"kubernetes.io/projected/16945e27-5a37-492e-a775-d8f31177c4d5-kube-api-access-zww84\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.161327 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.161306    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16945e27-5a37-492e-a775-d8f31177c4d5-openshift-service-ca\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.163268 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.163242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16945e27-5a37-492e-a775-d8f31177c4d5-maas-api-tls\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.170225 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.170201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zww84\" (UniqueName: \"kubernetes.io/projected/16945e27-5a37-492e-a775-d8f31177c4d5-kube-api-access-zww84\") pod \"maas-api-5df78cc578-lcmx8\" (UID: \"16945e27-5a37-492e-a775-d8f31177c4d5\") " pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.284290 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.284209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:55.423795 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.423770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"]
Jul 21 15:13:55.426621 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:13:55.426592    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16945e27_5a37_492e_a775_d8f31177c4d5.slice/crio-656c16c473bfda1eb0ee41318abdce05f1a10edce0a72629d04dd5f3e105fc4d WatchSource:0}: Error finding container 656c16c473bfda1eb0ee41318abdce05f1a10edce0a72629d04dd5f3e105fc4d: Status 404 returned error can't find the container with id 656c16c473bfda1eb0ee41318abdce05f1a10edce0a72629d04dd5f3e105fc4d
Jul 21 15:13:55.531315 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.531275    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"]
Jul 21 15:13:55.536206 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.536148    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.539422 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.539401    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 15:13:55.548815 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.548789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"]
Jul 21 15:13:55.560103 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.560064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-554k7"]
Jul 21 15:13:55.563642 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.563621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.563812 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.563791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnf9g\" (UniqueName: \"kubernetes.io/projected/34240273-59ee-482a-a3c1-741f9878c40b-kube-api-access-hnf9g\") pod \"payload-pre-processing-7677b774bb-8tdl2\" (UID: \"34240273-59ee-482a-a3c1-741f9878c40b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.563873 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.563837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34240273-59ee-482a-a3c1-741f9878c40b-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8tdl2\" (UID: \"34240273-59ee-482a-a3c1-741f9878c40b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.566013 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.565991    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zs4jq\""
Jul 21 15:13:55.581034 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.580969    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-554k7"]
Jul 21 15:13:55.584359 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.584320    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8" event={"ID":"16945e27-5a37-492e-a775-d8f31177c4d5","Type":"ContainerStarted","Data":"656c16c473bfda1eb0ee41318abdce05f1a10edce0a72629d04dd5f3e105fc4d"}
Jul 21 15:13:55.665268 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.665230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv8v9\" (UniqueName: \"kubernetes.io/projected/16b44575-5705-4210-8d25-2fa5e3533e08-kube-api-access-tv8v9\") pod \"payload-processing-5bf47cd988-554k7\" (UID: \"16b44575-5705-4210-8d25-2fa5e3533e08\") " pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.665451 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.665315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnf9g\" (UniqueName: \"kubernetes.io/projected/34240273-59ee-482a-a3c1-741f9878c40b-kube-api-access-hnf9g\") pod \"payload-pre-processing-7677b774bb-8tdl2\" (UID: \"34240273-59ee-482a-a3c1-741f9878c40b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.665451 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.665343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34240273-59ee-482a-a3c1-741f9878c40b-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8tdl2\" (UID: \"34240273-59ee-482a-a3c1-741f9878c40b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.665451 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.665379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b44575-5705-4210-8d25-2fa5e3533e08-plugins-config-volume\") pod \"payload-processing-5bf47cd988-554k7\" (UID: \"16b44575-5705-4210-8d25-2fa5e3533e08\") " pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.666086 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.666068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34240273-59ee-482a-a3c1-741f9878c40b-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8tdl2\" (UID: \"34240273-59ee-482a-a3c1-741f9878c40b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.674317 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.674285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnf9g\" (UniqueName: \"kubernetes.io/projected/34240273-59ee-482a-a3c1-741f9878c40b-kube-api-access-hnf9g\") pod \"payload-pre-processing-7677b774bb-8tdl2\" (UID: \"34240273-59ee-482a-a3c1-741f9878c40b\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.766126 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.766082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8v9\" (UniqueName: \"kubernetes.io/projected/16b44575-5705-4210-8d25-2fa5e3533e08-kube-api-access-tv8v9\") pod \"payload-processing-5bf47cd988-554k7\" (UID: \"16b44575-5705-4210-8d25-2fa5e3533e08\") " pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.766312 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.766178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b44575-5705-4210-8d25-2fa5e3533e08-plugins-config-volume\") pod \"payload-processing-5bf47cd988-554k7\" (UID: \"16b44575-5705-4210-8d25-2fa5e3533e08\") " pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.766915 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.766897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16b44575-5705-4210-8d25-2fa5e3533e08-plugins-config-volume\") pod \"payload-processing-5bf47cd988-554k7\" (UID: \"16b44575-5705-4210-8d25-2fa5e3533e08\") " pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.775345 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.775314    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv8v9\" (UniqueName: \"kubernetes.io/projected/16b44575-5705-4210-8d25-2fa5e3533e08-kube-api-access-tv8v9\") pod \"payload-processing-5bf47cd988-554k7\" (UID: \"16b44575-5705-4210-8d25-2fa5e3533e08\") " pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:55.847764 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.847731    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:55.874162 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:55.874133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:56.003101 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:56.003068    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"]
Jul 21 15:13:56.005404 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:13:56.005368    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34240273_59ee_482a_a3c1_741f9878c40b.slice/crio-3a5c826db33e9d092010373ab6de9ced340a69bf7187f01eb9a9c2580652396b WatchSource:0}: Error finding container 3a5c826db33e9d092010373ab6de9ced340a69bf7187f01eb9a9c2580652396b: Status 404 returned error can't find the container with id 3a5c826db33e9d092010373ab6de9ced340a69bf7187f01eb9a9c2580652396b
Jul 21 15:13:56.034017 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:56.033925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-554k7"]
Jul 21 15:13:56.036325 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:13:56.036299    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b44575_5705_4210_8d25_2fa5e3533e08.slice/crio-806c7e649e3fc3eb73f8f8f42c6a9bea69e64a33598a1e8496d8b4a05a4bf098 WatchSource:0}: Error finding container 806c7e649e3fc3eb73f8f8f42c6a9bea69e64a33598a1e8496d8b4a05a4bf098: Status 404 returned error can't find the container with id 806c7e649e3fc3eb73f8f8f42c6a9bea69e64a33598a1e8496d8b4a05a4bf098
Jul 21 15:13:56.591905 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:56.591864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2" event={"ID":"34240273-59ee-482a-a3c1-741f9878c40b","Type":"ContainerStarted","Data":"3a5c826db33e9d092010373ab6de9ced340a69bf7187f01eb9a9c2580652396b"}
Jul 21 15:13:56.593301 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:56.593272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-554k7" event={"ID":"16b44575-5705-4210-8d25-2fa5e3533e08","Type":"ContainerStarted","Data":"806c7e649e3fc3eb73f8f8f42c6a9bea69e64a33598a1e8496d8b4a05a4bf098"}
Jul 21 15:13:58.604284 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:58.604247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2" event={"ID":"34240273-59ee-482a-a3c1-741f9878c40b","Type":"ContainerStarted","Data":"5bba95c6c67335e9784e8142cdbb9437ecee66f41ae323d6cb644c5932c3cc6f"}
Jul 21 15:13:58.604713 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:58.604350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:13:58.605831 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:58.605807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-554k7" event={"ID":"16b44575-5705-4210-8d25-2fa5e3533e08","Type":"ContainerStarted","Data":"930875509e8b9d5e44d9d4cdd33ad56832801ac21d669c42eaa429dbebec35b2"}
Jul 21 15:13:58.605978 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:58.605931    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:13:58.622200 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:58.622162    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2" podStartSLOduration=1.431182426 podStartE2EDuration="3.62214942s" totalImagesPullingTime="2.190966994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:58.620623895 +0000 UTC m=+889.764536862" watchObservedRunningTime="2026-07-21 15:13:58.62214942 +0000 UTC m=+889.766062391"
Jul 21 15:13:58.636865 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:58.636817    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-554k7" podStartSLOduration=1.475624379 podStartE2EDuration="3.636803395s" totalImagesPullingTime="2.161179016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:58.635805366 +0000 UTC m=+889.779718334" watchObservedRunningTime="2026-07-21 15:13:58.636803395 +0000 UTC m=+889.780716366"
Jul 21 15:13:59.611863 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:59.611825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8" event={"ID":"16945e27-5a37-492e-a775-d8f31177c4d5","Type":"ContainerStarted","Data":"5bf43f6f23145c658758fdcc4c80ed7323fd07289e5b7822effe7dfd16df93c8"}
Jul 21 15:13:59.612263 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:59.612032    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:13:59.632452 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:13:59.632399    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8" podStartSLOduration=2.416268401 podStartE2EDuration="5.632384571s" totalImagesPullingTime="3.21611617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:59.63151396 +0000 UTC m=+890.775426954" watchObservedRunningTime="2026-07-21 15:13:59.632384571 +0000 UTC m=+890.776297542"
Jul 21 15:14:05.622721 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:05.622623    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5df78cc578-lcmx8"
Jul 21 15:14:09.254416 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:09.254388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:14:09.255548 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:09.255527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:14:09.614507 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:09.614480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8tdl2"
Jul 21 15:14:09.614729 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:09.614544    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-554k7"
Jul 21 15:14:21.658319 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.658278    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"]
Jul 21 15:14:21.661632 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.661617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.665391 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.665367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wcwjp\""
Jul 21 15:14:21.665391 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.665385    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 15:14:21.665610 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.665385    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 15:14:21.665610 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.665367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 15:14:21.671495 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.671472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"]
Jul 21 15:14:21.781248 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.781217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.781412 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.781263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.781412 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.781283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.781412 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.781319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3776d51b-d76d-4342-ac25-4e8168dc9c49-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.781512 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.781407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6tnt\" (UniqueName: \"kubernetes.io/projected/3776d51b-d76d-4342-ac25-4e8168dc9c49-kube-api-access-f6tnt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.781512 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.781442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.882762 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.882727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.882955 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.882781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.882955 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.882798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.882955 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.882903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3776d51b-d76d-4342-ac25-4e8168dc9c49-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.882955 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.882946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6tnt\" (UniqueName: \"kubernetes.io/projected/3776d51b-d76d-4342-ac25-4e8168dc9c49-kube-api-access-f6tnt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.883150 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.882976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.883203 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.883185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.883256 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.883206    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.883309 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.883264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.885358 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.885331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3776d51b-d76d-4342-ac25-4e8168dc9c49-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.885512 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.885496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3776d51b-d76d-4342-ac25-4e8168dc9c49-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.890900 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.890880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6tnt\" (UniqueName: \"kubernetes.io/projected/3776d51b-d76d-4342-ac25-4e8168dc9c49-kube-api-access-f6tnt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8\" (UID: \"3776d51b-d76d-4342-ac25-4e8168dc9c49\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:21.974783 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:21.974689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:22.108520 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:22.108434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"]
Jul 21 15:14:22.111288 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:14:22.111260    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3776d51b_d76d_4342_ac25_4e8168dc9c49.slice/crio-5ca628a360d2c98fba57cf9bbc1e61c8498b2d51f0a6a9d65f780abc0366c620 WatchSource:0}: Error finding container 5ca628a360d2c98fba57cf9bbc1e61c8498b2d51f0a6a9d65f780abc0366c620: Status 404 returned error can't find the container with id 5ca628a360d2c98fba57cf9bbc1e61c8498b2d51f0a6a9d65f780abc0366c620
Jul 21 15:14:22.722061 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:22.722026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8" event={"ID":"3776d51b-d76d-4342-ac25-4e8168dc9c49","Type":"ContainerStarted","Data":"5ca628a360d2c98fba57cf9bbc1e61c8498b2d51f0a6a9d65f780abc0366c620"}
Jul 21 15:14:24.737438 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:24.737400    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8" event={"ID":"3776d51b-d76d-4342-ac25-4e8168dc9c49","Type":"ContainerStarted","Data":"653e98b25c027b0f79647fd2870095bcc49e1da906486f9524843137553fbe81"}
Jul 21 15:14:24.754488 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:24.754391    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8" podStartSLOduration=1.3726794469999999 podStartE2EDuration="3.754370767s" totalImagesPullingTime="2.38169132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:14:24.753840353 +0000 UTC m=+915.897753361" watchObservedRunningTime="2026-07-21 15:14:24.754370767 +0000 UTC m=+915.898283738"
Jul 21 15:14:31.975639 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:31.975605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:31.976057 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:31.975688    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:31.988393 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:31.988361    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:14:32.783264 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:14:32.783233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8"
Jul 21 15:15:00.135981 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.135940    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"]
Jul 21 15:15:00.142377 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.142354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"
Jul 21 15:15:00.145276 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.145155    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mtm2m\""
Jul 21 15:15:00.147005 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.146965    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"]
Jul 21 15:15:00.155740 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.155714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"
Jul 21 15:15:00.291703 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.291674    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"]
Jul 21 15:15:00.294868 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:15:00.294841    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcedef3e1_bbfa_4b53_8b1f_f167fbee18b8.slice/crio-58313871373f3fde84a63791dcf6c4a5cb795addb7b1442741a9feff0c9c0168 WatchSource:0}: Error finding container 58313871373f3fde84a63791dcf6c4a5cb795addb7b1442741a9feff0c9c0168: Status 404 returned error can't find the container with id 58313871373f3fde84a63791dcf6c4a5cb795addb7b1442741a9feff0c9c0168
Jul 21 15:15:00.297382 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.297363    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:15:00.897240 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:00.897207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8" event={"ID":"cedef3e1-bbfa-4b53-8b1f-f167fbee18b8","Type":"ContainerStarted","Data":"58313871373f3fde84a63791dcf6c4a5cb795addb7b1442741a9feff0c9c0168"}
Jul 21 15:15:01.946838 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:01.946798    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"]
Jul 21 15:15:01.951055 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:01.951034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"]
Jul 21 15:15:01.951202 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:01.951121    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:01.953952 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:01.953925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 15:15:02.007762 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.007713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.007904 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.007777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d69e0c-fd7b-4078-9e31-7bf421be3014-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.007904 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.007864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ml4t\" (UniqueName: \"kubernetes.io/projected/56d69e0c-fd7b-4078-9e31-7bf421be3014-kube-api-access-2ml4t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.008071 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.007921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.008071 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.008032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.008180 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.008070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.108999 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.108963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ml4t\" (UniqueName: \"kubernetes.io/projected/56d69e0c-fd7b-4078-9e31-7bf421be3014-kube-api-access-2ml4t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109154 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109021    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109154 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109154 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109312 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109312 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d69e0c-fd7b-4078-9e31-7bf421be3014-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109519 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.109519 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109511    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.110033 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.109575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.111786 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.111761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d69e0c-fd7b-4078-9e31-7bf421be3014-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.112162 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.112140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d69e0c-fd7b-4078-9e31-7bf421be3014-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.120379 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.120332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ml4t\" (UniqueName: \"kubernetes.io/projected/56d69e0c-fd7b-4078-9e31-7bf421be3014-kube-api-access-2ml4t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gvwnr\" (UID: \"56d69e0c-fd7b-4078-9e31-7bf421be3014\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.266302 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.266216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:02.945671 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:02.945497    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"]
Jul 21 15:15:02.947622 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:15:02.947598    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d69e0c_fd7b_4078_9e31_7bf421be3014.slice/crio-7fd1660a39bdbdc867e32a8885c99a53a712c74e0f3c7d4681eaab7759eb78f9 WatchSource:0}: Error finding container 7fd1660a39bdbdc867e32a8885c99a53a712c74e0f3c7d4681eaab7759eb78f9: Status 404 returned error can't find the container with id 7fd1660a39bdbdc867e32a8885c99a53a712c74e0f3c7d4681eaab7759eb78f9
Jul 21 15:15:03.913952 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:03.913917    2562 generic.go:356] "Generic (PLEG): container finished" podID="cedef3e1-bbfa-4b53-8b1f-f167fbee18b8" containerID="c6e9e049a1189e7b4bcf82fcdba239aa7efdc61e1b8a07a5d6e2d0a9a0aae00a" exitCode=0
Jul 21 15:15:03.914150 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:03.914010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8" event={"ID":"cedef3e1-bbfa-4b53-8b1f-f167fbee18b8","Type":"ContainerDied","Data":"c6e9e049a1189e7b4bcf82fcdba239aa7efdc61e1b8a07a5d6e2d0a9a0aae00a"}
Jul 21 15:15:03.915202 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:03.915180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr" event={"ID":"56d69e0c-fd7b-4078-9e31-7bf421be3014","Type":"ContainerStarted","Data":"7fd1660a39bdbdc867e32a8885c99a53a712c74e0f3c7d4681eaab7759eb78f9"}
Jul 21 15:15:04.921207 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:04.921170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr" event={"ID":"56d69e0c-fd7b-4078-9e31-7bf421be3014","Type":"ContainerStarted","Data":"bb44289b8841a688562fbba2466a8fe14f23650eda24817c42945d13ebf6ee36"}
Jul 21 15:15:04.941442 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:04.941391    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr" podStartSLOduration=2.142582609 podStartE2EDuration="3.94137455s" totalImagesPullingTime="1.798791941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:15:04.940484244 +0000 UTC m=+956.084397234" watchObservedRunningTime="2026-07-21 15:15:04.94137455 +0000 UTC m=+956.085287560"
Jul 21 15:15:05.052157 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:05.052126    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"
Jul 21 15:15:05.926409 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:05.926381    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"
Jul 21 15:15:05.926805 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:05.926419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8" event={"ID":"cedef3e1-bbfa-4b53-8b1f-f167fbee18b8","Type":"ContainerDied","Data":"58313871373f3fde84a63791dcf6c4a5cb795addb7b1442741a9feff0c9c0168"}
Jul 21 15:15:05.926805 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:05.926468    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58313871373f3fde84a63791dcf6c4a5cb795addb7b1442741a9feff0c9c0168"
Jul 21 15:15:12.267060 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:12.267027    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:12.267523 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:12.267086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:12.279532 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:12.279507    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:15:12.971608 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:15:12.971580    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gvwnr"
Jul 21 15:16:14.372798 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.372759    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54694b5559-2rlg2"]
Jul 21 15:16:14.373394 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.373345    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedef3e1-bbfa-4b53-8b1f-f167fbee18b8" containerName="cleanup"
Jul 21 15:16:14.373394 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.373365    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedef3e1-bbfa-4b53-8b1f-f167fbee18b8" containerName="cleanup"
Jul 21 15:16:14.373596 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.373469    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cedef3e1-bbfa-4b53-8b1f-f167fbee18b8" containerName="cleanup"
Jul 21 15:16:14.377699 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.377172    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.381968 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.381941    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rmczl\""
Jul 21 15:16:14.382095 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.381945    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 15:16:14.385422 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.385397    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54694b5559-2rlg2"]
Jul 21 15:16:14.496449 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.496415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3e8c06-3260-4ab2-9c20-9097d175717d-tls-cert\") pod \"authorino-54694b5559-2rlg2\" (UID: \"6a3e8c06-3260-4ab2-9c20-9097d175717d\") " pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.496578 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.496491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2lv\" (UniqueName: \"kubernetes.io/projected/6a3e8c06-3260-4ab2-9c20-9097d175717d-kube-api-access-xn2lv\") pod \"authorino-54694b5559-2rlg2\" (UID: \"6a3e8c06-3260-4ab2-9c20-9097d175717d\") " pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.597620 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.597591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2lv\" (UniqueName: \"kubernetes.io/projected/6a3e8c06-3260-4ab2-9c20-9097d175717d-kube-api-access-xn2lv\") pod \"authorino-54694b5559-2rlg2\" (UID: \"6a3e8c06-3260-4ab2-9c20-9097d175717d\") " pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.597786 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.597654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3e8c06-3260-4ab2-9c20-9097d175717d-tls-cert\") pod \"authorino-54694b5559-2rlg2\" (UID: \"6a3e8c06-3260-4ab2-9c20-9097d175717d\") " pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.600488 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.600467    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6a3e8c06-3260-4ab2-9c20-9097d175717d-tls-cert\") pod \"authorino-54694b5559-2rlg2\" (UID: \"6a3e8c06-3260-4ab2-9c20-9097d175717d\") " pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.606528 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.606505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2lv\" (UniqueName: \"kubernetes.io/projected/6a3e8c06-3260-4ab2-9c20-9097d175717d-kube-api-access-xn2lv\") pod \"authorino-54694b5559-2rlg2\" (UID: \"6a3e8c06-3260-4ab2-9c20-9097d175717d\") " pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.692784 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.692731    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54694b5559-2rlg2"
Jul 21 15:16:14.825363 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:14.825298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54694b5559-2rlg2"]
Jul 21 15:16:14.827949 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:16:14.827923    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a3e8c06_3260_4ab2_9c20_9097d175717d.slice/crio-087ddad988193cd5cd3a2db068e0a45451cb90e37a703f63a606f669c043830d WatchSource:0}: Error finding container 087ddad988193cd5cd3a2db068e0a45451cb90e37a703f63a606f669c043830d: Status 404 returned error can't find the container with id 087ddad988193cd5cd3a2db068e0a45451cb90e37a703f63a606f669c043830d
Jul 21 15:16:15.257490 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:15.257450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54694b5559-2rlg2" event={"ID":"6a3e8c06-3260-4ab2-9c20-9097d175717d","Type":"ContainerStarted","Data":"087ddad988193cd5cd3a2db068e0a45451cb90e37a703f63a606f669c043830d"}
Jul 21 15:16:18.272591 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:18.272503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54694b5559-2rlg2" event={"ID":"6a3e8c06-3260-4ab2-9c20-9097d175717d","Type":"ContainerStarted","Data":"b780ed7ae4e19d728795e750a93a3e2f3ee1d587c080ff34233d44841e723cde"}
Jul 21 15:16:18.294888 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:16:18.294839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54694b5559-2rlg2" podStartSLOduration=1.263947559 podStartE2EDuration="4.294823598s" totalImagesPullingTime="3.030876039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:16:18.293002714 +0000 UTC m=+1029.436915689" watchObservedRunningTime="2026-07-21 15:16:18.294823598 +0000 UTC m=+1029.438736594"
Jul 21 15:17:15.909140 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:15.909049    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-8bk2t"]
Jul 21 15:17:15.909651 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:15.909274    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65db74b7cb-8bk2t" podUID="48dbce92-01f4-48e9-8855-636f10539c1d" containerName="manager" containerID="cri-o://ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c" gracePeriod=30
Jul 21 15:17:16.161029 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.160973    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:17:16.199408 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.199382    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wph5l\" (UniqueName: \"kubernetes.io/projected/48dbce92-01f4-48e9-8855-636f10539c1d-kube-api-access-wph5l\") pod \"48dbce92-01f4-48e9-8855-636f10539c1d\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") "
Jul 21 15:17:16.199534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.199474    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48dbce92-01f4-48e9-8855-636f10539c1d-webhook-cert\") pod \"48dbce92-01f4-48e9-8855-636f10539c1d\" (UID: \"48dbce92-01f4-48e9-8855-636f10539c1d\") "
Jul 21 15:17:16.201521 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.201489    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48dbce92-01f4-48e9-8855-636f10539c1d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "48dbce92-01f4-48e9-8855-636f10539c1d" (UID: "48dbce92-01f4-48e9-8855-636f10539c1d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:17:16.201619 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.201555    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dbce92-01f4-48e9-8855-636f10539c1d-kube-api-access-wph5l" (OuterVolumeSpecName: "kube-api-access-wph5l") pod "48dbce92-01f4-48e9-8855-636f10539c1d" (UID: "48dbce92-01f4-48e9-8855-636f10539c1d"). InnerVolumeSpecName "kube-api-access-wph5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:17:16.300525 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.300500    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48dbce92-01f4-48e9-8855-636f10539c1d-webhook-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:17:16.300525 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.300526    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wph5l\" (UniqueName: \"kubernetes.io/projected/48dbce92-01f4-48e9-8855-636f10539c1d-kube-api-access-wph5l\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:17:16.551902 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.551831    2562 generic.go:356] "Generic (PLEG): container finished" podID="48dbce92-01f4-48e9-8855-636f10539c1d" containerID="ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c" exitCode=0
Jul 21 15:17:16.551902 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.551881    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-8bk2t"
Jul 21 15:17:16.552047 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.551924    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-8bk2t" event={"ID":"48dbce92-01f4-48e9-8855-636f10539c1d","Type":"ContainerDied","Data":"ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c"}
Jul 21 15:17:16.552047 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.551980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-8bk2t" event={"ID":"48dbce92-01f4-48e9-8855-636f10539c1d","Type":"ContainerDied","Data":"44a1e705feb3d0475277c32d52d1cd3d82948786aea14fb7bbb3f3d7bee884a9"}
Jul 21 15:17:16.552047 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.552004    2562 scope.go:117] "RemoveContainer" containerID="ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c"
Jul 21 15:17:16.562122 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.562101    2562 scope.go:117] "RemoveContainer" containerID="ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c"
Jul 21 15:17:16.562402 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:17:16.562377    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c\": container with ID starting with ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c not found: ID does not exist" containerID="ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c"
Jul 21 15:17:16.562534 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.562405    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c"} err="failed to get container status \"ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c\": rpc error: code = NotFound desc = could not find container \"ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c\": container with ID starting with ca955fd58f5ef5f84f5b0e33ee12a11e23c6cce5967d2be5ad585f3816b51a0c not found: ID does not exist"
Jul 21 15:17:16.575506 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.575477    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-8bk2t"]
Jul 21 15:17:16.582126 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:16.582100    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-8bk2t"]
Jul 21 15:17:17.298096 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:17:17.298060    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48dbce92-01f4-48e9-8855-636f10539c1d" path="/var/lib/kubelet/pods/48dbce92-01f4-48e9-8855-636f10539c1d/volumes"
Jul 21 15:18:17.446982 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.446943    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65db74b7cb-xczl6"]
Jul 21 15:18:17.447480 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.447319    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dbce92-01f4-48e9-8855-636f10539c1d" containerName="manager"
Jul 21 15:18:17.447480 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.447330    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dbce92-01f4-48e9-8855-636f10539c1d" containerName="manager"
Jul 21 15:18:17.447480 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.447408    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dbce92-01f4-48e9-8855-636f10539c1d" containerName="manager"
Jul 21 15:18:17.450506 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.450487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.454193 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.454167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mc9vp\""
Jul 21 15:18:17.454193 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.454191    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 15:18:17.454434 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.454210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 15:18:17.460922 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.460895    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-xczl6"]
Jul 21 15:18:17.506161 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.506125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5024902f-1747-4ccc-98c6-642bfeb409ee-webhook-cert\") pod \"maas-controller-65db74b7cb-xczl6\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") " pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.506357 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.506238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzfw\" (UniqueName: \"kubernetes.io/projected/5024902f-1747-4ccc-98c6-642bfeb409ee-kube-api-access-qmzfw\") pod \"maas-controller-65db74b7cb-xczl6\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") " pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.607484 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.607440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzfw\" (UniqueName: \"kubernetes.io/projected/5024902f-1747-4ccc-98c6-642bfeb409ee-kube-api-access-qmzfw\") pod \"maas-controller-65db74b7cb-xczl6\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") " pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.607755 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.607504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5024902f-1747-4ccc-98c6-642bfeb409ee-webhook-cert\") pod \"maas-controller-65db74b7cb-xczl6\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") " pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.610300 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.610265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5024902f-1747-4ccc-98c6-642bfeb409ee-webhook-cert\") pod \"maas-controller-65db74b7cb-xczl6\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") " pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.617748 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.617721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzfw\" (UniqueName: \"kubernetes.io/projected/5024902f-1747-4ccc-98c6-642bfeb409ee-kube-api-access-qmzfw\") pod \"maas-controller-65db74b7cb-xczl6\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") " pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.762953 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.762839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:17.905035 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:17.905012    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-xczl6"]
Jul 21 15:18:17.907857 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:18:17.907828    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5024902f_1747_4ccc_98c6_642bfeb409ee.slice/crio-eb06ed3e8bf66d10e8dcaed7bde926fad389f0f517fb5efb27009efe744e6ba0 WatchSource:0}: Error finding container eb06ed3e8bf66d10e8dcaed7bde926fad389f0f517fb5efb27009efe744e6ba0: Status 404 returned error can't find the container with id eb06ed3e8bf66d10e8dcaed7bde926fad389f0f517fb5efb27009efe744e6ba0
Jul 21 15:18:18.854699 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:18.854641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-xczl6" event={"ID":"5024902f-1747-4ccc-98c6-642bfeb409ee","Type":"ContainerStarted","Data":"da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6"}
Jul 21 15:18:18.855137 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:18.854732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:18.855137 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:18.854757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-xczl6" event={"ID":"5024902f-1747-4ccc-98c6-642bfeb409ee","Type":"ContainerStarted","Data":"eb06ed3e8bf66d10e8dcaed7bde926fad389f0f517fb5efb27009efe744e6ba0"}
Jul 21 15:18:18.882878 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:18.882811    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65db74b7cb-xczl6" podStartSLOduration=1.225796603 podStartE2EDuration="1.882777449s" totalImagesPullingTime="656.980846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:18:18.880722068 +0000 UTC m=+1150.024635039" watchObservedRunningTime="2026-07-21 15:18:18.882777449 +0000 UTC m=+1150.026690421"
Jul 21 15:18:29.862390 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:29.862356    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:34.553103 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.553019    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-xczl6"]
Jul 21 15:18:34.553613 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.553217    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65db74b7cb-xczl6" podUID="5024902f-1747-4ccc-98c6-642bfeb409ee" containerName="manager" containerID="cri-o://da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6" gracePeriod=30
Jul 21 15:18:34.910457 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.910420    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:34.939040 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.939004    2562 generic.go:356] "Generic (PLEG): container finished" podID="5024902f-1747-4ccc-98c6-642bfeb409ee" containerID="da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6" exitCode=0
Jul 21 15:18:34.939221 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.939069    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-xczl6"
Jul 21 15:18:34.939221 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.939122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-xczl6" event={"ID":"5024902f-1747-4ccc-98c6-642bfeb409ee","Type":"ContainerDied","Data":"da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6"}
Jul 21 15:18:34.939323 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.939272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-xczl6" event={"ID":"5024902f-1747-4ccc-98c6-642bfeb409ee","Type":"ContainerDied","Data":"eb06ed3e8bf66d10e8dcaed7bde926fad389f0f517fb5efb27009efe744e6ba0"}
Jul 21 15:18:34.939323 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.939315    2562 scope.go:117] "RemoveContainer" containerID="da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6"
Jul 21 15:18:34.948984 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.948966    2562 scope.go:117] "RemoveContainer" containerID="da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6"
Jul 21 15:18:34.949307 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:18:34.949286    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6\": container with ID starting with da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6 not found: ID does not exist" containerID="da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6"
Jul 21 15:18:34.949365 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:34.949317    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6"} err="failed to get container status \"da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6\": rpc error: code = NotFound desc = could not find container \"da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6\": container with ID starting with da645ea269c387e25f7fa0069677580ba46789c443877d5f6f1a195323d81da6 not found: ID does not exist"
Jul 21 15:18:35.070691 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.070628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5024902f-1747-4ccc-98c6-642bfeb409ee-webhook-cert\") pod \"5024902f-1747-4ccc-98c6-642bfeb409ee\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") "
Jul 21 15:18:35.070904 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.070761    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmzfw\" (UniqueName: \"kubernetes.io/projected/5024902f-1747-4ccc-98c6-642bfeb409ee-kube-api-access-qmzfw\") pod \"5024902f-1747-4ccc-98c6-642bfeb409ee\" (UID: \"5024902f-1747-4ccc-98c6-642bfeb409ee\") "
Jul 21 15:18:35.072911 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.072887    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5024902f-1747-4ccc-98c6-642bfeb409ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5024902f-1747-4ccc-98c6-642bfeb409ee" (UID: "5024902f-1747-4ccc-98c6-642bfeb409ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:18:35.073026 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.073001    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5024902f-1747-4ccc-98c6-642bfeb409ee-kube-api-access-qmzfw" (OuterVolumeSpecName: "kube-api-access-qmzfw") pod "5024902f-1747-4ccc-98c6-642bfeb409ee" (UID: "5024902f-1747-4ccc-98c6-642bfeb409ee"). InnerVolumeSpecName "kube-api-access-qmzfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:18:35.172013 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.171974    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmzfw\" (UniqueName: \"kubernetes.io/projected/5024902f-1747-4ccc-98c6-642bfeb409ee-kube-api-access-qmzfw\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:18:35.172013 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.172006    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5024902f-1747-4ccc-98c6-642bfeb409ee-webhook-cert\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:18:35.261219 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.261186    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-xczl6"]
Jul 21 15:18:35.265513 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.265478    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-xczl6"]
Jul 21 15:18:35.299008 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:35.298973    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5024902f-1747-4ccc-98c6-642bfeb409ee" path="/var/lib/kubelet/pods/5024902f-1747-4ccc-98c6-642bfeb409ee/volumes"
Jul 21 15:18:36.093864 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.093828    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65db74b7cb-f2hlk"]
Jul 21 15:18:36.094250 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.094187    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5024902f-1747-4ccc-98c6-642bfeb409ee" containerName="manager"
Jul 21 15:18:36.094250 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.094197    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5024902f-1747-4ccc-98c6-642bfeb409ee" containerName="manager"
Jul 21 15:18:36.094319 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.094260    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5024902f-1747-4ccc-98c6-642bfeb409ee" containerName="manager"
Jul 21 15:18:36.098570 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.098550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.102222 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.102195    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mc9vp\""
Jul 21 15:18:36.102222 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.102216    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 15:18:36.102453 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.102203    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 15:18:36.106984 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.106955    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-f2hlk"]
Jul 21 15:18:36.181692 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.181632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af67a338-ca0c-4031-bf3a-6ce43de0b634-webhook-cert\") pod \"maas-controller-65db74b7cb-f2hlk\" (UID: \"af67a338-ca0c-4031-bf3a-6ce43de0b634\") " pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.181877 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.181778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxxv\" (UniqueName: \"kubernetes.io/projected/af67a338-ca0c-4031-bf3a-6ce43de0b634-kube-api-access-fnxxv\") pod \"maas-controller-65db74b7cb-f2hlk\" (UID: \"af67a338-ca0c-4031-bf3a-6ce43de0b634\") " pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.283054 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.283017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af67a338-ca0c-4031-bf3a-6ce43de0b634-webhook-cert\") pod \"maas-controller-65db74b7cb-f2hlk\" (UID: \"af67a338-ca0c-4031-bf3a-6ce43de0b634\") " pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.283239 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.283099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxxv\" (UniqueName: \"kubernetes.io/projected/af67a338-ca0c-4031-bf3a-6ce43de0b634-kube-api-access-fnxxv\") pod \"maas-controller-65db74b7cb-f2hlk\" (UID: \"af67a338-ca0c-4031-bf3a-6ce43de0b634\") " pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.285639 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.285615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af67a338-ca0c-4031-bf3a-6ce43de0b634-webhook-cert\") pod \"maas-controller-65db74b7cb-f2hlk\" (UID: \"af67a338-ca0c-4031-bf3a-6ce43de0b634\") " pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.291686 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.291631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxxv\" (UniqueName: \"kubernetes.io/projected/af67a338-ca0c-4031-bf3a-6ce43de0b634-kube-api-access-fnxxv\") pod \"maas-controller-65db74b7cb-f2hlk\" (UID: \"af67a338-ca0c-4031-bf3a-6ce43de0b634\") " pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.411315 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.411228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:36.554164 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.554139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65db74b7cb-f2hlk"]
Jul 21 15:18:36.556854 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:18:36.556825    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf67a338_ca0c_4031_bf3a_6ce43de0b634.slice/crio-c1500414798623aec2231dd2c420a441265a3307cecf1f9a34bcc9e896ea76f3 WatchSource:0}: Error finding container c1500414798623aec2231dd2c420a441265a3307cecf1f9a34bcc9e896ea76f3: Status 404 returned error can't find the container with id c1500414798623aec2231dd2c420a441265a3307cecf1f9a34bcc9e896ea76f3
Jul 21 15:18:36.951182 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:36.951140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-f2hlk" event={"ID":"af67a338-ca0c-4031-bf3a-6ce43de0b634","Type":"ContainerStarted","Data":"c1500414798623aec2231dd2c420a441265a3307cecf1f9a34bcc9e896ea76f3"}
Jul 21 15:18:37.957300 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:37.957265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65db74b7cb-f2hlk" event={"ID":"af67a338-ca0c-4031-bf3a-6ce43de0b634","Type":"ContainerStarted","Data":"26b64d0df576febb47032065d068de624957510dcd565e03a8c3d53f2d347720"}
Jul 21 15:18:37.957740 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:37.957332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:18:37.975499 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:37.975438    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65db74b7cb-f2hlk" podStartSLOduration=1.5669580079999998 podStartE2EDuration="1.975417784s" totalImagesPullingTime="408.459776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:18:37.975231855 +0000 UTC m=+1169.119144827" watchObservedRunningTime="2026-07-21 15:18:37.975417784 +0000 UTC m=+1169.119330759"
Jul 21 15:18:48.964672 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:18:48.964636    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65db74b7cb-f2hlk"
Jul 21 15:19:09.282385 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:19:09.282357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:19:09.283553 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:19:09.283533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:24:09.309787 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:24:09.309755    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:24:09.312163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:24:09.312144    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:29:09.340630 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:29:09.340596    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:29:09.344127 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:29:09.344105    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:30:35.080719 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.080622    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"]
Jul 21 15:30:35.084423 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.084402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.088152 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.088129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-81110a4b-serving-cert\""
Jul 21 15:30:35.106003 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.105976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"]
Jul 21 15:30:35.195441 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.195413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8763380-0392-4d1c-8a5f-83d866e6dad2-maas-api-tls\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.195548 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.195467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8763380-0392-4d1c-8a5f-83d866e6dad2-openshift-service-ca\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.195548 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.195501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5c8p\" (UniqueName: \"kubernetes.io/projected/e8763380-0392-4d1c-8a5f-83d866e6dad2-kube-api-access-n5c8p\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.296550 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.296518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8763380-0392-4d1c-8a5f-83d866e6dad2-openshift-service-ca\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.296678 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.296553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5c8p\" (UniqueName: \"kubernetes.io/projected/e8763380-0392-4d1c-8a5f-83d866e6dad2-kube-api-access-n5c8p\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.296678 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.296612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8763380-0392-4d1c-8a5f-83d866e6dad2-maas-api-tls\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.297346 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.297319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8763380-0392-4d1c-8a5f-83d866e6dad2-openshift-service-ca\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.299298 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.299276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8763380-0392-4d1c-8a5f-83d866e6dad2-maas-api-tls\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.306775 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.306710    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5c8p\" (UniqueName: \"kubernetes.io/projected/e8763380-0392-4d1c-8a5f-83d866e6dad2-kube-api-access-n5c8p\") pod \"maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.395213 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.395189    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:35.530924 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.530899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"]
Jul 21 15:30:35.534248 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:30:35.534219    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8763380_0392_4d1c_8a5f_83d866e6dad2.slice/crio-22a4433e1c982f2901b87ba178a40023c175629fcd47cdbd89b53892ed4f279b WatchSource:0}: Error finding container 22a4433e1c982f2901b87ba178a40023c175629fcd47cdbd89b53892ed4f279b: Status 404 returned error can't find the container with id 22a4433e1c982f2901b87ba178a40023c175629fcd47cdbd89b53892ed4f279b
Jul 21 15:30:35.535599 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:35.535583    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:30:36.346290 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:36.346254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn" event={"ID":"e8763380-0392-4d1c-8a5f-83d866e6dad2","Type":"ContainerStarted","Data":"b204b4f84797ebd792b1de787108fd32d986cc99a3bc6ff23abdd8589b222864"}
Jul 21 15:30:36.346726 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:36.346301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn" event={"ID":"e8763380-0392-4d1c-8a5f-83d866e6dad2","Type":"ContainerStarted","Data":"22a4433e1c982f2901b87ba178a40023c175629fcd47cdbd89b53892ed4f279b"}
Jul 21 15:30:36.346726 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:36.346322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:30:36.365547 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:36.365496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn" podStartSLOduration=0.846706074 podStartE2EDuration="1.365470381s" totalImagesPullingTime="518.764307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:36.36458742 +0000 UTC m=+1887.508500391" watchObservedRunningTime="2026-07-21 15:30:36.365470381 +0000 UTC m=+1887.509383355"
Jul 21 15:30:42.355520 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:30:42.355478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:31:11.354780 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.354746    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"]
Jul 21 15:31:11.355391 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.354985    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn" podUID="e8763380-0392-4d1c-8a5f-83d866e6dad2" containerName="maas-api" containerID="cri-o://b204b4f84797ebd792b1de787108fd32d986cc99a3bc6ff23abdd8589b222864" gracePeriod=30
Jul 21 15:31:11.515865 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.515833    2562 generic.go:356] "Generic (PLEG): container finished" podID="e8763380-0392-4d1c-8a5f-83d866e6dad2" containerID="b204b4f84797ebd792b1de787108fd32d986cc99a3bc6ff23abdd8589b222864" exitCode=0
Jul 21 15:31:11.516006 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.515912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn" event={"ID":"e8763380-0392-4d1c-8a5f-83d866e6dad2","Type":"ContainerDied","Data":"b204b4f84797ebd792b1de787108fd32d986cc99a3bc6ff23abdd8589b222864"}
Jul 21 15:31:11.601127 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.601103    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:31:11.687065 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.687001    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8763380-0392-4d1c-8a5f-83d866e6dad2-openshift-service-ca\") pod \"e8763380-0392-4d1c-8a5f-83d866e6dad2\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") "
Jul 21 15:31:11.687065 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.687052    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5c8p\" (UniqueName: \"kubernetes.io/projected/e8763380-0392-4d1c-8a5f-83d866e6dad2-kube-api-access-n5c8p\") pod \"e8763380-0392-4d1c-8a5f-83d866e6dad2\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") "
Jul 21 15:31:11.687254 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.687096    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8763380-0392-4d1c-8a5f-83d866e6dad2-maas-api-tls\") pod \"e8763380-0392-4d1c-8a5f-83d866e6dad2\" (UID: \"e8763380-0392-4d1c-8a5f-83d866e6dad2\") "
Jul 21 15:31:11.687409 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.687384    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8763380-0392-4d1c-8a5f-83d866e6dad2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8763380-0392-4d1c-8a5f-83d866e6dad2" (UID: "e8763380-0392-4d1c-8a5f-83d866e6dad2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:31:11.689269 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.689239    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8763380-0392-4d1c-8a5f-83d866e6dad2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8763380-0392-4d1c-8a5f-83d866e6dad2" (UID: "e8763380-0392-4d1c-8a5f-83d866e6dad2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:31:11.689362 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.689321    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8763380-0392-4d1c-8a5f-83d866e6dad2-kube-api-access-n5c8p" (OuterVolumeSpecName: "kube-api-access-n5c8p") pod "e8763380-0392-4d1c-8a5f-83d866e6dad2" (UID: "e8763380-0392-4d1c-8a5f-83d866e6dad2"). InnerVolumeSpecName "kube-api-access-n5c8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:31:11.788019 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.787999    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8763380-0392-4d1c-8a5f-83d866e6dad2-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:31:11.788019 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.788019    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8763380-0392-4d1c-8a5f-83d866e6dad2-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:31:11.788148 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:11.788028    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5c8p\" (UniqueName: \"kubernetes.io/projected/e8763380-0392-4d1c-8a5f-83d866e6dad2-kube-api-access-n5c8p\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:31:12.522342 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:12.522314    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"
Jul 21 15:31:12.522811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:12.522354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn" event={"ID":"e8763380-0392-4d1c-8a5f-83d866e6dad2","Type":"ContainerDied","Data":"22a4433e1c982f2901b87ba178a40023c175629fcd47cdbd89b53892ed4f279b"}
Jul 21 15:31:12.522811 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:12.522406    2562 scope.go:117] "RemoveContainer" containerID="b204b4f84797ebd792b1de787108fd32d986cc99a3bc6ff23abdd8589b222864"
Jul 21 15:31:12.543527 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:12.543499    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"]
Jul 21 15:31:12.547333 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:12.547311    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-81110a4b-7d8c49dcb9-br2wn"]
Jul 21 15:31:13.298932 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:31:13.298900    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8763380-0392-4d1c-8a5f-83d866e6dad2" path="/var/lib/kubelet/pods/e8763380-0392-4d1c-8a5f-83d866e6dad2/volumes"
Jul 21 15:34:04.332503 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.332476    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"]
Jul 21 15:34:04.333116 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.332992    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8763380-0392-4d1c-8a5f-83d866e6dad2" containerName="maas-api"
Jul 21 15:34:04.333116 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.333012    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8763380-0392-4d1c-8a5f-83d866e6dad2" containerName="maas-api"
Jul 21 15:34:04.333234 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.333122    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8763380-0392-4d1c-8a5f-83d866e6dad2" containerName="maas-api"
Jul 21 15:34:04.336320 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.336299    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.338616 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.338590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-719155ca-serving-cert\""
Jul 21 15:34:04.347178 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.347121    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"]
Jul 21 15:34:04.393592 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.393561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87tbg\" (UniqueName: \"kubernetes.io/projected/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-kube-api-access-87tbg\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.393724 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.393629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-openshift-service-ca\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.393807 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.393786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-maas-api-tls\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.495034 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.495011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-openshift-service-ca\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.495123 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.495086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-maas-api-tls\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.495170 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.495126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87tbg\" (UniqueName: \"kubernetes.io/projected/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-kube-api-access-87tbg\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.495699 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.495633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-openshift-service-ca\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.497513 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.497477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-maas-api-tls\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.503821 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.503802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87tbg\" (UniqueName: \"kubernetes.io/projected/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-kube-api-access-87tbg\") pod \"maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.647475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.647454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:04.782245 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:04.782192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"]
Jul 21 15:34:05.321128 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:05.321098    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq" event={"ID":"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3","Type":"ContainerStarted","Data":"b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9"}
Jul 21 15:34:05.321254 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:05.321136    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq" event={"ID":"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3","Type":"ContainerStarted","Data":"9a16ec39bb16e51ca1d88382640a9d0b9accf7b739f67406a8182e91c2d3524b"}
Jul 21 15:34:05.321254 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:05.321221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:05.338630 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:05.338585    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq" podStartSLOduration=0.91234876 podStartE2EDuration="1.338571611s" totalImagesPullingTime="426.222851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:34:05.337237276 +0000 UTC m=+2096.481150249" watchObservedRunningTime="2026-07-21 15:34:05.338571611 +0000 UTC m=+2096.482484581"
Jul 21 15:34:09.367580 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:09.367551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:34:09.373183 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:09.373161    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:34:11.331310 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:11.331240    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:39.588361 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.588318    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"]
Jul 21 15:34:39.588954 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.588550    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq" podUID="fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" containerName="maas-api" containerID="cri-o://b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9" gracePeriod=30
Jul 21 15:34:39.854818 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.854765    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:39.862089 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.862058    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87tbg\" (UniqueName: \"kubernetes.io/projected/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-kube-api-access-87tbg\") pod \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") "
Jul 21 15:34:39.862204 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.862128    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-maas-api-tls\") pod \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") "
Jul 21 15:34:39.862275 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.862203    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-openshift-service-ca\") pod \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\" (UID: \"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3\") "
Jul 21 15:34:39.862586 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.862560    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" (UID: "fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:34:39.864203 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.864178    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" (UID: "fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:34:39.864285 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.864233    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-kube-api-access-87tbg" (OuterVolumeSpecName: "kube-api-access-87tbg") pod "fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" (UID: "fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3"). InnerVolumeSpecName "kube-api-access-87tbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:34:39.963687 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.963636    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87tbg\" (UniqueName: \"kubernetes.io/projected/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-kube-api-access-87tbg\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:34:39.963783 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.963690    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:34:39.963783 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:39.963707    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:34:40.479550 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.479523    2562 generic.go:356] "Generic (PLEG): container finished" podID="fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" containerID="b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9" exitCode=0
Jul 21 15:34:40.479706 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.479569    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"
Jul 21 15:34:40.479706 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.479580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq" event={"ID":"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3","Type":"ContainerDied","Data":"b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9"}
Jul 21 15:34:40.479706 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.479619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq" event={"ID":"fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3","Type":"ContainerDied","Data":"9a16ec39bb16e51ca1d88382640a9d0b9accf7b739f67406a8182e91c2d3524b"}
Jul 21 15:34:40.479706 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.479639    2562 scope.go:117] "RemoveContainer" containerID="b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9"
Jul 21 15:34:40.488341 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.488326    2562 scope.go:117] "RemoveContainer" containerID="b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9"
Jul 21 15:34:40.488596 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:34:40.488580    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9\": container with ID starting with b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9 not found: ID does not exist" containerID="b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9"
Jul 21 15:34:40.488643 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.488604    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9"} err="failed to get container status \"b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9\": rpc error: code = NotFound desc = could not find container \"b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9\": container with ID starting with b7bc4198af25672987183dbe74f346c044b9631f3f43a61587f027c47b9dd1d9 not found: ID does not exist"
Jul 21 15:34:40.500863 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.500841    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"]
Jul 21 15:34:40.506679 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:40.506643    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-719155ca-67b98db6cb-6nvnq"]
Jul 21 15:34:41.298388 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:34:41.298360    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" path="/var/lib/kubelet/pods/fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3/volumes"
Jul 21 15:37:32.301475 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.301445    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"]
Jul 21 15:37:32.303589 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.301972    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" containerName="maas-api"
Jul 21 15:37:32.303589 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.301988    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" containerName="maas-api"
Jul 21 15:37:32.303589 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.302085    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcadad7b-4067-4e0a-a3aa-c87f9ee4dee3" containerName="maas-api"
Jul 21 15:37:32.305303 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.305287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.308434 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.308415    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ed4302cf-serving-cert\""
Jul 21 15:37:32.315017 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.314993    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"]
Jul 21 15:37:32.416942 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.416912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60a7add-c1a7-48bb-8da0-1a898234c833-maas-api-tls\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.417082 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.416943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60a7add-c1a7-48bb-8da0-1a898234c833-openshift-service-ca\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.417621 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.417591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rxgt\" (UniqueName: \"kubernetes.io/projected/e60a7add-c1a7-48bb-8da0-1a898234c833-kube-api-access-4rxgt\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.518162 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.518139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60a7add-c1a7-48bb-8da0-1a898234c833-maas-api-tls\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.518257 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.518165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60a7add-c1a7-48bb-8da0-1a898234c833-openshift-service-ca\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.518257 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.518225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxgt\" (UniqueName: \"kubernetes.io/projected/e60a7add-c1a7-48bb-8da0-1a898234c833-kube-api-access-4rxgt\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.518866 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.518801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60a7add-c1a7-48bb-8da0-1a898234c833-openshift-service-ca\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.520519 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.520499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60a7add-c1a7-48bb-8da0-1a898234c833-maas-api-tls\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.526516 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.526495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rxgt\" (UniqueName: \"kubernetes.io/projected/e60a7add-c1a7-48bb-8da0-1a898234c833-kube-api-access-4rxgt\") pod \"maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.616163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.616140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:32.811847 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.811821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"]
Jul 21 15:37:32.813766 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:37:32.813736    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60a7add_c1a7_48bb_8da0_1a898234c833.slice/crio-bf2569166676b0646e5971b28d52546c0a39956462d600b51b6acd77e481035d WatchSource:0}: Error finding container bf2569166676b0646e5971b28d52546c0a39956462d600b51b6acd77e481035d: Status 404 returned error can't find the container with id bf2569166676b0646e5971b28d52546c0a39956462d600b51b6acd77e481035d
Jul 21 15:37:32.815089 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:32.815068    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:37:33.239147 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:33.239117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq" event={"ID":"e60a7add-c1a7-48bb-8da0-1a898234c833","Type":"ContainerStarted","Data":"bf2569166676b0646e5971b28d52546c0a39956462d600b51b6acd77e481035d"}
Jul 21 15:37:34.244850 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:34.244814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq" event={"ID":"e60a7add-c1a7-48bb-8da0-1a898234c833","Type":"ContainerStarted","Data":"3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41"}
Jul 21 15:37:34.245170 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:34.244968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:37:34.263824 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:34.263786    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq" podStartSLOduration=1.0159648 podStartE2EDuration="2.263774024s" totalImagesPullingTime="1.247809224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:37:34.262115104 +0000 UTC m=+2305.406028081" watchObservedRunningTime="2026-07-21 15:37:34.263774024 +0000 UTC m=+2305.407687030"
Jul 21 15:37:40.254863 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:37:40.254837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:38:08.521922 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.521839    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"]
Jul 21 15:38:08.522473 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.522076    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq" podUID="e60a7add-c1a7-48bb-8da0-1a898234c833" containerName="maas-api" containerID="cri-o://3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41" gracePeriod=30
Jul 21 15:38:08.761669 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.761632    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:38:08.776648 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.776606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60a7add-c1a7-48bb-8da0-1a898234c833-maas-api-tls\") pod \"e60a7add-c1a7-48bb-8da0-1a898234c833\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") "
Jul 21 15:38:08.776648 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.776632    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rxgt\" (UniqueName: \"kubernetes.io/projected/e60a7add-c1a7-48bb-8da0-1a898234c833-kube-api-access-4rxgt\") pod \"e60a7add-c1a7-48bb-8da0-1a898234c833\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") "
Jul 21 15:38:08.776781 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.776690    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60a7add-c1a7-48bb-8da0-1a898234c833-openshift-service-ca\") pod \"e60a7add-c1a7-48bb-8da0-1a898234c833\" (UID: \"e60a7add-c1a7-48bb-8da0-1a898234c833\") "
Jul 21 15:38:08.777197 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.777166    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e60a7add-c1a7-48bb-8da0-1a898234c833-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e60a7add-c1a7-48bb-8da0-1a898234c833" (UID: "e60a7add-c1a7-48bb-8da0-1a898234c833"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:38:08.779118 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.779093    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60a7add-c1a7-48bb-8da0-1a898234c833-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e60a7add-c1a7-48bb-8da0-1a898234c833" (UID: "e60a7add-c1a7-48bb-8da0-1a898234c833"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:38:08.779467 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.779431    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60a7add-c1a7-48bb-8da0-1a898234c833-kube-api-access-4rxgt" (OuterVolumeSpecName: "kube-api-access-4rxgt") pod "e60a7add-c1a7-48bb-8da0-1a898234c833" (UID: "e60a7add-c1a7-48bb-8da0-1a898234c833"). InnerVolumeSpecName "kube-api-access-4rxgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:38:08.877346 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.877326    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e60a7add-c1a7-48bb-8da0-1a898234c833-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:38:08.877425 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.877347    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rxgt\" (UniqueName: \"kubernetes.io/projected/e60a7add-c1a7-48bb-8da0-1a898234c833-kube-api-access-4rxgt\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:38:08.877425 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:08.877357    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60a7add-c1a7-48bb-8da0-1a898234c833-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:38:09.401051 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.401026    2562 generic.go:356] "Generic (PLEG): container finished" podID="e60a7add-c1a7-48bb-8da0-1a898234c833" containerID="3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41" exitCode=0
Jul 21 15:38:09.401165 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.401057    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"
Jul 21 15:38:09.401165 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.401110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq" event={"ID":"e60a7add-c1a7-48bb-8da0-1a898234c833","Type":"ContainerDied","Data":"3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41"}
Jul 21 15:38:09.401165 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.401154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq" event={"ID":"e60a7add-c1a7-48bb-8da0-1a898234c833","Type":"ContainerDied","Data":"bf2569166676b0646e5971b28d52546c0a39956462d600b51b6acd77e481035d"}
Jul 21 15:38:09.401266 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.401175    2562 scope.go:117] "RemoveContainer" containerID="3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41"
Jul 21 15:38:09.409146 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.409128    2562 scope.go:117] "RemoveContainer" containerID="3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41"
Jul 21 15:38:09.409409 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:38:09.409392    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41\": container with ID starting with 3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41 not found: ID does not exist" containerID="3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41"
Jul 21 15:38:09.409481 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.409416    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41"} err="failed to get container status \"3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41\": rpc error: code = NotFound desc = could not find container \"3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41\": container with ID starting with 3b04a29af0d351f9ab8eba7825f764d177f2f010ed1a41faf764d91878879d41 not found: ID does not exist"
Jul 21 15:38:09.416163 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.416143    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"]
Jul 21 15:38:09.422023 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:09.422000    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ed4302cf-7c9b8c85cd-bzwhq"]
Jul 21 15:38:11.298492 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:38:11.298459    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e60a7add-c1a7-48bb-8da0-1a898234c833" path="/var/lib/kubelet/pods/e60a7add-c1a7-48bb-8da0-1a898234c833/volumes"
Jul 21 15:39:09.396148 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:39:09.396122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:39:09.404503 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:39:09.404479    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:44:01.575873 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.575774    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"]
Jul 21 15:44:01.577965 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.576529    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60a7add-c1a7-48bb-8da0-1a898234c833" containerName="maas-api"
Jul 21 15:44:01.577965 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.576547    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60a7add-c1a7-48bb-8da0-1a898234c833" containerName="maas-api"
Jul 21 15:44:01.577965 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.576796    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e60a7add-c1a7-48bb-8da0-1a898234c833" containerName="maas-api"
Jul 21 15:44:01.580603 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.580583    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.583078 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.583052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5195cc17-serving-cert\""
Jul 21 15:44:01.588122 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.588013    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"]
Jul 21 15:44:01.676877 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.676856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2ll7\" (UniqueName: \"kubernetes.io/projected/5c3ddd88-b0db-4cab-8dff-1718572315e9-kube-api-access-l2ll7\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.676990 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.676892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3ddd88-b0db-4cab-8dff-1718572315e9-maas-api-tls\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.676990 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.676935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3ddd88-b0db-4cab-8dff-1718572315e9-openshift-service-ca\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.778287 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.778255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2ll7\" (UniqueName: \"kubernetes.io/projected/5c3ddd88-b0db-4cab-8dff-1718572315e9-kube-api-access-l2ll7\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.778411 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.778296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3ddd88-b0db-4cab-8dff-1718572315e9-maas-api-tls\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.778411 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.778335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3ddd88-b0db-4cab-8dff-1718572315e9-openshift-service-ca\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.779043 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.779014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3ddd88-b0db-4cab-8dff-1718572315e9-openshift-service-ca\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.781021 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.780990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3ddd88-b0db-4cab-8dff-1718572315e9-maas-api-tls\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.786473 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.786455    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2ll7\" (UniqueName: \"kubernetes.io/projected/5c3ddd88-b0db-4cab-8dff-1718572315e9-kube-api-access-l2ll7\") pod \"maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:01.892105 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:01.892079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:02.032151 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:02.032128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"]
Jul 21 15:44:02.034621 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:44:02.034593    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3ddd88_b0db_4cab_8dff_1718572315e9.slice/crio-d5a6cb2562bbf8ed32109999becf923bdf8ea1078132122cad1ef314d0a10db7 WatchSource:0}: Error finding container d5a6cb2562bbf8ed32109999becf923bdf8ea1078132122cad1ef314d0a10db7: Status 404 returned error can't find the container with id d5a6cb2562bbf8ed32109999becf923bdf8ea1078132122cad1ef314d0a10db7
Jul 21 15:44:02.036031 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:02.036013    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:44:02.950033 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:02.949951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv" event={"ID":"5c3ddd88-b0db-4cab-8dff-1718572315e9","Type":"ContainerStarted","Data":"092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb"}
Jul 21 15:44:02.950033 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:02.950008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv" event={"ID":"5c3ddd88-b0db-4cab-8dff-1718572315e9","Type":"ContainerStarted","Data":"d5a6cb2562bbf8ed32109999becf923bdf8ea1078132122cad1ef314d0a10db7"}
Jul 21 15:44:02.950421 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:02.950035    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:02.970858 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:02.970811    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv" podStartSLOduration=1.392637581 podStartE2EDuration="1.970795966s" totalImagesPullingTime="578.158385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:44:02.968485053 +0000 UTC m=+2694.112398023" watchObservedRunningTime="2026-07-21 15:44:02.970795966 +0000 UTC m=+2694.114708938"
Jul 21 15:44:08.960846 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:08.960818    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:09.422361 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:09.422325    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:44:09.432590 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:09.432572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:44:36.665308 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.665270    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"]
Jul 21 15:44:36.665883 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.665485    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv" podUID="5c3ddd88-b0db-4cab-8dff-1718572315e9" containerName="maas-api" containerID="cri-o://092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb" gracePeriod=30
Jul 21 15:44:36.914698 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.914672    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:36.978530 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.978457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3ddd88-b0db-4cab-8dff-1718572315e9-openshift-service-ca\") pod \"5c3ddd88-b0db-4cab-8dff-1718572315e9\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") "
Jul 21 15:44:36.978702 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.978555    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2ll7\" (UniqueName: \"kubernetes.io/projected/5c3ddd88-b0db-4cab-8dff-1718572315e9-kube-api-access-l2ll7\") pod \"5c3ddd88-b0db-4cab-8dff-1718572315e9\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") "
Jul 21 15:44:36.978702 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.978598    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3ddd88-b0db-4cab-8dff-1718572315e9-maas-api-tls\") pod \"5c3ddd88-b0db-4cab-8dff-1718572315e9\" (UID: \"5c3ddd88-b0db-4cab-8dff-1718572315e9\") "
Jul 21 15:44:36.978899 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.978837    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3ddd88-b0db-4cab-8dff-1718572315e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c3ddd88-b0db-4cab-8dff-1718572315e9" (UID: "5c3ddd88-b0db-4cab-8dff-1718572315e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:44:36.978899 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.978895    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c3ddd88-b0db-4cab-8dff-1718572315e9-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:44:36.980836 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.980812    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3ddd88-b0db-4cab-8dff-1718572315e9-kube-api-access-l2ll7" (OuterVolumeSpecName: "kube-api-access-l2ll7") pod "5c3ddd88-b0db-4cab-8dff-1718572315e9" (UID: "5c3ddd88-b0db-4cab-8dff-1718572315e9"). InnerVolumeSpecName "kube-api-access-l2ll7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:44:36.980836 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:36.980817    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3ddd88-b0db-4cab-8dff-1718572315e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c3ddd88-b0db-4cab-8dff-1718572315e9" (UID: "5c3ddd88-b0db-4cab-8dff-1718572315e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:44:37.079520 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.079491    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2ll7\" (UniqueName: \"kubernetes.io/projected/5c3ddd88-b0db-4cab-8dff-1718572315e9-kube-api-access-l2ll7\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:44:37.079520 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.079517    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c3ddd88-b0db-4cab-8dff-1718572315e9-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:44:37.112586 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.112558    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c3ddd88-b0db-4cab-8dff-1718572315e9" containerID="092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb" exitCode=0
Jul 21 15:44:37.112732 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.112594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv" event={"ID":"5c3ddd88-b0db-4cab-8dff-1718572315e9","Type":"ContainerDied","Data":"092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb"}
Jul 21 15:44:37.112732 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.112608    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"
Jul 21 15:44:37.112732 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.112637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv" event={"ID":"5c3ddd88-b0db-4cab-8dff-1718572315e9","Type":"ContainerDied","Data":"d5a6cb2562bbf8ed32109999becf923bdf8ea1078132122cad1ef314d0a10db7"}
Jul 21 15:44:37.112732 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.112678    2562 scope.go:117] "RemoveContainer" containerID="092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb"
Jul 21 15:44:37.121737 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.121720    2562 scope.go:117] "RemoveContainer" containerID="092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb"
Jul 21 15:44:37.121990 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:44:37.121969    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb\": container with ID starting with 092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb not found: ID does not exist" containerID="092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb"
Jul 21 15:44:37.122055 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.122002    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb"} err="failed to get container status \"092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb\": rpc error: code = NotFound desc = could not find container \"092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb\": container with ID starting with 092f51bf6bc2cc7226689b27409fdac93e7fea93fd6417889974682ae85b2edb not found: ID does not exist"
Jul 21 15:44:37.132913 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.132886    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"]
Jul 21 15:44:37.135417 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.135398    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5195cc17-85c5f5c7b4-pp6pv"]
Jul 21 15:44:37.298711 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:44:37.298631    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3ddd88-b0db-4cab-8dff-1718572315e9" path="/var/lib/kubelet/pods/5c3ddd88-b0db-4cab-8dff-1718572315e9/volumes"
Jul 21 15:49:06.041309 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.041271    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"]
Jul 21 15:49:06.043792 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.041852    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3ddd88-b0db-4cab-8dff-1718572315e9" containerName="maas-api"
Jul 21 15:49:06.043792 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.041868    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3ddd88-b0db-4cab-8dff-1718572315e9" containerName="maas-api"
Jul 21 15:49:06.043792 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.041968    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3ddd88-b0db-4cab-8dff-1718572315e9" containerName="maas-api"
Jul 21 15:49:06.045320 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.045303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.048536 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.048513    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bfbfdffb-serving-cert\""
Jul 21 15:49:06.059847 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.059820    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"]
Jul 21 15:49:06.152581 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.152557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.152708 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.152598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc37d71-5258-44a1-97e2-bfa424a44ef3-openshift-service-ca\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.152708 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.152690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhcnb\" (UniqueName: \"kubernetes.io/projected/cfc37d71-5258-44a1-97e2-bfa424a44ef3-kube-api-access-bhcnb\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.253259 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.253234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.253350 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.253273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc37d71-5258-44a1-97e2-bfa424a44ef3-openshift-service-ca\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.253350 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.253308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhcnb\" (UniqueName: \"kubernetes.io/projected/cfc37d71-5258-44a1-97e2-bfa424a44ef3-kube-api-access-bhcnb\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.253477 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:49:06.253368    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-serving-cert: secret "maas-api-e2e-mt-bfbfdffb-serving-cert" not found
Jul 21 15:49:06.253477 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:49:06.253441    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls podName:cfc37d71-5258-44a1-97e2-bfa424a44ef3 nodeName:}" failed. No retries permitted until 2026-07-21 15:49:06.753422514 +0000 UTC m=+2997.897335463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls") pod "maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" (UID: "cfc37d71-5258-44a1-97e2-bfa424a44ef3") : secret "maas-api-e2e-mt-bfbfdffb-serving-cert" not found
Jul 21 15:49:06.253896 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.253879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc37d71-5258-44a1-97e2-bfa424a44ef3-openshift-service-ca\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.276332 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.276303    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhcnb\" (UniqueName: \"kubernetes.io/projected/cfc37d71-5258-44a1-97e2-bfa424a44ef3-kube-api-access-bhcnb\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.757626 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.757600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.759990 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.759961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls\") pod \"maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:06.955378 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:06.955350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:07.088853 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:07.088828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"]
Jul 21 15:49:07.091846 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:49:07.091815    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc37d71_5258_44a1_97e2_bfa424a44ef3.slice/crio-3a25d99981912194b2b8437508cd5ef4c30b3f72a625b9abc52d0844b1e4c852 WatchSource:0}: Error finding container 3a25d99981912194b2b8437508cd5ef4c30b3f72a625b9abc52d0844b1e4c852: Status 404 returned error can't find the container with id 3a25d99981912194b2b8437508cd5ef4c30b3f72a625b9abc52d0844b1e4c852
Jul 21 15:49:07.093234 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:07.093218    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:49:07.401717 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:07.401682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" event={"ID":"cfc37d71-5258-44a1-97e2-bfa424a44ef3","Type":"ContainerStarted","Data":"3a25d99981912194b2b8437508cd5ef4c30b3f72a625b9abc52d0844b1e4c852"}
Jul 21 15:49:08.407230 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:08.407199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" event={"ID":"cfc37d71-5258-44a1-97e2-bfa424a44ef3","Type":"ContainerStarted","Data":"b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664"}
Jul 21 15:49:08.407550 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:08.407327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:08.425363 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:08.425311    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" podStartSLOduration=1.278812335 podStartE2EDuration="2.42529664s" totalImagesPullingTime="1.146484305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:49:08.423549035 +0000 UTC m=+2999.567462027" watchObservedRunningTime="2026-07-21 15:49:08.42529664 +0000 UTC m=+2999.569209609"
Jul 21 15:49:09.451429 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:09.451403    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:49:09.469237 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:09.469212    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:49:14.417029 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:14.416996    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:27.939210 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:27.939174    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"]
Jul 21 15:49:27.939613 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:27.939374    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" podUID="cfc37d71-5258-44a1-97e2-bfa424a44ef3" containerName="maas-api" containerID="cri-o://b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664" gracePeriod=30
Jul 21 15:49:28.182098 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.182071    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:28.322458 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.322396    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhcnb\" (UniqueName: \"kubernetes.io/projected/cfc37d71-5258-44a1-97e2-bfa424a44ef3-kube-api-access-bhcnb\") pod \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") "
Jul 21 15:49:28.322458 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.322438    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls\") pod \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") "
Jul 21 15:49:28.322605 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.322505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc37d71-5258-44a1-97e2-bfa424a44ef3-openshift-service-ca\") pod \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\" (UID: \"cfc37d71-5258-44a1-97e2-bfa424a44ef3\") "
Jul 21 15:49:28.322930 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.322908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfc37d71-5258-44a1-97e2-bfa424a44ef3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cfc37d71-5258-44a1-97e2-bfa424a44ef3" (UID: "cfc37d71-5258-44a1-97e2-bfa424a44ef3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:49:28.324627 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.324600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfc37d71-5258-44a1-97e2-bfa424a44ef3-kube-api-access-bhcnb" (OuterVolumeSpecName: "kube-api-access-bhcnb") pod "cfc37d71-5258-44a1-97e2-bfa424a44ef3" (UID: "cfc37d71-5258-44a1-97e2-bfa424a44ef3"). InnerVolumeSpecName "kube-api-access-bhcnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:49:28.324627 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.324617    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cfc37d71-5258-44a1-97e2-bfa424a44ef3" (UID: "cfc37d71-5258-44a1-97e2-bfa424a44ef3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:49:28.423765 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.423736    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfc37d71-5258-44a1-97e2-bfa424a44ef3-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:49:28.423765 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.423760    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhcnb\" (UniqueName: \"kubernetes.io/projected/cfc37d71-5258-44a1-97e2-bfa424a44ef3-kube-api-access-bhcnb\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:49:28.423907 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.423773    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cfc37d71-5258-44a1-97e2-bfa424a44ef3-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:49:28.496409 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.496385    2562 generic.go:356] "Generic (PLEG): container finished" podID="cfc37d71-5258-44a1-97e2-bfa424a44ef3" containerID="b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664" exitCode=0
Jul 21 15:49:28.496516 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.496431    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"
Jul 21 15:49:28.496516 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.496428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" event={"ID":"cfc37d71-5258-44a1-97e2-bfa424a44ef3","Type":"ContainerDied","Data":"b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664"}
Jul 21 15:49:28.496584 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.496552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6" event={"ID":"cfc37d71-5258-44a1-97e2-bfa424a44ef3","Type":"ContainerDied","Data":"3a25d99981912194b2b8437508cd5ef4c30b3f72a625b9abc52d0844b1e4c852"}
Jul 21 15:49:28.496584 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.496576    2562 scope.go:117] "RemoveContainer" containerID="b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664"
Jul 21 15:49:28.505183 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.505168    2562 scope.go:117] "RemoveContainer" containerID="b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664"
Jul 21 15:49:28.505418 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:49:28.505399    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664\": container with ID starting with b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664 not found: ID does not exist" containerID="b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664"
Jul 21 15:49:28.505480 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.505430    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664"} err="failed to get container status \"b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664\": rpc error: code = NotFound desc = could not find container \"b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664\": container with ID starting with b568a405165c50e22977b9c773fbc1715098fdab8eeb5488698f422e281b8664 not found: ID does not exist"
Jul 21 15:49:28.517300 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.517281    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"]
Jul 21 15:49:28.520606 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:28.520588    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfbfdffb-76c9f4fdb6-bt4v6"]
Jul 21 15:49:29.303843 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:49:29.303811    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfc37d71-5258-44a1-97e2-bfa424a44ef3" path="/var/lib/kubelet/pods/cfc37d71-5258-44a1-97e2-bfa424a44ef3/volumes"
Jul 21 15:52:46.958413 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.958379    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"]
Jul 21 15:52:46.958871 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.958754    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfc37d71-5258-44a1-97e2-bfa424a44ef3" containerName="maas-api"
Jul 21 15:52:46.958871 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.958766    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfc37d71-5258-44a1-97e2-bfa424a44ef3" containerName="maas-api"
Jul 21 15:52:46.958871 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.958837    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfc37d71-5258-44a1-97e2-bfa424a44ef3" containerName="maas-api"
Jul 21 15:52:46.961732 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.961717    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:46.964155 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.964129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-534ea2a9-serving-cert\""
Jul 21 15:52:46.971147 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:46.971121    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"]
Jul 21 15:52:47.009530 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.009496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.009637 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.009533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3056a007-54d2-40ed-a4da-35ac67675756-openshift-service-ca\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.009637 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.009615    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsttc\" (UniqueName: \"kubernetes.io/projected/3056a007-54d2-40ed-a4da-35ac67675756-kube-api-access-dsttc\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.110885 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.110849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.110885 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.110888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3056a007-54d2-40ed-a4da-35ac67675756-openshift-service-ca\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.111114 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.110964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsttc\" (UniqueName: \"kubernetes.io/projected/3056a007-54d2-40ed-a4da-35ac67675756-kube-api-access-dsttc\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.111114 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:52:47.111001    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-serving-cert: secret "maas-api-e2e-mt-534ea2a9-serving-cert" not found
Jul 21 15:52:47.111114 ip-10-0-130-165 kubenswrapper[2562]: E0721 15:52:47.111070    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls podName:3056a007-54d2-40ed-a4da-35ac67675756 nodeName:}" failed. No retries permitted until 2026-07-21 15:52:47.61105447 +0000 UTC m=+3218.754967422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls") pod "maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" (UID: "3056a007-54d2-40ed-a4da-35ac67675756") : secret "maas-api-e2e-mt-534ea2a9-serving-cert" not found
Jul 21 15:52:47.111542 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.111523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3056a007-54d2-40ed-a4da-35ac67675756-openshift-service-ca\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.125617 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.125593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsttc\" (UniqueName: \"kubernetes.io/projected/3056a007-54d2-40ed-a4da-35ac67675756-kube-api-access-dsttc\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.615409 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.615371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.618071 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.618045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls\") pod \"maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:47.872651 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:47.872571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:48.015602 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:48.015553    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"]
Jul 21 15:52:48.017878 ip-10-0-130-165 kubenswrapper[2562]: W0721 15:52:48.017852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3056a007_54d2_40ed_a4da_35ac67675756.slice/crio-5db12f3c8704e27a9d8055c509463fd4e7796dbcb533e98c83d56254f4a063f5 WatchSource:0}: Error finding container 5db12f3c8704e27a9d8055c509463fd4e7796dbcb533e98c83d56254f4a063f5: Status 404 returned error can't find the container with id 5db12f3c8704e27a9d8055c509463fd4e7796dbcb533e98c83d56254f4a063f5
Jul 21 15:52:48.391403 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:48.391373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" event={"ID":"3056a007-54d2-40ed-a4da-35ac67675756","Type":"ContainerStarted","Data":"5db12f3c8704e27a9d8055c509463fd4e7796dbcb533e98c83d56254f4a063f5"}
Jul 21 15:52:49.397378 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:49.397342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" event={"ID":"3056a007-54d2-40ed-a4da-35ac67675756","Type":"ContainerStarted","Data":"601c9014172c47d51b7df7d0a4e4572474b47294e109dc426cfa43caadeb39db"}
Jul 21 15:52:49.397796 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:49.397430    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:52:49.415793 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:49.415749    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" podStartSLOduration=2.927656395 podStartE2EDuration="3.41573595s" totalImagesPullingTime="488.079555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:52:49.413601087 +0000 UTC m=+3220.557514058" watchObservedRunningTime="2026-07-21 15:52:49.41573595 +0000 UTC m=+3220.559648920"
Jul 21 15:52:55.407906 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:52:55.407876    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:53:35.407263 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.407224    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"]
Jul 21 15:53:35.407825 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.407480    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" podUID="3056a007-54d2-40ed-a4da-35ac67675756" containerName="maas-api" containerID="cri-o://601c9014172c47d51b7df7d0a4e4572474b47294e109dc426cfa43caadeb39db" gracePeriod=30
Jul 21 15:53:35.621462 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.621427    2562 generic.go:356] "Generic (PLEG): container finished" podID="3056a007-54d2-40ed-a4da-35ac67675756" containerID="601c9014172c47d51b7df7d0a4e4572474b47294e109dc426cfa43caadeb39db" exitCode=0
Jul 21 15:53:35.621628 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.621473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" event={"ID":"3056a007-54d2-40ed-a4da-35ac67675756","Type":"ContainerDied","Data":"601c9014172c47d51b7df7d0a4e4572474b47294e109dc426cfa43caadeb39db"}
Jul 21 15:53:35.653599 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.653575    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:53:35.794260 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.794180    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsttc\" (UniqueName: \"kubernetes.io/projected/3056a007-54d2-40ed-a4da-35ac67675756-kube-api-access-dsttc\") pod \"3056a007-54d2-40ed-a4da-35ac67675756\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") "
Jul 21 15:53:35.794421 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.794272    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3056a007-54d2-40ed-a4da-35ac67675756-openshift-service-ca\") pod \"3056a007-54d2-40ed-a4da-35ac67675756\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") "
Jul 21 15:53:35.794421 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.794309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls\") pod \"3056a007-54d2-40ed-a4da-35ac67675756\" (UID: \"3056a007-54d2-40ed-a4da-35ac67675756\") "
Jul 21 15:53:35.794738 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.794706    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3056a007-54d2-40ed-a4da-35ac67675756-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3056a007-54d2-40ed-a4da-35ac67675756" (UID: "3056a007-54d2-40ed-a4da-35ac67675756"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:53:35.796424 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.796400    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3056a007-54d2-40ed-a4da-35ac67675756-kube-api-access-dsttc" (OuterVolumeSpecName: "kube-api-access-dsttc") pod "3056a007-54d2-40ed-a4da-35ac67675756" (UID: "3056a007-54d2-40ed-a4da-35ac67675756"). InnerVolumeSpecName "kube-api-access-dsttc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:53:35.796637 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.796618    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3056a007-54d2-40ed-a4da-35ac67675756" (UID: "3056a007-54d2-40ed-a4da-35ac67675756"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:53:35.895014 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.894991    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3056a007-54d2-40ed-a4da-35ac67675756-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:53:35.895014 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.895011    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3056a007-54d2-40ed-a4da-35ac67675756-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:53:35.895014 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:35.895021    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsttc\" (UniqueName: \"kubernetes.io/projected/3056a007-54d2-40ed-a4da-35ac67675756-kube-api-access-dsttc\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 15:53:36.628454 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:36.628416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq" event={"ID":"3056a007-54d2-40ed-a4da-35ac67675756","Type":"ContainerDied","Data":"5db12f3c8704e27a9d8055c509463fd4e7796dbcb533e98c83d56254f4a063f5"}
Jul 21 15:53:36.628948 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:36.628484    2562 scope.go:117] "RemoveContainer" containerID="601c9014172c47d51b7df7d0a4e4572474b47294e109dc426cfa43caadeb39db"
Jul 21 15:53:36.628948 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:36.628428    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"
Jul 21 15:53:36.649164 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:36.649136    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"]
Jul 21 15:53:36.653240 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:36.653217    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-534ea2a9-585ff4959d-pz9zq"]
Jul 21 15:53:37.298528 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:53:37.298497    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3056a007-54d2-40ed-a4da-35ac67675756" path="/var/lib/kubelet/pods/3056a007-54d2-40ed-a4da-35ac67675756/volumes"
Jul 21 15:54:09.483698 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:54:09.483648    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:54:09.509635 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:54:09.509604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:59:09.522262 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:59:09.522160    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 15:59:09.539836 ip-10-0-130-165 kubenswrapper[2562]: I0721 15:59:09.539817    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:00:03.193105 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:00:03.193072    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"]
Jul 21 16:00:03.195461 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:00:03.195439    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9vjz8"]
Jul 21 16:00:03.298066 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:00:03.298040    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cedef3e1-bbfa-4b53-8b1f-f167fbee18b8" path="/var/lib/kubelet/pods/cedef3e1-bbfa-4b53-8b1f-f167fbee18b8/volumes"
Jul 21 16:00:09.656010 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:00:09.655980    2562 scope.go:117] "RemoveContainer" containerID="c6e9e049a1189e7b4bcf82fcdba239aa7efdc61e1b8a07a5d6e2d0a9a0aae00a"
Jul 21 16:04:09.553840 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:09.553740    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:04:09.569943 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:09.569911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:04:16.987263 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:16.987231    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"]
Jul 21 16:04:16.987874 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:16.987602    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3056a007-54d2-40ed-a4da-35ac67675756" containerName="maas-api"
Jul 21 16:04:16.987874 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:16.987613    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3056a007-54d2-40ed-a4da-35ac67675756" containerName="maas-api"
Jul 21 16:04:16.987874 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:16.987714    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3056a007-54d2-40ed-a4da-35ac67675756" containerName="maas-api"
Jul 21 16:04:16.990973 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:16.990950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:16.993614 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:16.993590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-682cb4-serving-cert\""
Jul 21 16:04:17.004925 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.004896    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"]
Jul 21 16:04:17.092342 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.092309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwpcl\" (UniqueName: \"kubernetes.io/projected/6e029014-7fbd-41b2-a9e9-c6a434f960de-kube-api-access-wwpcl\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.092342 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.092355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e029014-7fbd-41b2-a9e9-c6a434f960de-openshift-service-ca\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.092558 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.092391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.193648 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.193617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwpcl\" (UniqueName: \"kubernetes.io/projected/6e029014-7fbd-41b2-a9e9-c6a434f960de-kube-api-access-wwpcl\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.193840 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.193690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e029014-7fbd-41b2-a9e9-c6a434f960de-openshift-service-ca\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.193840 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.193736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.193914 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:04:17.193853    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-serving-cert: secret "maas-api-e2e-inf-a-682cb4-serving-cert" not found
Jul 21 16:04:17.193950 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:04:17.193936    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls podName:6e029014-7fbd-41b2-a9e9-c6a434f960de nodeName:}" failed. No retries permitted until 2026-07-21 16:04:17.693915411 +0000 UTC m=+3908.837828363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls") pod "maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" (UID: "6e029014-7fbd-41b2-a9e9-c6a434f960de") : secret "maas-api-e2e-inf-a-682cb4-serving-cert" not found
Jul 21 16:04:17.194423 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.194405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e029014-7fbd-41b2-a9e9-c6a434f960de-openshift-service-ca\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.202576 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.202553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwpcl\" (UniqueName: \"kubernetes.io/projected/6e029014-7fbd-41b2-a9e9-c6a434f960de-kube-api-access-wwpcl\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.699334 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.699295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.701977 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.701958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls\") pod \"maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:17.911565 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:17.911526    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:18.047026 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:18.047000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"]
Jul 21 16:04:18.049977 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:04:18.049948    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e029014_7fbd_41b2_a9e9_c6a434f960de.slice/crio-9483453e29ab1b50b7993b75249f7dec5f061d27a1821f8ec562aab54b54ffd0 WatchSource:0}: Error finding container 9483453e29ab1b50b7993b75249f7dec5f061d27a1821f8ec562aab54b54ffd0: Status 404 returned error can't find the container with id 9483453e29ab1b50b7993b75249f7dec5f061d27a1821f8ec562aab54b54ffd0
Jul 21 16:04:18.051635 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:18.051618    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:04:18.583222 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:18.583186    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" event={"ID":"6e029014-7fbd-41b2-a9e9-c6a434f960de","Type":"ContainerStarted","Data":"9483453e29ab1b50b7993b75249f7dec5f061d27a1821f8ec562aab54b54ffd0"}
Jul 21 16:04:19.588760 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:19.588728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" event={"ID":"6e029014-7fbd-41b2-a9e9-c6a434f960de","Type":"ContainerStarted","Data":"da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06"}
Jul 21 16:04:19.589097 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:19.588834    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:19.604841 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:19.604797    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" podStartSLOduration=3.101280339 podStartE2EDuration="3.604783279s" totalImagesPullingTime="503.50294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:04:19.603408654 +0000 UTC m=+3910.747321624" watchObservedRunningTime="2026-07-21 16:04:19.604783279 +0000 UTC m=+3910.748696250"
Jul 21 16:04:25.018709 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.018674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"]
Jul 21 16:04:25.022458 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.022442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.024707 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.024683    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-26bb92-serving-cert\""
Jul 21 16:04:25.030833 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.030681    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"]
Jul 21 16:04:25.163587 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.163559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vz9\" (UniqueName: \"kubernetes.io/projected/6da62c29-2b4b-48af-a2b0-84c427d5787e-kube-api-access-n7vz9\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.163772 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.163591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da62c29-2b4b-48af-a2b0-84c427d5787e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.163772 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.163619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6da62c29-2b4b-48af-a2b0-84c427d5787e-maas-api-tls\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.264609 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.264579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6da62c29-2b4b-48af-a2b0-84c427d5787e-maas-api-tls\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.264778 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.264719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vz9\" (UniqueName: \"kubernetes.io/projected/6da62c29-2b4b-48af-a2b0-84c427d5787e-kube-api-access-n7vz9\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.264778 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.264750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da62c29-2b4b-48af-a2b0-84c427d5787e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.265316 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.265293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da62c29-2b4b-48af-a2b0-84c427d5787e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.267148 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.267126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6da62c29-2b4b-48af-a2b0-84c427d5787e-maas-api-tls\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.272625 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.272579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vz9\" (UniqueName: \"kubernetes.io/projected/6da62c29-2b4b-48af-a2b0-84c427d5787e-kube-api-access-n7vz9\") pod \"maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.335862 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.335839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:25.470864 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.470837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"]
Jul 21 16:04:25.472900 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:04:25.472872    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da62c29_2b4b_48af_a2b0_84c427d5787e.slice/crio-f15b5c85aa9c06ee3594b97ef10ebc2d1e11f4bf59f34d91c23e0f5b841080e6 WatchSource:0}: Error finding container f15b5c85aa9c06ee3594b97ef10ebc2d1e11f4bf59f34d91c23e0f5b841080e6: Status 404 returned error can't find the container with id f15b5c85aa9c06ee3594b97ef10ebc2d1e11f4bf59f34d91c23e0f5b841080e6
Jul 21 16:04:25.599290 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.599269    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:04:25.619344 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:25.619311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl" event={"ID":"6da62c29-2b4b-48af-a2b0-84c427d5787e","Type":"ContainerStarted","Data":"f15b5c85aa9c06ee3594b97ef10ebc2d1e11f4bf59f34d91c23e0f5b841080e6"}
Jul 21 16:04:26.625727 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:26.625695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl" event={"ID":"6da62c29-2b4b-48af-a2b0-84c427d5787e","Type":"ContainerStarted","Data":"408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796"}
Jul 21 16:04:26.626100 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:26.625776    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:04:26.642669 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:26.642622    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl" podStartSLOduration=2.333688497 podStartE2EDuration="2.642604755s" totalImagesPullingTime="308.916258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:04:26.641425198 +0000 UTC m=+3917.785338170" watchObservedRunningTime="2026-07-21 16:04:26.642604755 +0000 UTC m=+3917.786517730"
Jul 21 16:04:32.636211 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:04:32.636182    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:05:13.051893 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.051809    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"]
Jul 21 16:05:13.055844 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.055824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.059362 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.059335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-26bb92\"/\"default-dockercfg-sk6xh\""
Jul 21 16:05:13.059489 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.059335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-26bb92\"/\"kube-root-ca.crt\""
Jul 21 16:05:13.059489 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.059422    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-26bb92\"/\"test-model-26bb92-kserve-self-signed-certs\""
Jul 21 16:05:13.059580 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.059500    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-26bb92\"/\"openshift-service-ca.crt\""
Jul 21 16:05:13.066481 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.066458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"]
Jul 21 16:05:13.151853 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.151824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-home\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.151853 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.151854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd436e5-9497-4958-b8b1-1b188f58a458-tls-certs\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.152048 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.151875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-model-cache\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.152048 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.151915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-dshm\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.152048 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.151936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-tmp-dir\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.152048 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.152015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vqsn\" (UniqueName: \"kubernetes.io/projected/edd436e5-9497-4958-b8b1-1b188f58a458-kube-api-access-4vqsn\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253200 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vqsn\" (UniqueName: \"kubernetes.io/projected/edd436e5-9497-4958-b8b1-1b188f58a458-kube-api-access-4vqsn\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253369 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-home\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253369 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd436e5-9497-4958-b8b1-1b188f58a458-tls-certs\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253369 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-model-cache\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253369 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-dshm\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253369 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-tmp-dir\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253629 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253569    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-home\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253696 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253638    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-tmp-dir\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.253755 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.253694    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-model-cache\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.255869 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.255836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-dshm\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.255995 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.255967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd436e5-9497-4958-b8b1-1b188f58a458-tls-certs\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.262130 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.262103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vqsn\" (UniqueName: \"kubernetes.io/projected/edd436e5-9497-4958-b8b1-1b188f58a458-kube-api-access-4vqsn\") pod \"test-model-26bb92-kserve-85549b4467-62q2l\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") " pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.365717 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.365688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:13.502280 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.502255    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"]
Jul 21 16:05:13.504199 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:05:13.504166    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedd436e5_9497_4958_b8b1_1b188f58a458.slice/crio-f0b3a26257c5c6cebffda56b68c434982a63ccfdfac258f69f6045f4c5a43b58 WatchSource:0}: Error finding container f0b3a26257c5c6cebffda56b68c434982a63ccfdfac258f69f6045f4c5a43b58: Status 404 returned error can't find the container with id f0b3a26257c5c6cebffda56b68c434982a63ccfdfac258f69f6045f4c5a43b58
Jul 21 16:05:13.839320 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.839286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l" event={"ID":"edd436e5-9497-4958-b8b1-1b188f58a458","Type":"ContainerStarted","Data":"8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc"}
Jul 21 16:05:13.839487 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.839332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l" event={"ID":"edd436e5-9497-4958-b8b1-1b188f58a458","Type":"ContainerStarted","Data":"f0b3a26257c5c6cebffda56b68c434982a63ccfdfac258f69f6045f4c5a43b58"}
Jul 21 16:05:13.855409 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:13.855355    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l" podStartSLOduration=0.855336226 podStartE2EDuration="855.336226ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:05:13.854090018 +0000 UTC m=+3964.998002989" watchObservedRunningTime="2026-07-21 16:05:13.855336226 +0000 UTC m=+3964.999249197"
Jul 21 16:05:23.366723 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:23.366689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:23.367080 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:23.366752    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:23.379233 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:23.379210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:05:23.899380 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:05:23.899349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:06:06.538088 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:06.538055    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"]
Jul 21 16:06:17.127313 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.127271    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"]
Jul 21 16:06:17.127926 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.127535    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" podUID="6e029014-7fbd-41b2-a9e9-c6a434f960de" containerName="maas-api" containerID="cri-o://da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06" gracePeriod=30
Jul 21 16:06:17.572975 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.572945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:06:17.665386 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.665321    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e029014-7fbd-41b2-a9e9-c6a434f960de-openshift-service-ca\") pod \"6e029014-7fbd-41b2-a9e9-c6a434f960de\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") "
Jul 21 16:06:17.665508 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.665466    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls\") pod \"6e029014-7fbd-41b2-a9e9-c6a434f960de\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") "
Jul 21 16:06:17.665592 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.665506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwpcl\" (UniqueName: \"kubernetes.io/projected/6e029014-7fbd-41b2-a9e9-c6a434f960de-kube-api-access-wwpcl\") pod \"6e029014-7fbd-41b2-a9e9-c6a434f960de\" (UID: \"6e029014-7fbd-41b2-a9e9-c6a434f960de\") "
Jul 21 16:06:17.665724 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.665699    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e029014-7fbd-41b2-a9e9-c6a434f960de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e029014-7fbd-41b2-a9e9-c6a434f960de" (UID: "6e029014-7fbd-41b2-a9e9-c6a434f960de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:06:17.667588 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.667560    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e029014-7fbd-41b2-a9e9-c6a434f960de" (UID: "6e029014-7fbd-41b2-a9e9-c6a434f960de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:06:17.667706 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.667614    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e029014-7fbd-41b2-a9e9-c6a434f960de-kube-api-access-wwpcl" (OuterVolumeSpecName: "kube-api-access-wwpcl") pod "6e029014-7fbd-41b2-a9e9-c6a434f960de" (UID: "6e029014-7fbd-41b2-a9e9-c6a434f960de"). InnerVolumeSpecName "kube-api-access-wwpcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:06:17.766204 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.766182    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e029014-7fbd-41b2-a9e9-c6a434f960de-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:17.766204 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.766201    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwpcl\" (UniqueName: \"kubernetes.io/projected/6e029014-7fbd-41b2-a9e9-c6a434f960de-kube-api-access-wwpcl\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:17.766333 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:17.766212    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e029014-7fbd-41b2-a9e9-c6a434f960de-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:18.153840 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.153806    2562 generic.go:356] "Generic (PLEG): container finished" podID="6e029014-7fbd-41b2-a9e9-c6a434f960de" containerID="da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06" exitCode=0
Jul 21 16:06:18.154161 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.153855    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"
Jul 21 16:06:18.154161 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.153890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" event={"ID":"6e029014-7fbd-41b2-a9e9-c6a434f960de","Type":"ContainerDied","Data":"da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06"}
Jul 21 16:06:18.154161 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.153944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf" event={"ID":"6e029014-7fbd-41b2-a9e9-c6a434f960de","Type":"ContainerDied","Data":"9483453e29ab1b50b7993b75249f7dec5f061d27a1821f8ec562aab54b54ffd0"}
Jul 21 16:06:18.154161 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.153969    2562 scope.go:117] "RemoveContainer" containerID="da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06"
Jul 21 16:06:18.163755 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.163718    2562 scope.go:117] "RemoveContainer" containerID="da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06"
Jul 21 16:06:18.164007 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:06:18.163989    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06\": container with ID starting with da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06 not found: ID does not exist" containerID="da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06"
Jul 21 16:06:18.164052 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.164015    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06"} err="failed to get container status \"da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06\": rpc error: code = NotFound desc = could not find container \"da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06\": container with ID starting with da8d8777da127a40063d03b3f48b959a8b85fadce2e172d1b9e6353455d21b06 not found: ID does not exist"
Jul 21 16:06:18.174415 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.174395    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"]
Jul 21 16:06:18.178193 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:18.178172    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-682cb4-7b984c84cf-q6xcf"]
Jul 21 16:06:19.298824 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:19.298786    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e029014-7fbd-41b2-a9e9-c6a434f960de" path="/var/lib/kubelet/pods/6e029014-7fbd-41b2-a9e9-c6a434f960de/volumes"
Jul 21 16:06:21.559140 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.559107    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l" podUID="edd436e5-9497-4958-b8b1-1b188f58a458" containerName="main" containerID="cri-o://8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc" gracePeriod=45
Jul 21 16:06:21.805022 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.804997    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:06:21.897970 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.897944    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-home\") pod \"edd436e5-9497-4958-b8b1-1b188f58a458\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") "
Jul 21 16:06:21.898093 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898016    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-tmp-dir\") pod \"edd436e5-9497-4958-b8b1-1b188f58a458\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") "
Jul 21 16:06:21.898093 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898069    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd436e5-9497-4958-b8b1-1b188f58a458-tls-certs\") pod \"edd436e5-9497-4958-b8b1-1b188f58a458\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") "
Jul 21 16:06:21.898188 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898094    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-dshm\") pod \"edd436e5-9497-4958-b8b1-1b188f58a458\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") "
Jul 21 16:06:21.898188 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898119    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-model-cache\") pod \"edd436e5-9497-4958-b8b1-1b188f58a458\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") "
Jul 21 16:06:21.898188 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898138    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vqsn\" (UniqueName: \"kubernetes.io/projected/edd436e5-9497-4958-b8b1-1b188f58a458-kube-api-access-4vqsn\") pod \"edd436e5-9497-4958-b8b1-1b188f58a458\" (UID: \"edd436e5-9497-4958-b8b1-1b188f58a458\") "
Jul 21 16:06:21.898355 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898212    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-home" (OuterVolumeSpecName: "home") pod "edd436e5-9497-4958-b8b1-1b188f58a458" (UID: "edd436e5-9497-4958-b8b1-1b188f58a458"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:06:21.898355 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898250    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "edd436e5-9497-4958-b8b1-1b188f58a458" (UID: "edd436e5-9497-4958-b8b1-1b188f58a458"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:06:21.898458 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898376    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-home\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:21.898458 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898391    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-tmp-dir\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:21.898458 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.898410    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-model-cache" (OuterVolumeSpecName: "model-cache") pod "edd436e5-9497-4958-b8b1-1b188f58a458" (UID: "edd436e5-9497-4958-b8b1-1b188f58a458"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:06:21.900507 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.900478    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd436e5-9497-4958-b8b1-1b188f58a458-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "edd436e5-9497-4958-b8b1-1b188f58a458" (UID: "edd436e5-9497-4958-b8b1-1b188f58a458"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:06:21.900598 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.900530    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-dshm" (OuterVolumeSpecName: "dshm") pod "edd436e5-9497-4958-b8b1-1b188f58a458" (UID: "edd436e5-9497-4958-b8b1-1b188f58a458"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:06:21.900598 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.900541    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd436e5-9497-4958-b8b1-1b188f58a458-kube-api-access-4vqsn" (OuterVolumeSpecName: "kube-api-access-4vqsn") pod "edd436e5-9497-4958-b8b1-1b188f58a458" (UID: "edd436e5-9497-4958-b8b1-1b188f58a458"). InnerVolumeSpecName "kube-api-access-4vqsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:06:21.999162 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.999137    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd436e5-9497-4958-b8b1-1b188f58a458-tls-certs\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:21.999162 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.999156    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-dshm\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:21.999162 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.999165    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edd436e5-9497-4958-b8b1-1b188f58a458-model-cache\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:21.999325 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:21.999173    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vqsn\" (UniqueName: \"kubernetes.io/projected/edd436e5-9497-4958-b8b1-1b188f58a458-kube-api-access-4vqsn\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:06:22.179896 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.179840    2562 generic.go:356] "Generic (PLEG): container finished" podID="edd436e5-9497-4958-b8b1-1b188f58a458" containerID="8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc" exitCode=0
Jul 21 16:06:22.179896 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.179891    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"
Jul 21 16:06:22.180047 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.179922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l" event={"ID":"edd436e5-9497-4958-b8b1-1b188f58a458","Type":"ContainerDied","Data":"8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc"}
Jul 21 16:06:22.180047 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.179974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l" event={"ID":"edd436e5-9497-4958-b8b1-1b188f58a458","Type":"ContainerDied","Data":"f0b3a26257c5c6cebffda56b68c434982a63ccfdfac258f69f6045f4c5a43b58"}
Jul 21 16:06:22.180047 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.179995    2562 scope.go:117] "RemoveContainer" containerID="8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc"
Jul 21 16:06:22.189475 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.189457    2562 scope.go:117] "RemoveContainer" containerID="8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc"
Jul 21 16:06:22.189828 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:06:22.189796    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc\": container with ID starting with 8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc not found: ID does not exist" containerID="8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc"
Jul 21 16:06:22.189911 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.189828    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc"} err="failed to get container status \"8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc\": rpc error: code = NotFound desc = could not find container \"8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc\": container with ID starting with 8b2d7838c4e3afbee221c51ae85f95cdeccb748399266a039b938513ecd302dc not found: ID does not exist"
Jul 21 16:06:22.201406 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.201382    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"]
Jul 21 16:06:22.205578 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:22.205546    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-26bb92/test-model-26bb92-kserve-85549b4467-62q2l"]
Jul 21 16:06:23.298774 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:06:23.298736    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd436e5-9497-4958-b8b1-1b188f58a458" path="/var/lib/kubelet/pods/edd436e5-9497-4958-b8b1-1b188f58a458/volumes"
Jul 21 16:09:09.585479 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:09.585363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:09:09.600102 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:09.600077    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:09:23.991505 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:23.991466    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"]
Jul 21 16:09:23.991991 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:23.991753    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl" podUID="6da62c29-2b4b-48af-a2b0-84c427d5787e" containerName="maas-api" containerID="cri-o://408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796" gracePeriod=30
Jul 21 16:09:24.236029 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.236003    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:09:24.368154 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.368129    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6da62c29-2b4b-48af-a2b0-84c427d5787e-maas-api-tls\") pod \"6da62c29-2b4b-48af-a2b0-84c427d5787e\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") "
Jul 21 16:09:24.368308 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.368165    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da62c29-2b4b-48af-a2b0-84c427d5787e-openshift-service-ca\") pod \"6da62c29-2b4b-48af-a2b0-84c427d5787e\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") "
Jul 21 16:09:24.368308 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.368205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7vz9\" (UniqueName: \"kubernetes.io/projected/6da62c29-2b4b-48af-a2b0-84c427d5787e-kube-api-access-n7vz9\") pod \"6da62c29-2b4b-48af-a2b0-84c427d5787e\" (UID: \"6da62c29-2b4b-48af-a2b0-84c427d5787e\") "
Jul 21 16:09:24.368555 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.368532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6da62c29-2b4b-48af-a2b0-84c427d5787e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6da62c29-2b4b-48af-a2b0-84c427d5787e" (UID: "6da62c29-2b4b-48af-a2b0-84c427d5787e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:09:24.370426 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.370407    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6da62c29-2b4b-48af-a2b0-84c427d5787e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6da62c29-2b4b-48af-a2b0-84c427d5787e" (UID: "6da62c29-2b4b-48af-a2b0-84c427d5787e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:09:24.370504 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.370465    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6da62c29-2b4b-48af-a2b0-84c427d5787e-kube-api-access-n7vz9" (OuterVolumeSpecName: "kube-api-access-n7vz9") pod "6da62c29-2b4b-48af-a2b0-84c427d5787e" (UID: "6da62c29-2b4b-48af-a2b0-84c427d5787e"). InnerVolumeSpecName "kube-api-access-n7vz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:09:24.468970 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.468945    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7vz9\" (UniqueName: \"kubernetes.io/projected/6da62c29-2b4b-48af-a2b0-84c427d5787e-kube-api-access-n7vz9\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:09:24.468970 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.468964    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6da62c29-2b4b-48af-a2b0-84c427d5787e-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:09:24.468970 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:24.468974    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6da62c29-2b4b-48af-a2b0-84c427d5787e-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:09:25.039443 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.039409    2562 generic.go:356] "Generic (PLEG): container finished" podID="6da62c29-2b4b-48af-a2b0-84c427d5787e" containerID="408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796" exitCode=0
Jul 21 16:09:25.039882 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.039455    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"
Jul 21 16:09:25.039882 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.039495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl" event={"ID":"6da62c29-2b4b-48af-a2b0-84c427d5787e","Type":"ContainerDied","Data":"408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796"}
Jul 21 16:09:25.039882 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.039549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl" event={"ID":"6da62c29-2b4b-48af-a2b0-84c427d5787e","Type":"ContainerDied","Data":"f15b5c85aa9c06ee3594b97ef10ebc2d1e11f4bf59f34d91c23e0f5b841080e6"}
Jul 21 16:09:25.039882 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.039571    2562 scope.go:117] "RemoveContainer" containerID="408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796"
Jul 21 16:09:25.048856 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.048835    2562 scope.go:117] "RemoveContainer" containerID="408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796"
Jul 21 16:09:25.049098 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:09:25.049080    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796\": container with ID starting with 408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796 not found: ID does not exist" containerID="408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796"
Jul 21 16:09:25.049150 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.049106    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796"} err="failed to get container status \"408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796\": rpc error: code = NotFound desc = could not find container \"408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796\": container with ID starting with 408fefbbc438934d54073357f2c65e24177e0075e0c46b7b0072750e77d05796 not found: ID does not exist"
Jul 21 16:09:25.060951 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.060929    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"]
Jul 21 16:09:25.067694 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.067672    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-26bb92-6d4fdf545b-4fqzl"]
Jul 21 16:09:25.298402 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:09:25.298334    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6da62c29-2b4b-48af-a2b0-84c427d5787e" path="/var/lib/kubelet/pods/6da62c29-2b4b-48af-a2b0-84c427d5787e/volumes"
Jul 21 16:12:23.833883 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.833851    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"]
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834223    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd436e5-9497-4958-b8b1-1b188f58a458" containerName="main"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834237    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd436e5-9497-4958-b8b1-1b188f58a458" containerName="main"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834257    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e029014-7fbd-41b2-a9e9-c6a434f960de" containerName="maas-api"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834263    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e029014-7fbd-41b2-a9e9-c6a434f960de" containerName="maas-api"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834268    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da62c29-2b4b-48af-a2b0-84c427d5787e" containerName="maas-api"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834273    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da62c29-2b4b-48af-a2b0-84c427d5787e" containerName="maas-api"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834333    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e029014-7fbd-41b2-a9e9-c6a434f960de" containerName="maas-api"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834339    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd436e5-9497-4958-b8b1-1b188f58a458" containerName="main"
Jul 21 16:12:23.834363 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.834348    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6da62c29-2b4b-48af-a2b0-84c427d5787e" containerName="maas-api"
Jul 21 16:12:23.837615 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.837599    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:23.839763 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.839738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-40a33d-serving-cert\""
Jul 21 16:12:23.847381 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.847169    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"]
Jul 21 16:12:23.925492 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.925462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9nz\" (UniqueName: \"kubernetes.io/projected/f21200fc-afd3-4052-be02-7f9e82536707-kube-api-access-zn9nz\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:23.925637 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.925505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:23.925637 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:23.925596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21200fc-afd3-4052-be02-7f9e82536707-openshift-service-ca\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.026118 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.026089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21200fc-afd3-4052-be02-7f9e82536707-openshift-service-ca\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.026268 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.026136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9nz\" (UniqueName: \"kubernetes.io/projected/f21200fc-afd3-4052-be02-7f9e82536707-kube-api-access-zn9nz\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.026268 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.026168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.026268 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:12:24.026265    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-serving-cert: secret "maas-api-e2e-api-a-40a33d-serving-cert" not found
Jul 21 16:12:24.026446 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:12:24.026324    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls podName:f21200fc-afd3-4052-be02-7f9e82536707 nodeName:}" failed. No retries permitted until 2026-07-21 16:12:24.526308871 +0000 UTC m=+4395.670221820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls") pod "maas-api-e2e-api-a-40a33d-64775cf494-6wx54" (UID: "f21200fc-afd3-4052-be02-7f9e82536707") : secret "maas-api-e2e-api-a-40a33d-serving-cert" not found
Jul 21 16:12:24.026845 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.026823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21200fc-afd3-4052-be02-7f9e82536707-openshift-service-ca\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.051241 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.051213    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9nz\" (UniqueName: \"kubernetes.io/projected/f21200fc-afd3-4052-be02-7f9e82536707-kube-api-access-zn9nz\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.530530 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.530502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.533059 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.533030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls\") pod \"maas-api-e2e-api-a-40a33d-64775cf494-6wx54\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.750353 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.750319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:24.890186 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.890163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"]
Jul 21 16:12:24.892348 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:12:24.892320    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21200fc_afd3_4052_be02_7f9e82536707.slice/crio-668de1c151757f064a17c5bae68d35970934e0d01fb4f377fe95bd9ffe50e6ed WatchSource:0}: Error finding container 668de1c151757f064a17c5bae68d35970934e0d01fb4f377fe95bd9ffe50e6ed: Status 404 returned error can't find the container with id 668de1c151757f064a17c5bae68d35970934e0d01fb4f377fe95bd9ffe50e6ed
Jul 21 16:12:24.893871 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:24.893849    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:12:25.890760 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:25.890721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54" event={"ID":"f21200fc-afd3-4052-be02-7f9e82536707","Type":"ContainerStarted","Data":"75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c"}
Jul 21 16:12:25.891224 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:25.890771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54" event={"ID":"f21200fc-afd3-4052-be02-7f9e82536707","Type":"ContainerStarted","Data":"668de1c151757f064a17c5bae68d35970934e0d01fb4f377fe95bd9ffe50e6ed"}
Jul 21 16:12:25.891224 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:25.890862    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:25.907871 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:25.907827    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54" podStartSLOduration=2.416298535 podStartE2EDuration="2.907814397s" totalImagesPullingTime="491.515862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:12:25.907532303 +0000 UTC m=+4397.051445274" watchObservedRunningTime="2026-07-21 16:12:25.907814397 +0000 UTC m=+4397.051727368"
Jul 21 16:12:31.901607 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:31.901515    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:31.916984 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:31.916944    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"]
Jul 21 16:12:31.920957 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:31.920930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:31.923397 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:31.923370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-fb94bd-serving-cert\""
Jul 21 16:12:31.931536 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:31.931505    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"]
Jul 21 16:12:32.089359 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.089331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb762995-99c8-4b2c-85cc-8b792634c10a-openshift-service-ca\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.089542 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.089368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb762995-99c8-4b2c-85cc-8b792634c10a-maas-api-tls\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.089542 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.089472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c4sc\" (UniqueName: \"kubernetes.io/projected/fb762995-99c8-4b2c-85cc-8b792634c10a-kube-api-access-5c4sc\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.190711 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.190629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb762995-99c8-4b2c-85cc-8b792634c10a-maas-api-tls\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.190711 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.190697    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c4sc\" (UniqueName: \"kubernetes.io/projected/fb762995-99c8-4b2c-85cc-8b792634c10a-kube-api-access-5c4sc\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.190864 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.190735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb762995-99c8-4b2c-85cc-8b792634c10a-openshift-service-ca\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.191357 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.191274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb762995-99c8-4b2c-85cc-8b792634c10a-openshift-service-ca\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.193217 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.193189    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb762995-99c8-4b2c-85cc-8b792634c10a-maas-api-tls\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.200687 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.200646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c4sc\" (UniqueName: \"kubernetes.io/projected/fb762995-99c8-4b2c-85cc-8b792634c10a-kube-api-access-5c4sc\") pod \"maas-api-e2e-api-b-fb94bd-c95f9865-8gs26\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.233436 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.233409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.364304 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.364259    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"]
Jul 21 16:12:32.367215 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:12:32.367191    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb762995_99c8_4b2c_85cc_8b792634c10a.slice/crio-c48fbebb57ce0a2c767f9b75325bb5789d849a3ad11b8b8cd63c12142c2dd015 WatchSource:0}: Error finding container c48fbebb57ce0a2c767f9b75325bb5789d849a3ad11b8b8cd63c12142c2dd015: Status 404 returned error can't find the container with id c48fbebb57ce0a2c767f9b75325bb5789d849a3ad11b8b8cd63c12142c2dd015
Jul 21 16:12:32.927861 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.927820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26" event={"ID":"fb762995-99c8-4b2c-85cc-8b792634c10a","Type":"ContainerStarted","Data":"ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332"}
Jul 21 16:12:32.928243 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.927874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26" event={"ID":"fb762995-99c8-4b2c-85cc-8b792634c10a","Type":"ContainerStarted","Data":"c48fbebb57ce0a2c767f9b75325bb5789d849a3ad11b8b8cd63c12142c2dd015"}
Jul 21 16:12:32.928243 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.927966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:32.944772 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:32.944694    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26" podStartSLOduration=1.626677269 podStartE2EDuration="1.944680677s" totalImagesPullingTime="318.003408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:12:32.943711477 +0000 UTC m=+4404.087624448" watchObservedRunningTime="2026-07-21 16:12:32.944680677 +0000 UTC m=+4404.088593648"
Jul 21 16:12:38.941428 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:38.941398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:12:55.411071 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.411035    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"]
Jul 21 16:12:55.411678 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.411274    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54" podUID="f21200fc-afd3-4052-be02-7f9e82536707" containerName="maas-api" containerID="cri-o://75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c" gracePeriod=30
Jul 21 16:12:55.656233 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.656200    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:55.690326 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.690247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls\") pod \"f21200fc-afd3-4052-be02-7f9e82536707\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") "
Jul 21 16:12:55.690326 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.690304    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn9nz\" (UniqueName: \"kubernetes.io/projected/f21200fc-afd3-4052-be02-7f9e82536707-kube-api-access-zn9nz\") pod \"f21200fc-afd3-4052-be02-7f9e82536707\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") "
Jul 21 16:12:55.690524 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.690422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21200fc-afd3-4052-be02-7f9e82536707-openshift-service-ca\") pod \"f21200fc-afd3-4052-be02-7f9e82536707\" (UID: \"f21200fc-afd3-4052-be02-7f9e82536707\") "
Jul 21 16:12:55.690786 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.690757    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f21200fc-afd3-4052-be02-7f9e82536707-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f21200fc-afd3-4052-be02-7f9e82536707" (UID: "f21200fc-afd3-4052-be02-7f9e82536707"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:12:55.692526 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.692499    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f21200fc-afd3-4052-be02-7f9e82536707-kube-api-access-zn9nz" (OuterVolumeSpecName: "kube-api-access-zn9nz") pod "f21200fc-afd3-4052-be02-7f9e82536707" (UID: "f21200fc-afd3-4052-be02-7f9e82536707"). InnerVolumeSpecName "kube-api-access-zn9nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:12:55.692628 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.692508    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f21200fc-afd3-4052-be02-7f9e82536707" (UID: "f21200fc-afd3-4052-be02-7f9e82536707"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:12:55.791345 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.791324    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f21200fc-afd3-4052-be02-7f9e82536707-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:12:55.791345 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.791345    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f21200fc-afd3-4052-be02-7f9e82536707-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:12:55.791473 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:55.791356    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn9nz\" (UniqueName: \"kubernetes.io/projected/f21200fc-afd3-4052-be02-7f9e82536707-kube-api-access-zn9nz\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:12:56.047289 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.047209    2562 generic.go:356] "Generic (PLEG): container finished" podID="f21200fc-afd3-4052-be02-7f9e82536707" containerID="75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c" exitCode=0
Jul 21 16:12:56.047289 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.047275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54" event={"ID":"f21200fc-afd3-4052-be02-7f9e82536707","Type":"ContainerDied","Data":"75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c"}
Jul 21 16:12:56.047289 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.047284    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"
Jul 21 16:12:56.047476 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.047359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54" event={"ID":"f21200fc-afd3-4052-be02-7f9e82536707","Type":"ContainerDied","Data":"668de1c151757f064a17c5bae68d35970934e0d01fb4f377fe95bd9ffe50e6ed"}
Jul 21 16:12:56.047476 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.047391    2562 scope.go:117] "RemoveContainer" containerID="75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c"
Jul 21 16:12:56.056557 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.056542    2562 scope.go:117] "RemoveContainer" containerID="75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c"
Jul 21 16:12:56.056842 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:12:56.056820    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c\": container with ID starting with 75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c not found: ID does not exist" containerID="75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c"
Jul 21 16:12:56.056891 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.056853    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c"} err="failed to get container status \"75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c\": rpc error: code = NotFound desc = could not find container \"75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c\": container with ID starting with 75844898070f0fb0a8412688fab35d3c9e25f7793e384f2004fc1290b2dfdb6c not found: ID does not exist"
Jul 21 16:12:56.068366 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.068345    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"]
Jul 21 16:12:56.071858 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:56.071837    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-40a33d-64775cf494-6wx54"]
Jul 21 16:12:57.298391 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:12:57.298357    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f21200fc-afd3-4052-be02-7f9e82536707" path="/var/lib/kubelet/pods/f21200fc-afd3-4052-be02-7f9e82536707/volumes"
Jul 21 16:14:09.615388 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:14:09.615364    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:14:09.631130 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:14:09.631109    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:16:02.179504 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.179465    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"]
Jul 21 16:16:02.180087 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.179739    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26" podUID="fb762995-99c8-4b2c-85cc-8b792634c10a" containerName="maas-api" containerID="cri-o://ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332" gracePeriod=30
Jul 21 16:16:02.430080 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.430028    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:16:02.513106 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.513072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb762995-99c8-4b2c-85cc-8b792634c10a-maas-api-tls\") pod \"fb762995-99c8-4b2c-85cc-8b792634c10a\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") "
Jul 21 16:16:02.513106 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.513112    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c4sc\" (UniqueName: \"kubernetes.io/projected/fb762995-99c8-4b2c-85cc-8b792634c10a-kube-api-access-5c4sc\") pod \"fb762995-99c8-4b2c-85cc-8b792634c10a\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") "
Jul 21 16:16:02.513369 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.513161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb762995-99c8-4b2c-85cc-8b792634c10a-openshift-service-ca\") pod \"fb762995-99c8-4b2c-85cc-8b792634c10a\" (UID: \"fb762995-99c8-4b2c-85cc-8b792634c10a\") "
Jul 21 16:16:02.513566 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.513539    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb762995-99c8-4b2c-85cc-8b792634c10a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb762995-99c8-4b2c-85cc-8b792634c10a" (UID: "fb762995-99c8-4b2c-85cc-8b792634c10a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:16:02.515361 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.515339    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb762995-99c8-4b2c-85cc-8b792634c10a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb762995-99c8-4b2c-85cc-8b792634c10a" (UID: "fb762995-99c8-4b2c-85cc-8b792634c10a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:16:02.515480 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.515380    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb762995-99c8-4b2c-85cc-8b792634c10a-kube-api-access-5c4sc" (OuterVolumeSpecName: "kube-api-access-5c4sc") pod "fb762995-99c8-4b2c-85cc-8b792634c10a" (UID: "fb762995-99c8-4b2c-85cc-8b792634c10a"). InnerVolumeSpecName "kube-api-access-5c4sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:16:02.614693 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.614645    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c4sc\" (UniqueName: \"kubernetes.io/projected/fb762995-99c8-4b2c-85cc-8b792634c10a-kube-api-access-5c4sc\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:16:02.614693 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.614694    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb762995-99c8-4b2c-85cc-8b792634c10a-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:16:02.614865 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.614708    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb762995-99c8-4b2c-85cc-8b792634c10a-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:16:02.910469 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.910438    2562 generic.go:356] "Generic (PLEG): container finished" podID="fb762995-99c8-4b2c-85cc-8b792634c10a" containerID="ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332" exitCode=0
Jul 21 16:16:02.910648 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.910492    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"
Jul 21 16:16:02.910648 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.910501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26" event={"ID":"fb762995-99c8-4b2c-85cc-8b792634c10a","Type":"ContainerDied","Data":"ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332"}
Jul 21 16:16:02.910648 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.910563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26" event={"ID":"fb762995-99c8-4b2c-85cc-8b792634c10a","Type":"ContainerDied","Data":"c48fbebb57ce0a2c767f9b75325bb5789d849a3ad11b8b8cd63c12142c2dd015"}
Jul 21 16:16:02.910648 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.910584    2562 scope.go:117] "RemoveContainer" containerID="ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332"
Jul 21 16:16:02.920188 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.920172    2562 scope.go:117] "RemoveContainer" containerID="ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332"
Jul 21 16:16:02.920443 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:16:02.920423    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332\": container with ID starting with ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332 not found: ID does not exist" containerID="ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332"
Jul 21 16:16:02.920494 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.920450    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332"} err="failed to get container status \"ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332\": rpc error: code = NotFound desc = could not find container \"ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332\": container with ID starting with ccabf2cace123c11d9f93b7c98a83767f589106f21b1da69425c6e916332a332 not found: ID does not exist"
Jul 21 16:16:02.931527 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.931495    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"]
Jul 21 16:16:02.935266 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:02.935246    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb94bd-c95f9865-8gs26"]
Jul 21 16:16:03.299432 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:16:03.299359    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb762995-99c8-4b2c-85cc-8b792634c10a" path="/var/lib/kubelet/pods/fb762995-99c8-4b2c-85cc-8b792634c10a/volumes"
Jul 21 16:19:02.058824 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.058786    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"]
Jul 21 16:19:02.059314 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.059142    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21200fc-afd3-4052-be02-7f9e82536707" containerName="maas-api"
Jul 21 16:19:02.059314 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.059153    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21200fc-afd3-4052-be02-7f9e82536707" containerName="maas-api"
Jul 21 16:19:02.059314 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.059160    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb762995-99c8-4b2c-85cc-8b792634c10a" containerName="maas-api"
Jul 21 16:19:02.059314 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.059166    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb762995-99c8-4b2c-85cc-8b792634c10a" containerName="maas-api"
Jul 21 16:19:02.059314 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.059221    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb762995-99c8-4b2c-85cc-8b792634c10a" containerName="maas-api"
Jul 21 16:19:02.059314 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.059228    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f21200fc-afd3-4052-be02-7f9e82536707" containerName="maas-api"
Jul 21 16:19:02.062378 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.062358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.064878 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.064854    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-524b80-serving-cert\""
Jul 21 16:19:02.073476 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.073454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"]
Jul 21 16:19:02.163395 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.163367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wqpm\" (UniqueName: \"kubernetes.io/projected/40504383-a8c7-4eae-bcc3-4c3d75252249-kube-api-access-8wqpm\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.163511 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.163400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.163511 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.163420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40504383-a8c7-4eae-bcc3-4c3d75252249-openshift-service-ca\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.264677 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.264626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqpm\" (UniqueName: \"kubernetes.io/projected/40504383-a8c7-4eae-bcc3-4c3d75252249-kube-api-access-8wqpm\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.264776 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.264684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.264776 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.264713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40504383-a8c7-4eae-bcc3-4c3d75252249-openshift-service-ca\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.264864 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:19:02.264789    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-serving-cert: secret "maas-api-e2e-shared-a-524b80-serving-cert" not found
Jul 21 16:19:02.264902 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:19:02.264864    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls podName:40504383-a8c7-4eae-bcc3-4c3d75252249 nodeName:}" failed. No retries permitted until 2026-07-21 16:19:02.76484398 +0000 UTC m=+4793.908756948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls") pod "maas-api-e2e-shared-a-524b80-57f5467955-rk95c" (UID: "40504383-a8c7-4eae-bcc3-4c3d75252249") : secret "maas-api-e2e-shared-a-524b80-serving-cert" not found
Jul 21 16:19:02.265303 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.265284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40504383-a8c7-4eae-bcc3-4c3d75252249-openshift-service-ca\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.273921 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.273901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqpm\" (UniqueName: \"kubernetes.io/projected/40504383-a8c7-4eae-bcc3-4c3d75252249-kube-api-access-8wqpm\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.770713 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.770647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.773196 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.773173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls\") pod \"maas-api-e2e-shared-a-524b80-57f5467955-rk95c\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:02.974835 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:02.974811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:03.121548 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:03.121522    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"]
Jul 21 16:19:03.125021 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:19:03.124995    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40504383_a8c7_4eae_bcc3_4c3d75252249.slice/crio-14ae91426b4327752c8c746a84c434903690d96e48f5a8612dcc1cbce3d18a81 WatchSource:0}: Error finding container 14ae91426b4327752c8c746a84c434903690d96e48f5a8612dcc1cbce3d18a81: Status 404 returned error can't find the container with id 14ae91426b4327752c8c746a84c434903690d96e48f5a8612dcc1cbce3d18a81
Jul 21 16:19:03.126906 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:03.126888    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:19:03.751084 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:03.751043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c" event={"ID":"40504383-a8c7-4eae-bcc3-4c3d75252249","Type":"ContainerStarted","Data":"9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915"}
Jul 21 16:19:03.751267 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:03.751103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c" event={"ID":"40504383-a8c7-4eae-bcc3-4c3d75252249","Type":"ContainerStarted","Data":"14ae91426b4327752c8c746a84c434903690d96e48f5a8612dcc1cbce3d18a81"}
Jul 21 16:19:03.751267 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:03.751123    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:03.770541 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:03.770492    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c" podStartSLOduration=1.3239988280000001 podStartE2EDuration="1.7704746s" totalImagesPullingTime="446.475772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:19:03.768838012 +0000 UTC m=+4794.912750982" watchObservedRunningTime="2026-07-21 16:19:03.7704746 +0000 UTC m=+4794.914387570"
Jul 21 16:19:09.644004 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:09.643907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:19:09.661840 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:09.661809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:19:09.761602 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:09.761574    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:19:10.159871 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.159840    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"]
Jul 21 16:19:10.163276 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.163255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.166188 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.166160    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bbeb7d-serving-cert\""
Jul 21 16:19:10.180761 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.180724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"]
Jul 21 16:19:10.231772 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.231740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b6ca1f-f6ed-4bde-956a-672767589000-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.231952 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.231789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv8hw\" (UniqueName: \"kubernetes.io/projected/b4b6ca1f-f6ed-4bde-956a-672767589000-kube-api-access-bv8hw\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.231952 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.231855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.332913 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.332872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b6ca1f-f6ed-4bde-956a-672767589000-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.333104 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.332926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv8hw\" (UniqueName: \"kubernetes.io/projected/b4b6ca1f-f6ed-4bde-956a-672767589000-kube-api-access-bv8hw\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.333104 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.332968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.333231 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:19:10.333141    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-serving-cert: secret "maas-api-e2e-shared-b-bbeb7d-serving-cert" not found
Jul 21 16:19:10.333231 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:19:10.333217    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls podName:b4b6ca1f-f6ed-4bde-956a-672767589000 nodeName:}" failed. No retries permitted until 2026-07-21 16:19:10.833196102 +0000 UTC m=+4801.977109065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls") pod "maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" (UID: "b4b6ca1f-f6ed-4bde-956a-672767589000") : secret "maas-api-e2e-shared-b-bbeb7d-serving-cert" not found
Jul 21 16:19:10.333506 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.333475    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b6ca1f-f6ed-4bde-956a-672767589000-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.353404 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.353371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv8hw\" (UniqueName: \"kubernetes.io/projected/b4b6ca1f-f6ed-4bde-956a-672767589000-kube-api-access-bv8hw\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.837300 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.837272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:10.839810 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:10.839791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls\") pod \"maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:11.074275 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:11.074240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:11.216451 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:11.216420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"]
Jul 21 16:19:11.219146 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:19:11.219121    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b6ca1f_f6ed_4bde_956a_672767589000.slice/crio-b67ce7bde13a4bfa4e14054bc96fbe76e083719e2e9399a608020d1760929b33 WatchSource:0}: Error finding container b67ce7bde13a4bfa4e14054bc96fbe76e083719e2e9399a608020d1760929b33: Status 404 returned error can't find the container with id b67ce7bde13a4bfa4e14054bc96fbe76e083719e2e9399a608020d1760929b33
Jul 21 16:19:11.788181 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:11.788144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" event={"ID":"b4b6ca1f-f6ed-4bde-956a-672767589000","Type":"ContainerStarted","Data":"46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991"}
Jul 21 16:19:11.788382 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:11.788208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" event={"ID":"b4b6ca1f-f6ed-4bde-956a-672767589000","Type":"ContainerStarted","Data":"b67ce7bde13a4bfa4e14054bc96fbe76e083719e2e9399a608020d1760929b33"}
Jul 21 16:19:11.788382 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:11.788343    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:19:11.804963 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:11.804882    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" podStartSLOduration=1.481569134 podStartE2EDuration="1.804868901s" totalImagesPullingTime="323.299767ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:19:11.803203877 +0000 UTC m=+4802.947116849" watchObservedRunningTime="2026-07-21 16:19:11.804868901 +0000 UTC m=+4802.948781871"
Jul 21 16:19:17.797892 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:19:17.797861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:20:11.746152 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.746111    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"]
Jul 21 16:20:11.749854 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.749832    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.753432 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.753401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bbeb7d\"/\"auth-test-model-bbeb7d-kserve-self-signed-certs\""
Jul 21 16:20:11.753432 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.753410    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bbeb7d\"/\"default-dockercfg-cgc2t\""
Jul 21 16:20:11.753647 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.753459    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bbeb7d\"/\"kube-root-ca.crt\""
Jul 21 16:20:11.753647 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.753415    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bbeb7d\"/\"openshift-service-ca.crt\""
Jul 21 16:20:11.761270 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.761248    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"]
Jul 21 16:20:11.836330 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.836309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tmp-dir\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.836445 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.836342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-home\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.836445 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.836363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-dshm\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.836445 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.836430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqr2z\" (UniqueName: \"kubernetes.io/projected/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-kube-api-access-lqr2z\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.836552 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.836476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-model-cache\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.836552 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.836496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tls-certs\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.936997 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.936959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqr2z\" (UniqueName: \"kubernetes.io/projected/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-kube-api-access-lqr2z\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937102 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937021    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-model-cache\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937102 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tls-certs\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937102 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tmp-dir\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937209 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-home\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937209 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-dshm\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937488 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-model-cache\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937538 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tmp-dir\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.937572 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.937557    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-home\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.939568 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.939545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-dshm\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.939878 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.939859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tls-certs\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:11.954909 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:11.954881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqr2z\" (UniqueName: \"kubernetes.io/projected/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-kube-api-access-lqr2z\") pod \"auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") " pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:12.059891 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:12.059826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:12.194457 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:12.194435    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"]
Jul 21 16:20:12.196880 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:20:12.196852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2f327b2_fd48_42e3_8c0e_83d552eeddcf.slice/crio-872fbb5640ebabde5eaf8b96462b825ee3e15cb7a42c34e7290904c60b679c91 WatchSource:0}: Error finding container 872fbb5640ebabde5eaf8b96462b825ee3e15cb7a42c34e7290904c60b679c91: Status 404 returned error can't find the container with id 872fbb5640ebabde5eaf8b96462b825ee3e15cb7a42c34e7290904c60b679c91
Jul 21 16:20:13.086896 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:13.086863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r" event={"ID":"f2f327b2-fd48-42e3-8c0e-83d552eeddcf","Type":"ContainerStarted","Data":"9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7"}
Jul 21 16:20:13.086896 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:13.086902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r" event={"ID":"f2f327b2-fd48-42e3-8c0e-83d552eeddcf","Type":"ContainerStarted","Data":"872fbb5640ebabde5eaf8b96462b825ee3e15cb7a42c34e7290904c60b679c91"}
Jul 21 16:20:13.108219 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:13.108167    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r" podStartSLOduration=2.108151579 podStartE2EDuration="2.108151579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:20:13.10595325 +0000 UTC m=+4864.249866220" watchObservedRunningTime="2026-07-21 16:20:13.108151579 +0000 UTC m=+4864.252064550"
Jul 21 16:20:22.060893 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:22.060855    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:22.061318 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:22.060910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:22.073240 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:22.073215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:22.141869 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:22.141844    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:20:56.605406 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:20:56.605366    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"]
Jul 21 16:21:07.256047 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.256012    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"]
Jul 21 16:21:07.256523 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.256286    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c" podUID="40504383-a8c7-4eae-bcc3-4c3d75252249" containerName="maas-api" containerID="cri-o://9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915" gracePeriod=30
Jul 21 16:21:07.511175 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.511117    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:21:07.591105 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.591076    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40504383-a8c7-4eae-bcc3-4c3d75252249-openshift-service-ca\") pod \"40504383-a8c7-4eae-bcc3-4c3d75252249\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") "
Jul 21 16:21:07.591222 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.591153    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wqpm\" (UniqueName: \"kubernetes.io/projected/40504383-a8c7-4eae-bcc3-4c3d75252249-kube-api-access-8wqpm\") pod \"40504383-a8c7-4eae-bcc3-4c3d75252249\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") "
Jul 21 16:21:07.591222 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.591198    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls\") pod \"40504383-a8c7-4eae-bcc3-4c3d75252249\" (UID: \"40504383-a8c7-4eae-bcc3-4c3d75252249\") "
Jul 21 16:21:07.591386 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.591360    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40504383-a8c7-4eae-bcc3-4c3d75252249-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "40504383-a8c7-4eae-bcc3-4c3d75252249" (UID: "40504383-a8c7-4eae-bcc3-4c3d75252249"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:21:07.591465 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.591449    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40504383-a8c7-4eae-bcc3-4c3d75252249-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:07.593391 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.593372    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "40504383-a8c7-4eae-bcc3-4c3d75252249" (UID: "40504383-a8c7-4eae-bcc3-4c3d75252249"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:21:07.593513 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.593493    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40504383-a8c7-4eae-bcc3-4c3d75252249-kube-api-access-8wqpm" (OuterVolumeSpecName: "kube-api-access-8wqpm") pod "40504383-a8c7-4eae-bcc3-4c3d75252249" (UID: "40504383-a8c7-4eae-bcc3-4c3d75252249"). InnerVolumeSpecName "kube-api-access-8wqpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:21:07.692344 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.692317    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wqpm\" (UniqueName: \"kubernetes.io/projected/40504383-a8c7-4eae-bcc3-4c3d75252249-kube-api-access-8wqpm\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:07.692344 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:07.692339    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40504383-a8c7-4eae-bcc3-4c3d75252249-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:08.349150 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.349117    2562 generic.go:356] "Generic (PLEG): container finished" podID="40504383-a8c7-4eae-bcc3-4c3d75252249" containerID="9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915" exitCode=0
Jul 21 16:21:08.349583 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.349167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c" event={"ID":"40504383-a8c7-4eae-bcc3-4c3d75252249","Type":"ContainerDied","Data":"9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915"}
Jul 21 16:21:08.349583 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.349204    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"
Jul 21 16:21:08.349583 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.349226    2562 scope.go:117] "RemoveContainer" containerID="9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915"
Jul 21 16:21:08.349583 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.349213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c" event={"ID":"40504383-a8c7-4eae-bcc3-4c3d75252249","Type":"ContainerDied","Data":"14ae91426b4327752c8c746a84c434903690d96e48f5a8612dcc1cbce3d18a81"}
Jul 21 16:21:08.359819 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.359795    2562 scope.go:117] "RemoveContainer" containerID="9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915"
Jul 21 16:21:08.360155 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:21:08.360128    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915\": container with ID starting with 9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915 not found: ID does not exist" containerID="9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915"
Jul 21 16:21:08.360222 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.360165    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915"} err="failed to get container status \"9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915\": rpc error: code = NotFound desc = could not find container \"9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915\": container with ID starting with 9558d6e561486edc0d746987d993841d1e916b75ac8a36ba72656cfbca372915 not found: ID does not exist"
Jul 21 16:21:08.373331 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.373294    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"]
Jul 21 16:21:08.375485 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:08.375459    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-524b80-57f5467955-rk95c"]
Jul 21 16:21:09.299783 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:09.299753    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40504383-a8c7-4eae-bcc3-4c3d75252249" path="/var/lib/kubelet/pods/40504383-a8c7-4eae-bcc3-4c3d75252249/volumes"
Jul 21 16:21:11.625192 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.625148    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r" podUID="f2f327b2-fd48-42e3-8c0e-83d552eeddcf" containerName="main" containerID="cri-o://9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7" gracePeriod=45
Jul 21 16:21:11.871647 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.871624    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:21:11.925804 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.925744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tls-certs\") pod \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") "
Jul 21 16:21:11.925804 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.925775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-dshm\") pod \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") "
Jul 21 16:21:11.925804 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.925802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-model-cache\") pod \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") "
Jul 21 16:21:11.926071 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.925823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqr2z\" (UniqueName: \"kubernetes.io/projected/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-kube-api-access-lqr2z\") pod \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") "
Jul 21 16:21:11.926071 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.925840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-home\") pod \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") "
Jul 21 16:21:11.926071 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.925894    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tmp-dir\") pod \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\" (UID: \"f2f327b2-fd48-42e3-8c0e-83d552eeddcf\") "
Jul 21 16:21:11.926233 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.926080    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-model-cache" (OuterVolumeSpecName: "model-cache") pod "f2f327b2-fd48-42e3-8c0e-83d552eeddcf" (UID: "f2f327b2-fd48-42e3-8c0e-83d552eeddcf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:21:11.926341 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.926295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f2f327b2-fd48-42e3-8c0e-83d552eeddcf" (UID: "f2f327b2-fd48-42e3-8c0e-83d552eeddcf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:21:11.926341 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.926307    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-home" (OuterVolumeSpecName: "home") pod "f2f327b2-fd48-42e3-8c0e-83d552eeddcf" (UID: "f2f327b2-fd48-42e3-8c0e-83d552eeddcf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:21:11.928088 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.928060    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-dshm" (OuterVolumeSpecName: "dshm") pod "f2f327b2-fd48-42e3-8c0e-83d552eeddcf" (UID: "f2f327b2-fd48-42e3-8c0e-83d552eeddcf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:21:11.928435 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.928415    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2f327b2-fd48-42e3-8c0e-83d552eeddcf" (UID: "f2f327b2-fd48-42e3-8c0e-83d552eeddcf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:21:11.928513 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:11.928468    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-kube-api-access-lqr2z" (OuterVolumeSpecName: "kube-api-access-lqr2z") pod "f2f327b2-fd48-42e3-8c0e-83d552eeddcf" (UID: "f2f327b2-fd48-42e3-8c0e-83d552eeddcf"). InnerVolumeSpecName "kube-api-access-lqr2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:21:12.027381 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.027354    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tmp-dir\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:12.027381 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.027381    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-tls-certs\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:12.027514 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.027393    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-dshm\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:12.027514 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.027402    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-model-cache\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:12.027514 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.027411    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqr2z\" (UniqueName: \"kubernetes.io/projected/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-kube-api-access-lqr2z\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:12.027514 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.027419    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f327b2-fd48-42e3-8c0e-83d552eeddcf-home\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:21:12.370279 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.370248    2562 generic.go:356] "Generic (PLEG): container finished" podID="f2f327b2-fd48-42e3-8c0e-83d552eeddcf" containerID="9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7" exitCode=0
Jul 21 16:21:12.370484 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.370289    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r" event={"ID":"f2f327b2-fd48-42e3-8c0e-83d552eeddcf","Type":"ContainerDied","Data":"9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7"}
Jul 21 16:21:12.370484 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.370291    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"
Jul 21 16:21:12.370484 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.370327    2562 scope.go:117] "RemoveContainer" containerID="9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7"
Jul 21 16:21:12.370484 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.370317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r" event={"ID":"f2f327b2-fd48-42e3-8c0e-83d552eeddcf","Type":"ContainerDied","Data":"872fbb5640ebabde5eaf8b96462b825ee3e15cb7a42c34e7290904c60b679c91"}
Jul 21 16:21:12.379375 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.379352    2562 scope.go:117] "RemoveContainer" containerID="9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7"
Jul 21 16:21:12.379630 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:21:12.379611    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7\": container with ID starting with 9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7 not found: ID does not exist" containerID="9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7"
Jul 21 16:21:12.379707 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.379641    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7"} err="failed to get container status \"9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7\": rpc error: code = NotFound desc = could not find container \"9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7\": container with ID starting with 9137d7e26f89d019657732f344399d2704214acab459c8a77803734eb59adfa7 not found: ID does not exist"
Jul 21 16:21:12.398109 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.398085    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"]
Jul 21 16:21:12.399637 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:12.399619    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bbeb7d/auth-test-model-bbeb7d-kserve-7fb55b587f-npz4r"]
Jul 21 16:21:13.299051 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:21:13.299020    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f327b2-fd48-42e3-8c0e-83d552eeddcf" path="/var/lib/kubelet/pods/f2f327b2-fd48-42e3-8c0e-83d552eeddcf/volumes"
Jul 21 16:24:09.673971 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:09.673857    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:24:09.694015 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:09.693994    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:24:14.380583 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.380547    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"]
Jul 21 16:24:14.381102 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.380857    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" podUID="b4b6ca1f-f6ed-4bde-956a-672767589000" containerName="maas-api" containerID="cri-o://46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991" gracePeriod=30
Jul 21 16:24:14.629246 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.629224    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:24:14.729273 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.729205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls\") pod \"b4b6ca1f-f6ed-4bde-956a-672767589000\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") "
Jul 21 16:24:14.729412 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.729284    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b6ca1f-f6ed-4bde-956a-672767589000-openshift-service-ca\") pod \"b4b6ca1f-f6ed-4bde-956a-672767589000\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") "
Jul 21 16:24:14.729412 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.729333    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv8hw\" (UniqueName: \"kubernetes.io/projected/b4b6ca1f-f6ed-4bde-956a-672767589000-kube-api-access-bv8hw\") pod \"b4b6ca1f-f6ed-4bde-956a-672767589000\" (UID: \"b4b6ca1f-f6ed-4bde-956a-672767589000\") "
Jul 21 16:24:14.729637 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.729614    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4b6ca1f-f6ed-4bde-956a-672767589000-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4b6ca1f-f6ed-4bde-956a-672767589000" (UID: "b4b6ca1f-f6ed-4bde-956a-672767589000"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:24:14.731616 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.731586    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4b6ca1f-f6ed-4bde-956a-672767589000" (UID: "b4b6ca1f-f6ed-4bde-956a-672767589000"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:24:14.731735 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.731630    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b6ca1f-f6ed-4bde-956a-672767589000-kube-api-access-bv8hw" (OuterVolumeSpecName: "kube-api-access-bv8hw") pod "b4b6ca1f-f6ed-4bde-956a-672767589000" (UID: "b4b6ca1f-f6ed-4bde-956a-672767589000"). InnerVolumeSpecName "kube-api-access-bv8hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:24:14.830120 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.830090    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4b6ca1f-f6ed-4bde-956a-672767589000-openshift-service-ca\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:24:14.830120 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.830119    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv8hw\" (UniqueName: \"kubernetes.io/projected/b4b6ca1f-f6ed-4bde-956a-672767589000-kube-api-access-bv8hw\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:24:14.830307 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:14.830132    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4b6ca1f-f6ed-4bde-956a-672767589000-maas-api-tls\") on node \"ip-10-0-130-165.ec2.internal\" DevicePath \"\""
Jul 21 16:24:15.202795 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.202761    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4b6ca1f-f6ed-4bde-956a-672767589000" containerID="46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991" exitCode=0
Jul 21 16:24:15.203083 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.202811    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"
Jul 21 16:24:15.203083 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.202820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" event={"ID":"b4b6ca1f-f6ed-4bde-956a-672767589000","Type":"ContainerDied","Data":"46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991"}
Jul 21 16:24:15.203083 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.202860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87" event={"ID":"b4b6ca1f-f6ed-4bde-956a-672767589000","Type":"ContainerDied","Data":"b67ce7bde13a4bfa4e14054bc96fbe76e083719e2e9399a608020d1760929b33"}
Jul 21 16:24:15.203083 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.202881    2562 scope.go:117] "RemoveContainer" containerID="46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991"
Jul 21 16:24:15.212455 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.212438    2562 scope.go:117] "RemoveContainer" containerID="46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991"
Jul 21 16:24:15.212737 ip-10-0-130-165 kubenswrapper[2562]: E0721 16:24:15.212719    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991\": container with ID starting with 46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991 not found: ID does not exist" containerID="46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991"
Jul 21 16:24:15.212788 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.212748    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991"} err="failed to get container status \"46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991\": rpc error: code = NotFound desc = could not find container \"46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991\": container with ID starting with 46dc7b8bb27181c205caee6517530563be4b03d7c7435ac2bc9dc5046b05f991 not found: ID does not exist"
Jul 21 16:24:15.225206 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.225176    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"]
Jul 21 16:24:15.229331 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.229308    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bbeb7d-5f84c456cc-ncf87"]
Jul 21 16:24:15.298206 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:24:15.298177    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b6ca1f-f6ed-4bde-956a-672767589000" path="/var/lib/kubelet/pods/b4b6ca1f-f6ed-4bde-956a-672767589000/volumes"
Jul 21 16:27:11.183466 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:11.183426    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54694b5559-2rlg2_6a3e8c06-3260-4ab2-9c20-9097d175717d/authorino/0.log"
Jul 21 16:27:16.982185 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:16.982154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65db74b7cb-f2hlk_af67a338-ca0c-4031-bf3a-6ce43de0b634/manager/0.log"
Jul 21 16:27:17.577258 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:17.577219    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-xkqsn_38aebe51-4576-4674-b85a-30c2705dfc5f/manager/0.log"
Jul 21 16:27:17.583596 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:17.583569    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-xkqsn_38aebe51-4576-4674-b85a-30c2705dfc5f/copy-manifests/0.log"
Jul 21 16:27:17.954394 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:17.954365    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5df78cc578-lcmx8_16945e27-5a37-492e-a775-d8f31177c4d5/maas-api/0.log"
Jul 21 16:27:19.883215 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:19.883180    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tzz66_f310ab49-9476-42c2-a732-0f5a65d010ac/postgres/0.log"
Jul 21 16:27:20.682266 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:20.682241    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54694b5559-2rlg2_6a3e8c06-3260-4ab2-9c20-9097d175717d/authorino/0.log"
Jul 21 16:27:20.914871 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:20.914847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5546559d7-6q4tb_f5de869f-aab0-4333-a5a6-451b0b2c06b0/manager/0.log"
Jul 21 16:27:22.002719 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:22.002687    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db96775b-9h2tr_20232e27-cf2d-4f98-9673-49435b317214/kube-auth-proxy/0.log"
Jul 21 16:27:22.641026 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:22.640997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8tdl2_34240273-59ee-482a-a3c1-741f9878c40b/payload-pre-processing/0.log"
Jul 21 16:27:23.241908 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:23.241878    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-554k7_16b44575-5705-4210-8d25-2fa5e3533e08/payload-processing/0.log"
Jul 21 16:27:23.770118 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:23.770089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-jcdj8_3776d51b-d76d-4342-ac25-4e8168dc9c49/main/0.log"
Jul 21 16:27:24.231032 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:24.231005    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gvwnr_56d69e0c-fd7b-4078-9e31-7bf421be3014/main/0.log"
Jul 21 16:27:36.846968 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:36.846869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nmwvs_99807af6-909a-4ac3-bf97-3339c78bad27/global-pull-secret-syncer/0.log"
Jul 21 16:27:36.962120 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:36.962094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kjj7b_2c06eadb-07a0-4e0f-b44c-aaebb7fe4c9f/konnectivity-agent/0.log"
Jul 21 16:27:37.056475 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:37.056453    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-165.ec2.internal_1faa3d6ac6af8dc03734d559d6e87e75/haproxy/0.log"
Jul 21 16:27:41.815492 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:41.815462    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54694b5559-2rlg2_6a3e8c06-3260-4ab2-9c20-9097d175717d/authorino/0.log"
Jul 21 16:27:41.865788 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:41.865761    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5546559d7-6q4tb_f5de869f-aab0-4333-a5a6-451b0b2c06b0/manager/0.log"
Jul 21 16:27:43.922701 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:43.922653    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-6r5m5_31385bd2-0a97-4328-869b-ac5b9614c346/monitoring-plugin/0.log"
Jul 21 16:27:44.050335 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.050272    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6b4dk_62f1f18a-3573-4254-ad2f-baaa99a28101/node-exporter/0.log"
Jul 21 16:27:44.069008 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.068983    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6b4dk_62f1f18a-3573-4254-ad2f-baaa99a28101/kube-rbac-proxy/0.log"
Jul 21 16:27:44.088572 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.088549    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6b4dk_62f1f18a-3573-4254-ad2f-baaa99a28101/init-textfile/0.log"
Jul 21 16:27:44.285421 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.285402    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/prometheus/0.log"
Jul 21 16:27:44.304475 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.304419    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/config-reloader/0.log"
Jul 21 16:27:44.325552 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.325528    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/thanos-sidecar/0.log"
Jul 21 16:27:44.353124 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.353108    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/kube-rbac-proxy-web/0.log"
Jul 21 16:27:44.376132 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.376084    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/kube-rbac-proxy/0.log"
Jul 21 16:27:44.401793 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.401770    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/kube-rbac-proxy-thanos/0.log"
Jul 21 16:27:44.428431 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.428405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e1dfaca6-8d9a-4504-b1a3-f40eac75cecb/init-config-reloader/0.log"
Jul 21 16:27:44.472412 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.472389    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-h5987_35b10e3c-3fd2-4ad9-a8ac-909eec2fd229/prometheus-operator/0.log"
Jul 21 16:27:44.495372 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.495357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-h5987_35b10e3c-3fd2-4ad9-a8ac-909eec2fd229/kube-rbac-proxy/0.log"
Jul 21 16:27:44.520931 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:44.520908    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-wxvpj_c550e675-b322-43fe-8d82-d506581190a2/prometheus-operator-admission-webhook/0.log"
Jul 21 16:27:46.295003 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:46.294972    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dnc59_90e7113f-2cd9-4fb7-b632-e95c2dcc0e9c/networking-console-plugin/0.log"
Jul 21 16:27:46.911815 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:46.911787    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/1.log"
Jul 21 16:27:46.919884 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:46.919861    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nkk2n_967b8e42-1738-4a28-b2cd-fb4ff8e76eef/console-operator/2.log"
Jul 21 16:27:47.495040 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.495004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-x7c6s_10c11601-ffc9-4175-9c34-000b074d87a4/download-server/0.log"
Jul 21 16:27:47.533103 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533076    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"]
Jul 21 16:27:47.533410 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533399    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40504383-a8c7-4eae-bcc3-4c3d75252249" containerName="maas-api"
Jul 21 16:27:47.533455 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533413    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="40504383-a8c7-4eae-bcc3-4c3d75252249" containerName="maas-api"
Jul 21 16:27:47.533455 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533424    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b6ca1f-f6ed-4bde-956a-672767589000" containerName="maas-api"
Jul 21 16:27:47.533455 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533430    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b6ca1f-f6ed-4bde-956a-672767589000" containerName="maas-api"
Jul 21 16:27:47.533455 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533436    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f327b2-fd48-42e3-8c0e-83d552eeddcf" containerName="main"
Jul 21 16:27:47.533455 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533441    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f327b2-fd48-42e3-8c0e-83d552eeddcf" containerName="main"
Jul 21 16:27:47.533611 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533511    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f327b2-fd48-42e3-8c0e-83d552eeddcf" containerName="main"
Jul 21 16:27:47.533611 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533520    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b6ca1f-f6ed-4bde-956a-672767589000" containerName="maas-api"
Jul 21 16:27:47.533611 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.533533    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="40504383-a8c7-4eae-bcc3-4c3d75252249" containerName="maas-api"
Jul 21 16:27:47.537009 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.536989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.539577 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.539553    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5nz6r\"/\"default-dockercfg-zjl95\""
Jul 21 16:27:47.540512 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.540496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5nz6r\"/\"kube-root-ca.crt\""
Jul 21 16:27:47.540606 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.540545    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5nz6r\"/\"openshift-service-ca.crt\""
Jul 21 16:27:47.545715 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.545692    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"]
Jul 21 16:27:47.581816 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.581786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-lib-modules\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.581999 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.581822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-podres\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.581999 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.581886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jmqv\" (UniqueName: \"kubernetes.io/projected/cbab87db-a676-4c95-87bc-7f100d41747e-kube-api-access-4jmqv\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.581999 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.581918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-proc\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.581999 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.581978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-sys\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.682844 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.682815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-sys\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.682984 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.682869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-lib-modules\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.682984 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.682912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-podres\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.682984 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.682931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-sys\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.682984 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.682980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jmqv\" (UniqueName: \"kubernetes.io/projected/cbab87db-a676-4c95-87bc-7f100d41747e-kube-api-access-4jmqv\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.683143 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.683003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-proc\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.683143 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.683035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-podres\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.683143 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.683035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-lib-modules\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.683143 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.683087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbab87db-a676-4c95-87bc-7f100d41747e-proc\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.691468 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.691448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jmqv\" (UniqueName: \"kubernetes.io/projected/cbab87db-a676-4c95-87bc-7f100d41747e-kube-api-access-4jmqv\") pod \"perf-node-gather-daemonset-qg97p\" (UID: \"cbab87db-a676-4c95-87bc-7f100d41747e\") " pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.848078 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.848058    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:47.975269 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:47.975240    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"]
Jul 21 16:27:47.977131 ip-10-0-130-165 kubenswrapper[2562]: W0721 16:27:47.977102    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbab87db_a676_4c95_87bc_7f100d41747e.slice/crio-1baa6f8c9522fa0d94c63c2efa6e903c02cb615d8784272dbcdafac71c5f676d WatchSource:0}: Error finding container 1baa6f8c9522fa0d94c63c2efa6e903c02cb615d8784272dbcdafac71c5f676d: Status 404 returned error can't find the container with id 1baa6f8c9522fa0d94c63c2efa6e903c02cb615d8784272dbcdafac71c5f676d
Jul 21 16:27:48.177060 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:48.177005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p" event={"ID":"cbab87db-a676-4c95-87bc-7f100d41747e","Type":"ContainerStarted","Data":"2703127e430246c8b8ef73c10d98b1dea8f351fc47ef12596125432422292b6b"}
Jul 21 16:27:48.177060 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:48.177048    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p" event={"ID":"cbab87db-a676-4c95-87bc-7f100d41747e","Type":"ContainerStarted","Data":"1baa6f8c9522fa0d94c63c2efa6e903c02cb615d8784272dbcdafac71c5f676d"}
Jul 21 16:27:48.177213 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:48.177080    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:48.193534 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:48.193486    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p" podStartSLOduration=1.1934736 podStartE2EDuration="1.1934736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:48.191986129 +0000 UTC m=+5319.335899099" watchObservedRunningTime="2026-07-21 16:27:48.1934736 +0000 UTC m=+5319.337386569"
Jul 21 16:27:49.408264 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:49.408231    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q65w7_51c8e612-9d31-4a3f-a983-d7297aa3688f/dns/0.log"
Jul 21 16:27:49.429318 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:49.429293    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q65w7_51c8e612-9d31-4a3f-a983-d7297aa3688f/kube-rbac-proxy/0.log"
Jul 21 16:27:49.572791 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:49.572766    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9ddg_05bc38b3-36fc-4d42-9971-93a8eb9759a9/dns-node-resolver/0.log"
Jul 21 16:27:50.225673 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:50.225631    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8b46b_ff0624d0-aca7-4737-bc11-df19765067fd/node-ca/0.log"
Jul 21 16:27:51.434868 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:51.434836    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db96775b-9h2tr_20232e27-cf2d-4f98-9673-49435b317214/kube-auth-proxy/0.log"
Jul 21 16:27:51.529840 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:51.529821    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8tdl2_34240273-59ee-482a-a3c1-741f9878c40b/payload-pre-processing/0.log"
Jul 21 16:27:51.556218 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:51.556197    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-554k7_16b44575-5705-4210-8d25-2fa5e3533e08/payload-processing/0.log"
Jul 21 16:27:52.315478 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:52.315450    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q8j2_eb5d9a82-59a4-4b43-9d12-2302aa4ee640/serve-healthcheck-canary/0.log"
Jul 21 16:27:52.816765 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:52.816738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-kjtds_fc8ef140-2332-4448-8315-d526415f52ff/insights-operator/0.log"
Jul 21 16:27:52.818610 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:52.818586    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-kjtds_fc8ef140-2332-4448-8315-d526415f52ff/insights-operator/1.log"
Jul 21 16:27:52.991519 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:52.991491    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q77kl_f7e62b4d-5b73-400c-bd84-c5a3dc5cffba/kube-rbac-proxy/0.log"
Jul 21 16:27:53.016184 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:53.016158    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q77kl_f7e62b4d-5b73-400c-bd84-c5a3dc5cffba/exporter/0.log"
Jul 21 16:27:53.039899 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:53.039869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q77kl_f7e62b4d-5b73-400c-bd84-c5a3dc5cffba/extractor/0.log"
Jul 21 16:27:54.191763 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:54.191739    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5nz6r/perf-node-gather-daemonset-qg97p"
Jul 21 16:27:55.544138 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:55.544102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65db74b7cb-f2hlk_af67a338-ca0c-4031-bf3a-6ce43de0b634/manager/0.log"
Jul 21 16:27:55.901779 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:55.901747    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-xkqsn_38aebe51-4576-4674-b85a-30c2705dfc5f/manager/0.log"
Jul 21 16:27:55.918137 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:55.918116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b74964cc-xkqsn_38aebe51-4576-4674-b85a-30c2705dfc5f/copy-manifests/0.log"
Jul 21 16:27:57.400428 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:57.400409    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c4b7cdb88-k5px5_255c234e-6ad9-433d-9bfd-978f4fa1d478/manager/0.log"
Jul 21 16:27:57.425144 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:57.425115    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dqwpv_730a2754-f157-4793-a0bb-a207d5179c8b/openshift-lws-operator/0.log"
Jul 21 16:27:58.093759 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:58.093734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db96775b-9h2tr_20232e27-cf2d-4f98-9673-49435b317214/kube-auth-proxy/0.log"
Jul 21 16:27:58.163604 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:58.163582    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8tdl2_34240273-59ee-482a-a3c1-741f9878c40b/payload-pre-processing/0.log"
Jul 21 16:27:58.186064 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:58.186043    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-554k7_16b44575-5705-4210-8d25-2fa5e3533e08/payload-processing/0.log"
Jul 21 16:27:59.679284 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:59.679240    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7db96775b-9h2tr_20232e27-cf2d-4f98-9673-49435b317214/kube-auth-proxy/0.log"
Jul 21 16:27:59.753880 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:59.753857    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8tdl2_34240273-59ee-482a-a3c1-741f9878c40b/payload-pre-processing/0.log"
Jul 21 16:27:59.777347 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:27:59.777324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-554k7_16b44575-5705-4210-8d25-2fa5e3533e08/payload-processing/0.log"
Jul 21 16:28:04.277150 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.277109    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/kube-multus-additional-cni-plugins/0.log"
Jul 21 16:28:04.298650 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.298626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/egress-router-binary-copy/0.log"
Jul 21 16:28:04.318001 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.317980    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/cni-plugins/0.log"
Jul 21 16:28:04.337469 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.337446    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/bond-cni-plugin/0.log"
Jul 21 16:28:04.357703 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.357685    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/routeoverride-cni/0.log"
Jul 21 16:28:04.376878 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.376854    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/whereabouts-cni-bincopy/0.log"
Jul 21 16:28:04.398816 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.398796    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjtp6_039018e0-f1ad-4f11-aa6b-cb414d9c0c61/whereabouts-cni/0.log"
Jul 21 16:28:04.606235 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.606210    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kdjg5_f3528059-be51-4b52-a652-06d83081f9b0/kube-multus/0.log"
Jul 21 16:28:04.628177 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.628162    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wcwv_ea14e970-a7bf-4b81-9bb1-787e49dfe3b0/network-metrics-daemon/0.log"
Jul 21 16:28:04.644033 ip-10-0-130-165 kubenswrapper[2562]: I0721 16:28:04.644013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wcwv_ea14e970-a7bf-4b81-9bb1-787e49dfe3b0/kube-rbac-proxy/0.log"