Jul 22 21:03:37.876186 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 21:03:37.876198 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 21:03:37.876205 ip-10-0-137-63 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 21:03:37.876477 ip-10-0-137-63 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 21:03:48.125477 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 21:03:48.125492 ip-10-0-137-63 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3dd57682d4ac482aa18ced6e86a98087 --
Jul 22 21:05:23.088378 ip-10-0-137-63 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 21:05:23.537272 ip-10-0-137-63 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 21:05:23.537272 ip-10-0-137-63 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 21:05:23.537272 ip-10-0-137-63 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 21:05:23.537272 ip-10-0-137-63 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 21:05:23.537272 ip-10-0-137-63 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 21:05:23.540261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.540116    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 21:05:23.545836 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545816    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:23.545836 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545835    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545840    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545845    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545848    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545851    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545854    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545857    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545859    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545862    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545865    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545868    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545871    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545873    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545876    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545886    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545889    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545892    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545896    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545898    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:23.545918 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545900    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545903    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545905    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545908    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545910    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545913    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545917    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545921    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545925    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545928    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545931    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545933    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545937    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545941    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545944    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545947    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545950    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545953    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545955    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:23.546514 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545958    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545960    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545963    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545965    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545968    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545970    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545972    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545976    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545978    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545981    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545983    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545990    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545993    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545995    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.545998    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546001    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546004    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546006    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546009    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546011    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:23.547238 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546014    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546016    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546019    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546021    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546024    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546026    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546028    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546031    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546033    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546035    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546037    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546040    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546042    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546045    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546047    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546049    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546052    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546054    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546056    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546059    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:23.547792 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546061    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546063    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546078    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546081    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546083    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546087    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546089    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546094    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546096    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546099    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546101    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546104    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546107    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546109    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546112    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546114    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546116    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546119    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546122    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:23.548303 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.546124    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:23.549051 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549033    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:23.549051 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549051    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549055    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549059    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549062    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549065    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549090    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549093    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549096    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549098    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549101    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549104    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549107    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549109    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549112    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549114    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549117    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549120    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549122    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549124    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549127    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:23.549132 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549129    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549132    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549136    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549139    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549141    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549144    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549147    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549149    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549151    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549154    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549156    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549159    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549161    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549164    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549166    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549169    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549171    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549174    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549177    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:23.549626 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549181    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549183    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549186    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549188    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549191    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549194    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549199    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549203    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549206    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549209    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549212    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549215    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549217    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549220    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549222    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549225    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549228    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549231    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549234    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:23.550119 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549236    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549239    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549241    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549244    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549246    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549249    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549252    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549254    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549257    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549259    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549262    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549264    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549267    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549269    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549271    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549276    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549278    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549280    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549283    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549286    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:23.550597 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549288    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549292    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549295    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549298    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549301    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549304    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549306    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549309    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549312    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549315    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549318    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549321    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549323    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549326    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549328    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549331    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549333    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549336    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549338    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:23.551106 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549340    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549756    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549762    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549764    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549767    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549770    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549773    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549775    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549778    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549781    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549783    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549786    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549789    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549791    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549794    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549796    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549800    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549804    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549807    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:23.551574 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549810    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549812    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549816    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549819    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549822    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549824    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549827    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549829    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549831    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549834    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549836    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549839    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549841    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549846    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549848    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549850    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549853    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549855    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549857    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:23.552019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549860    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549862    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549865    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549867    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549869    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549872    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549874    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549877    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549879    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549881    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549884    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549886    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549889    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549892    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549894    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549897    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549900    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549903    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549905    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:23.552516 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549908    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549910    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549913    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549916    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549918    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549922    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549926    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549929    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549932    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549935    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549938    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549941    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549943    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549945    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549948    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549950    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549953    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549955    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549958    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549961    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:23.552986 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549963    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549967    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549970    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549973    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549976    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549980    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549982    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549985    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549988    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549990    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549993    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549995    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.549998    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550000    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550003    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550005    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550007    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550010    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550012    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550015    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:23.553503 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550017    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550019    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550111    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550119    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550126    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550131    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550135    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550138    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550142    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550147    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550150    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550153    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550157    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550161    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550164    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550167    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550170    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550173    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550176    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550179    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550183    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550186    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550189    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550192    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 21:05:23.554020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550196    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550199    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550202    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550205    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550208    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550211    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550213    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550216    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550219    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550222    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550226    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550229    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550232    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550235    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550238    2576 flags.go:64] FLAG: --enable-server="true"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550240    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550245    2576 flags.go:64] FLAG: --event-burst="100"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550248    2576 flags.go:64] FLAG: --event-qps="50"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550250    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550253    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550256    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550260    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550263    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550265    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550268    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 22 21:05:23.554617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550271    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550273    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550278    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550281    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550283    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550286    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550289    2576 flags.go:64] FLAG: --feature-gates=""
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550293    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550296    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550298    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550302    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550304    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550307    2576 flags.go:64] FLAG: --help="false"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550310    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550313    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550316    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550318    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550321    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550325    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550327    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550330    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550332    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550335    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 21:05:23.555227 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550338    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550341    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550344    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550347    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550349    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550352    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550355    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550358    2576 flags.go:64] FLAG: --lock-file=""
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550360    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550363    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550366    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550374    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550378    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550381    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550383    2576 flags.go:64] FLAG: --logging-format="text"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550386    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550389    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550392    2576 flags.go:64] FLAG: --manifest-url=""
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550394    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550398    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550401    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550405    2576 flags.go:64] FLAG: --max-pods="110"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550408    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550411    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550414    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 21:05:23.555820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550417    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550419    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550422    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550425    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550432    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550435    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550438    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550441    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550444    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550450    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550454    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550457    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550460    2576 flags.go:64] FLAG: --port="10250"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550463    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550466    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021fd689160a154ef"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550469    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550471    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550474    2576 flags.go:64] FLAG: --register-node="true"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550477    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550482    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550486    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550489    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550491    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550494    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550497    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 21:05:23.556428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550500    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550503    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550506    2576 flags.go:64] FLAG: --runonce="false"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550508    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550511    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550514    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550516    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550519    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550522    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550525    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550527    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550530    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550533    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550536    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550538    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550541    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550544    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550551    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550557    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550559    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550562    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550566    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550568    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550571    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550574    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 21:05:23.557032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550576    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550581    2576 flags.go:64] FLAG: --v="2"
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550584    2576 flags.go:64] FLAG: --version="false"
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550593    2576 flags.go:64] FLAG: --vmodule=""
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550597    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.550600    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550721    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550724    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550728    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550730    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550733    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550736    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550739    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550742    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550745    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550748    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550750    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550753    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550755    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550757    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550760    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:23.557709 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550762    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550765    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550767    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550771    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550773    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550776    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550778    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550780    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550783    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550785    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550788    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550790    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550794    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550797    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550799    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550802    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550805    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550807    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550810    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550812    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:23.558237 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550815    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550817    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550820    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550823    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550825    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550827    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550830    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550832    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550834    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550837    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550839    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550842    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550853    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550857    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550859    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550863    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550865    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550868    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550870    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550873    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:23.558724 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550875    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550877    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550880    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550884    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550889    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550892    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550894    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550897    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550900    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550903    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550905    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550908    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550910    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550912    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550917    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550920    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550922    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550925    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550928    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:23.559234 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550931    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550933    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550936    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550938    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550941    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550943    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550945    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550948    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550952    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550955    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550957    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550960    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550963    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550967    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550970    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550972    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550975    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550980    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550982    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550985    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:23.559692 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550987    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550990    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550993    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550995    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.550998    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.551754    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.560227    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.560245    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.560265    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.560271    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 21:05:23.560323 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560327    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560331    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560335    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560339    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560341    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560344    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560347    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560349    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560352    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560355    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560357    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560360    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560362    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560365    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560368    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560370    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560373    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560375    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560378    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560380    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:23.560576 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560383    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560385    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560388    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560391    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560393    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560395    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560398    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560400    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560403    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560406    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560409    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560411    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560413    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560416    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560419    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560422    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560424    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560426    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560429    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:23.561063 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560431    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560434    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560436    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560439    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560441    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560443    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560447    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560449    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560452    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560454    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560457    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560459    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560461    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560464    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560466    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560469    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560472    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560474    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560476    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:23.561527 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560479    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560481    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560484    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560486    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560489    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560493    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560497    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560500    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560504    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560508    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560510    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560513    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560515    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560518    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560521    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560523    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560526    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560528    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:23.561997 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560531    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560534    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560536    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560539    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560541    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560543    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560546    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560548    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560551    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560553    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560555    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560558    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560560    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560563    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560565    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560568    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560570    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560574    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560578    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560581    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:23.562440 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560584    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560587    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560590    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.560595    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560721    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560726    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560729    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560731    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560734    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560736    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560739    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560741    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560745    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560748    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 21:05:23.562935 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560750    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560755    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560758    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560761    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560763    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560766    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560768    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560771    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560773    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560776    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560778    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560781    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560783    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560785    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560788    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560790    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560793    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560795    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560798    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 21:05:23.563292 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560801    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560803    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560806    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560809    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560811    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560813    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560816    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560818    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560821    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560823    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560826    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560828    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560830    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560833    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560835    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560838    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560840    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560842    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560845    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560847    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 21:05:23.563820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560850    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560853    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560856    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560859    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560862    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560864    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560867    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560869    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560871    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560874    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560876    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560878    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560881    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560884    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560887    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560889    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560891    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560894    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560896    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 21:05:23.564396 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560898    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560901    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560903    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560905    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560907    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560910    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560912    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560915    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560917    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560919    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560922    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560924    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560926    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560929    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560931    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560934    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560936    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560938    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560941    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560943    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 21:05:23.564840 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560945    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560948    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560950    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560953    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560955    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560960    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560963    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560965    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560968    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560970    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:23.560972    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.560977    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.561118    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.563446    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 21:05:23.565347 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.565169    2576 server.go:1019] "Starting client certificate rotation"
Jul 22 21:05:23.565694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.565271    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 21:05:23.565694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.565304    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 21:05:23.568128 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.568112    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 21:05:23.572313 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.572299    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 21:05:23.583115 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.583086    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 22 21:05:23.585731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.585711    2576 log.go:25] "Validated CRI v1 image API"
Jul 22 21:05:23.587859 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.587838    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 21:05:23.590569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.590544    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae5fe493-e791-447a-8c66-a25ac6b28a9a:/dev/nvme0n1p4 fb899384-5886-4b8f-a1a1-ab178b3c9ddd:/dev/nvme0n1p3]
Jul 22 21:05:23.590683 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.590567    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 21:05:23.596899 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.596764    2576 manager.go:216] Machine: {Timestamp:2026-07-22 21:05:23.59436288 +0000 UTC m=+0.377264689 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098336 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec284ce601eeea85d0c49e91c728f2fc SystemUUID:ec284ce6-01ee-ea85-d0c4-9e91c728f2fc BootID:3dd57682-d4ac-482a-a18c-ed6e86a98087 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:64:b7:b3:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:64:b7:b3:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:02:e1:0e:b2:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 21:05:23.596899 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.596883    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 21:05:23.597063 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.597015    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 21:05:23.600988 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.600969    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 21:05:23.601108 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.601003    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 21:05:23.601246 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.601049    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 21:05:23.601982 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.601969    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 21:05:23.602036 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.601988    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 21:05:23.602036 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.601999    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 21:05:23.602036 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.602022    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 21:05:23.603906 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.603891    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 21:05:23.608486 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608470    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 21:05:23.608636 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608624    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 21:05:23.608693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608668    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 21:05:23.608693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608684    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 21:05:23.608804 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608700    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 21:05:23.608804 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608714    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 22 21:05:23.608804 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.608728    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 21:05:23.609201 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.609187    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 21:05:23.609279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.609211    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 21:05:23.611635 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.611617    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 21:05:23.614096 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.614059    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 21:05:23.614182 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.614116    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 21:05:23.615500 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615486    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615507    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615516    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615523    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615536    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615544    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615556    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615564    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 21:05:23.615577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615574    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 21:05:23.615807 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615582    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 21:05:23.615807 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615595    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 21:05:23.615807 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.615603    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 21:05:23.617403 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.617390    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 21:05:23.617459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.617406    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 21:05:23.619894 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.619872    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 21:05:23.620031 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.620011    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 21:05:23.620121 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.620087    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 21:05:23.620881 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.620863    2576 server.go:1268] "Started kubelet"
Jul 22 21:05:23.621837 ip-10-0-137-63 systemd[1]: Started Kubernetes Kubelet.
Jul 22 21:05:23.622042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.621979    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 21:05:23.622502 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.621926    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 21:05:23.622502 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.622429    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 21:05:23.624498 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.624483    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 21:05:23.624575 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.624523    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 21:05:23.627994 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.627975    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 21:05:23.633511 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.633489    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 21:05:23.633602 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.633495    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 21:05:23.633986 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.633961    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634350    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634366    2576 factory.go:55] Registering systemd factory
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634376    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634452    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634468    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634536    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634544    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634544    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634584    2576 factory.go:153] Registering CRI-O factory
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634596    2576 factory.go:223] Registration of the crio container factory successfully
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634619    2576 factory.go:103] Registering Raw factory
Jul 22 21:05:23.634808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.634633    2576 manager.go:1196] Started watching for new ooms in manager
Jul 22 21:05:23.635449 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.635336    2576 manager.go:349] Starting recovery of all containers
Jul 22 21:05:23.641489 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.641458    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 21:05:23.641653 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.641621    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 21:05:23.642682 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.641507    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c4b899eec32b5e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-22 21:05:23.620834142 +0000 UTC m=+0.403735955,LastTimestamp:2026-07-22 21:05:23.620834142 +0000 UTC m=+0.403735955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}"
Jul 22 21:05:23.643657 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.643631    2576 manager.go:354] Recovery completed
Jul 22 21:05:23.648633 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.648532    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.650721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.650705    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.650783 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.650739    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.650783 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.650750    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.651362 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.651346    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 21:05:23.651362 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.651362    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 21:05:23.651477 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.651368    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.651477 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.651380    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 21:05:23.653042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.653027    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.653106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.653055    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.653106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.653063    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.653384 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.653313    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c4b899f08b3423  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-22 21:05:23.650720803 +0000 UTC m=+0.433622614,LastTimestamp:2026-07-22 21:05:23.650720803 +0000 UTC m=+0.433622614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}"
Jul 22 21:05:23.653558 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.653545    2576 policy_none.go:49] "None policy: Start"
Jul 22 21:05:23.653608 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.653562    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 21:05:23.653608 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.653572    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 21:05:23.655569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.655558    2576 policy_none.go:47] "Start"
Jul 22 21:05:23.663450 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.663382    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c4b899f08b9031  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-63.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-22 21:05:23.650744369 +0000 UTC m=+0.433646178,LastTimestamp:2026-07-22 21:05:23.650744369 +0000 UTC m=+0.433646178,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}"
Jul 22 21:05:23.673604 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.673509    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c4b899f08bb48f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-63.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-22 21:05:23.650753679 +0000 UTC m=+0.433655488,LastTimestamp:2026-07-22 21:05:23.650753679 +0000 UTC m=+0.433655488,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}"
Jul 22 21:05:23.674514 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.673993    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5m5t2"
Jul 22 21:05:23.681285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.681269    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5m5t2"
Jul 22 21:05:23.687842 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.687783    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-63.ec2.internal.18c4b899f08b3423\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c4b899f08b3423  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-22 21:05:23.650720803 +0000 UTC m=+0.433622614,LastTimestamp:2026-07-22 21:05:23.653042316 +0000 UTC m=+0.435944126,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.688864    2576 manager.go:337] "Starting Device Plugin manager"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.688901    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.688915    2576 server.go:87] "Starting device plugin registration server"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.689166    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.689176    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.689284    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.689372    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.689380    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.689837    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 21:05:23.714231 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.689890    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:23.742753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.742676    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 21:05:23.744053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.744034    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 21:05:23.744163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.744083    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 21:05:23.744163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.744107    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 21:05:23.744163 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.744138    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 21:05:23.746359 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.746340    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:23.790323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.790289    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.791239 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.791219    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.791333 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.791250    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.791333 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.791261    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.791333 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.791283    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.799459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.799442    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.799557 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.799469    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-63.ec2.internal\": node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:23.822829 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.822804    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:23.845206 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.845177    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"]
Jul 22 21:05:23.845273 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.845241    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.846086 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.846051    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.846145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.846097    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.846145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.846111    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.848571 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.848560    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.848721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.848707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.848793 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.848737    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.849653 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.849637    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.849709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.849663    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.849709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.849673    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.849770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.849637    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.849770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.849748    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.849770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.849760    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.851976 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.851963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.852050 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.851987    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 21:05:23.852714 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.852701    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 21:05:23.852774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.852722    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 21:05:23.852774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:23.852736    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 22 21:05:23.871574 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.871555    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.875481 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.875461    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal"
Jul 22 21:05:23.923143 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:23.923119    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.023846 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.023782    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.036078 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.036050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7bfd2e96f7567a0d58475c9b87cbb79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"c7bfd2e96f7567a0d58475c9b87cbb79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.036138 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.036095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7bfd2e96f7567a0d58475c9b87cbb79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"c7bfd2e96f7567a0d58475c9b87cbb79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.036138 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.036116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e1e12e96403c8859930639c889248d4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"5e1e12e96403c8859930639c889248d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.124446 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.124415    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.136771 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.136745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7bfd2e96f7567a0d58475c9b87cbb79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"c7bfd2e96f7567a0d58475c9b87cbb79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.136854 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.136781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7bfd2e96f7567a0d58475c9b87cbb79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"c7bfd2e96f7567a0d58475c9b87cbb79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.136854 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.136806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e1e12e96403c8859930639c889248d4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"5e1e12e96403c8859930639c889248d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.136940 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.136855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c7bfd2e96f7567a0d58475c9b87cbb79-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"c7bfd2e96f7567a0d58475c9b87cbb79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.136940 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.136866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7bfd2e96f7567a0d58475c9b87cbb79-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"c7bfd2e96f7567a0d58475c9b87cbb79\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.136940 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.136857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e1e12e96403c8859930639c889248d4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"5e1e12e96403c8859930639c889248d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.174882 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.174858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.178017 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.178002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.225127 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.225104    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.325720 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.325645    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.426176 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.426135    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.526788 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.526757    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 22 21:05:24.564206 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.564178    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 21:05:24.564700 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.564357    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 21:05:24.604545 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.604485    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:24.609666 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.609647    2576 apiserver.go:52] "Watching apiserver"
Jul 22 21:05:24.612660 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.612644    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:24.617151 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.617133    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 21:05:24.617472 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.617450    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-7lzrc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk","openshift-dns/node-resolver-rk8w2","openshift-image-registry/node-ca-wng62","openshift-multus/multus-7446q","openshift-cluster-node-tuning-operator/tuned-9nlvs","openshift-multus/multus-additional-cni-plugins-xwmt5","openshift-multus/network-metrics-daemon-4nxf6","openshift-network-diagnostics/network-check-target-8h2b5","openshift-network-operator/iptables-alerter-kfhpg","openshift-ovn-kubernetes/ovnkube-node-27pfm","kube-system/global-pull-secret-syncer-vqjdz"]
Jul 22 21:05:24.620367 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.620346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.622857 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.622836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.623064 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.623041    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.623064 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.623042    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-45g5p\""
Jul 22 21:05:24.623064 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.623082    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 21:05:24.623276 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.623098    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.623276 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.623153    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 21:05:24.625218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.625198    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.625308 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.625236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8sblh\""
Jul 22 21:05:24.625308 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.625238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.625605 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.625591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.627777 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.627763    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l8mk4\""
Jul 22 21:05:24.627777 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.627772    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 21:05:24.628034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.628016    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 21:05:24.628336 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.628320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.630458 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.630442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgk9s\""
Jul 22 21:05:24.630539 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.630488    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 21:05:24.630539 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.630530    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 21:05:24.630871 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.630853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.633052 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.633038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mvvrt\""
Jul 22 21:05:24.633151 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.633137    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 21:05:24.633339 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.633323    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.633388 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.633373    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.633539 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.633526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.633613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.633600    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 21:05:24.634097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.634064    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.635521 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.635504    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.635693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.635674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pgrh7\""
Jul 22 21:05:24.635766 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.635732    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.636299 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.636286    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.638414 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.638398    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.638582 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.638568    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 21:05:24.638637 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.638583    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.638718 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.638704    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-srggh\""
Jul 22 21:05:24.639317 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6369a9b6-f821-4279-b5cb-6e705932b299-tmp-dir\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.639317 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:24.639467 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33091d94-1a6c-49c3-aeac-b99407eaf5ff-serviceca\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.639467 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-cnibin\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.639467 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-etc-selinux\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.639467 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.639380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:24.639467 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jz92\" (UniqueName: \"kubernetes.io/projected/33091d94-1a6c-49c3-aeac-b99407eaf5ff-kube-api-access-8jz92\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysctl-conf\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-os-release\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-multus-certs\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qzd2\" (UniqueName: \"kubernetes.io/projected/6369a9b6-f821-4279-b5cb-6e705932b299-kube-api-access-4qzd2\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbsll\" (UniqueName: \"kubernetes.io/projected/1f491988-38ed-4326-958b-ebd036164685-kube-api-access-kbsll\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-socket-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-device-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639665    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-modprobe-d\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.639710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52ae3d51-1c70-4159-a81f-278945a2cfc5-agent-certs\") pod \"konnectivity-agent-7lzrc\" (UID: \"52ae3d51-1c70-4159-a81f-278945a2cfc5\") " pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6369a9b6-f821-4279-b5cb-6e705932b299-hosts-file\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-k8s-cni-cncf-io\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-cni-bin\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysconfig\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-systemd\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-system-cni-dir\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhx64\" (UniqueName: \"kubernetes.io/projected/9c988042-9c0b-4ab1-af14-a4e22255c99e-kube-api-access-nhx64\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-socket-dir-parent\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-kubelet\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f491988-38ed-4326-958b-ebd036164685-multus-daemon-config\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-run\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-tmp\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.639996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-os-release\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f491988-38ed-4326-958b-ebd036164685-cni-binary-copy\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.640053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf9xf\" (UniqueName: \"kubernetes.io/projected/7a1c1608-2198-4b25-9098-0bdd58c5b265-kube-api-access-qf9xf\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-cni-multus\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-registration-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-kubernetes\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-sys\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-system-cni-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-conf-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-etc-kubernetes\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysctl-d\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-host\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52ae3d51-1c70-4159-a81f-278945a2cfc5-konnectivity-ca\") pod \"konnectivity-agent-7lzrc\" (UID: \"52ae3d51-1c70-4159-a81f-278945a2cfc5\") " pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-lib-modules\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-netns\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-hostroot\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33091d94-1a6c-49c3-aeac-b99407eaf5ff-host\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.641464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-cnibin\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.641964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.641964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-sys-fs\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.641964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-cni-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.641964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-var-lib-kubelet\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-tuned\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.641964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.640528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4j9\" (UniqueName: \"kubernetes.io/projected/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-kube-api-access-vj4j9\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.643466 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.643439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:24.643532 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.643505    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:24.647290 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.647133    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 21:05:24.648341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.648321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.650680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.650661    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 21:05:24.650770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.650702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.650770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.650719    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 21:05:24.650770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.650753    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 22 21:05:24.651200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.651185    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.651284 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.651230    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n7hh8\""
Jul 22 21:05:24.651284 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.651263    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.653047 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.653027    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"]
Jul 22 21:05:24.653153 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.653123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.653217 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.653181    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:24.653335 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.653317    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 21:05:24.653552 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.653533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 21:05:24.653712 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.653691    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kmw94\""
Jul 22 21:05:24.654233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.654158    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 21:05:24.654233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.654212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 21:05:24.654577 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.654562    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 21:05:24.654654 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.654565    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 21:05:24.661407 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.661390    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"]
Jul 22 21:05:24.661568 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.661557    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 21:05:24.675121 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.675101    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4946"
Jul 22 21:05:24.684224 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.684207    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v4946"
Jul 22 21:05:24.686593 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.686547    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 21:00:23 +0000 UTC" deadline="2028-01-16 14:25:29.434783065 +0000 UTC"
Jul 22 21:05:24.686685 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.686593    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13025h20m4.748194322s"
Jul 22 21:05:24.736335 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.736318    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 21:05:24.740845 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.740828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f491988-38ed-4326-958b-ebd036164685-cni-binary-copy\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.740899 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.740858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.740899 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.740879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf9xf\" (UniqueName: \"kubernetes.io/projected/7a1c1608-2198-4b25-9098-0bdd58c5b265-kube-api-access-qf9xf\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.740960 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.740896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:24.740960 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.740931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-var-lib-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.741022 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.740955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.741057 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-node-log\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.741108 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-run-ovn-kubernetes\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.741163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:24.741196 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-cni-multus\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741230 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-registration-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.741263 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.741263 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-systemd-units\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.741319 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-registration-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.741319 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-kubernetes\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.741319 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-cni-multus\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-sys\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.741434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-kubernetes\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.741434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovnkube-config\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.741434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-system-cni-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-sys\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.741434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-conf-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741738 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.741796 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f491988-38ed-4326-958b-ebd036164685-cni-binary-copy\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741850 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-system-cni-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741902 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-etc-kubernetes\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-conf-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.741946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysctl-d\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.741946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-host\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-host\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.741979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-etc-kubernetes\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52ae3d51-1c70-4159-a81f-278945a2cfc5-konnectivity-ca\") pod \"konnectivity-agent-7lzrc\" (UID: \"52ae3d51-1c70-4159-a81f-278945a2cfc5\") " pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.742097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysctl-d\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4b85b30-681a-4ef0-a982-cfad490eed20-iptables-alerter-script\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.742249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.742249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-lib-modules\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovn-node-metrics-cert\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.742249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovnkube-script-lib\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd82aa96-ead0-4184-a4fd-016a555d2d87-kubelet-config\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd82aa96-ead0-4184-a4fd-016a555d2d87-dbus\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-lib-modules\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-netns\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-hostroot\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33091d94-1a6c-49c3-aeac-b99407eaf5ff-host\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-netns\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-hostroot\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33091d94-1a6c-49c3-aeac-b99407eaf5ff-host\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5299\" (UniqueName: \"kubernetes.io/projected/3e5abe72-4167-40ef-a1de-c353e22e6ed4-kube-api-access-k5299\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:24.742460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-cnibin\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-sys-fs\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742544    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-sys-fs\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742499    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-cnibin\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52ae3d51-1c70-4159-a81f-278945a2cfc5-konnectivity-ca\") pod \"konnectivity-agent-7lzrc\" (UID: \"52ae3d51-1c70-4159-a81f-278945a2cfc5\") " pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-cni-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-cni-dir\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-var-lib-kubelet\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-tuned\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4j9\" (UniqueName: \"kubernetes.io/projected/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-kube-api-access-vj4j9\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6369a9b6-f821-4279-b5cb-6e705932b299-tmp-dir\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33091d94-1a6c-49c3-aeac-b99407eaf5ff-serviceca\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-var-lib-kubelet\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.742821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.742741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-cni-bin\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.743483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-cnibin\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.743483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743356    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 21:05:24.743483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-cnibin\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.743693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-etc-selinux\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.743693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jz92\" (UniqueName: \"kubernetes.io/projected/33091d94-1a6c-49c3-aeac-b99407eaf5ff-kube-api-access-8jz92\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.743693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysctl-conf\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.743693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.743693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.743957 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-kubelet\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.743957 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-log-socket\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.743957 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-os-release\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.743957 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-multus-certs\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.744202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-etc-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.744202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-cni-netd\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.744202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6369a9b6-f821-4279-b5cb-6e705932b299-tmp-dir\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.744202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-env-overrides\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.744202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.743888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-etc-selinux\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.744202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qzd2\" (UniqueName: \"kubernetes.io/projected/6369a9b6-f821-4279-b5cb-6e705932b299-kube-api-access-4qzd2\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.744479 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-os-release\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.744479 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744420    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-multus-certs\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.744578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4b85b30-681a-4ef0-a982-cfad490eed20-host-slash\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.744578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33091d94-1a6c-49c3-aeac-b99407eaf5ff-serviceca\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.744578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-ovn\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.744578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cmmn\" (UniqueName: \"kubernetes.io/projected/f29dd71b-4548-4c9b-a4d5-af413dfcf903-kube-api-access-7cmmn\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.744774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbsll\" (UniqueName: \"kubernetes.io/projected/1f491988-38ed-4326-958b-ebd036164685-kube-api-access-kbsll\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.744774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-socket-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.744774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-device-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.744774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-modprobe-d\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.744951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.744951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-socket-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.744951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52ae3d51-1c70-4159-a81f-278945a2cfc5-agent-certs\") pod \"konnectivity-agent-7lzrc\" (UID: \"52ae3d51-1c70-4159-a81f-278945a2cfc5\") " pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.744951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.744951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.744942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a1c1608-2198-4b25-9098-0bdd58c5b265-device-dir\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.745209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-modprobe-d\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.745209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-systemd\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.745209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6369a9b6-f821-4279-b5cb-6e705932b299-hosts-file\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.745356 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6369a9b6-f821-4279-b5cb-6e705932b299-hosts-file\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.745356 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-k8s-cni-cncf-io\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.745356 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9c988042-9c0b-4ab1-af14-a4e22255c99e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.745506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-cni-bin\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.745506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysconfig\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.745506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysctl-conf\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.745506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-systemd\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.745506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-system-cni-dir\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.745721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-sysconfig\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.745721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhx64\" (UniqueName: \"kubernetes.io/projected/9c988042-9c0b-4ab1-af14-a4e22255c99e-kube-api-access-nhx64\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.745721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-cni-bin\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.745721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-systemd\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.745951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-run-k8s-cni-cncf-io\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.745951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-socket-dir-parent\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.745951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-kubelet\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.745951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-system-cni-dir\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.745951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f491988-38ed-4326-958b-ebd036164685-multus-daemon-config\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.746203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbr6c\" (UniqueName: \"kubernetes.io/projected/b4b85b30-681a-4ef0-a982-cfad490eed20-kube-api-access-lbr6c\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.746203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.745985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-slash\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.746203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-run-netns\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.746203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-multus-socket-dir-parent\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.746203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f491988-38ed-4326-958b-ebd036164685-host-var-lib-kubelet\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.746435 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.746490 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-run\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.746546 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f491988-38ed-4326-958b-ebd036164685-multus-daemon-config\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.746546 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-tmp\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.746640 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-run\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.746640 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-os-release\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.747027 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-etc-tuned\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.747027 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.746870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c988042-9c0b-4ab1-af14-a4e22255c99e-os-release\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.748388 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.747773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52ae3d51-1c70-4159-a81f-278945a2cfc5-agent-certs\") pod \"konnectivity-agent-7lzrc\" (UID: \"52ae3d51-1c70-4159-a81f-278945a2cfc5\") " pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.748991 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.748964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-tmp\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.750996 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.750970    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf9xf\" (UniqueName: \"kubernetes.io/projected/7a1c1608-2198-4b25-9098-0bdd58c5b265-kube-api-access-qf9xf\") pod \"aws-ebs-csi-driver-node-lp7qk\" (UID: \"7a1c1608-2198-4b25-9098-0bdd58c5b265\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:24.751864 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.751843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4j9\" (UniqueName: \"kubernetes.io/projected/e89e7667-8bb2-4f80-9c27-06ddd435c2ee-kube-api-access-vj4j9\") pod \"tuned-9nlvs\" (UID: \"e89e7667-8bb2-4f80-9c27-06ddd435c2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.752187 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.752165    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jz92\" (UniqueName: \"kubernetes.io/projected/33091d94-1a6c-49c3-aeac-b99407eaf5ff-kube-api-access-8jz92\") pod \"node-ca-wng62\" (UID: \"33091d94-1a6c-49c3-aeac-b99407eaf5ff\") " pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:24.753325 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.753307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qzd2\" (UniqueName: \"kubernetes.io/projected/6369a9b6-f821-4279-b5cb-6e705932b299-kube-api-access-4qzd2\") pod \"node-resolver-rk8w2\" (UID: \"6369a9b6-f821-4279-b5cb-6e705932b299\") " pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:24.753580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.753561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbsll\" (UniqueName: \"kubernetes.io/projected/1f491988-38ed-4326-958b-ebd036164685-kube-api-access-kbsll\") pod \"multus-7446q\" (UID: \"1f491988-38ed-4326-958b-ebd036164685\") " pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.753762 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.753748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhx64\" (UniqueName: \"kubernetes.io/projected/9c988042-9c0b-4ab1-af14-a4e22255c99e-kube-api-access-nhx64\") pod \"multus-additional-cni-plugins-xwmt5\" (UID: \"9c988042-9c0b-4ab1-af14-a4e22255c99e\") " pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.774563 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:24.774535    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1e12e96403c8859930639c889248d4.slice/crio-9567b17e99755e522d707dc14469d3d3275b999f5618bf65de7c63bf931fad54 WatchSource:0}: Error finding container 9567b17e99755e522d707dc14469d3d3275b999f5618bf65de7c63bf931fad54: Status 404 returned error can't find the container with id 9567b17e99755e522d707dc14469d3d3275b999f5618bf65de7c63bf931fad54
Jul 22 21:05:24.774759 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:24.774745    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7bfd2e96f7567a0d58475c9b87cbb79.slice/crio-3710af02c190069dca01bbefd79aa7aeb2d25bd977df7d825e4a77c907b54acb WatchSource:0}: Error finding container 3710af02c190069dca01bbefd79aa7aeb2d25bd977df7d825e4a77c907b54acb: Status 404 returned error can't find the container with id 3710af02c190069dca01bbefd79aa7aeb2d25bd977df7d825e4a77c907b54acb
Jul 22 21:05:24.778790 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.778766    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:05:24.847704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-cni-bin\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-kubelet\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-log-socket\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-etc-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-cni-bin\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847795    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-etc-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-log-socket\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-kubelet\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-cni-netd\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-cni-netd\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.847894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-env-overrides\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4b85b30-681a-4ef0-a982-cfad490eed20-host-slash\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-ovn\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cmmn\" (UniqueName: \"kubernetes.io/projected/f29dd71b-4548-4c9b-a4d5-af413dfcf903-kube-api-access-7cmmn\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-systemd\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4b85b30-681a-4ef0-a982-cfad490eed20-host-slash\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-ovn\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.847988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbr6c\" (UniqueName: \"kubernetes.io/projected/b4b85b30-681a-4ef0-a982-cfad490eed20-kube-api-access-lbr6c\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-slash\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-systemd\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-run-netns\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-slash\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-run-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-run-netns\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-var-lib-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-var-lib-openvswitch\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-node-log\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-run-ovn-kubernetes\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-node-log\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-systemd-units\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovnkube-config\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.848323    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-run-ovn-kubernetes\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4b85b30-681a-4ef0-a982-cfad490eed20-iptables-alerter-script\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-systemd-units\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.848389    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:25.348367046 +0000 UTC m=+2.131268862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovn-node-metrics-cert\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f29dd71b-4548-4c9b-a4d5-af413dfcf903-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovnkube-script-lib\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-env-overrides\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.848947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd82aa96-ead0-4184-a4fd-016a555d2d87-kubelet-config\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd82aa96-ead0-4184-a4fd-016a555d2d87-dbus\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5299\" (UniqueName: \"kubernetes.io/projected/3e5abe72-4167-40ef-a1de-c353e22e6ed4-kube-api-access-k5299\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd82aa96-ead0-4184-a4fd-016a555d2d87-kubelet-config\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.848722    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.848777    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:25.348758325 +0000 UTC m=+2.131660136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd82aa96-ead0-4184-a4fd-016a555d2d87-dbus\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovnkube-config\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848950    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4b85b30-681a-4ef0-a982-cfad490eed20-iptables-alerter-script\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.849499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.848957    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovnkube-script-lib\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.850657 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.850641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f29dd71b-4548-4c9b-a4d5-af413dfcf903-ovn-node-metrics-cert\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.857856 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.857801    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:24.857856 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.857824    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:24.857856 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.857838    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:24.858014 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:24.857895    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:25.357880634 +0000 UTC m=+2.140782456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:24.859171 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.859148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5299\" (UniqueName: \"kubernetes.io/projected/3e5abe72-4167-40ef-a1de-c353e22e6ed4-kube-api-access-k5299\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:24.859912 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.859896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbr6c\" (UniqueName: \"kubernetes.io/projected/b4b85b30-681a-4ef0-a982-cfad490eed20-kube-api-access-lbr6c\") pod \"iptables-alerter-kfhpg\" (UID: \"b4b85b30-681a-4ef0-a982-cfad490eed20\") " pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:24.859977 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.859963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cmmn\" (UniqueName: \"kubernetes.io/projected/f29dd71b-4548-4c9b-a4d5-af413dfcf903-kube-api-access-7cmmn\") pod \"ovnkube-node-27pfm\" (UID: \"f29dd71b-4548-4c9b-a4d5-af413dfcf903\") " pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:24.953443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.953420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7446q"
Jul 22 21:05:24.962780 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:24.962754    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f491988_38ed_4326_958b_ebd036164685.slice/crio-d2605245171dffa472f484c7d67d8664f8910d486d355d9648862b423a3293f1 WatchSource:0}: Error finding container d2605245171dffa472f484c7d67d8664f8910d486d355d9648862b423a3293f1: Status 404 returned error can't find the container with id d2605245171dffa472f484c7d67d8664f8910d486d355d9648862b423a3293f1
Jul 22 21:05:24.968476 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.968459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9nlvs"
Jul 22 21:05:24.973238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.973224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwmt5"
Jul 22 21:05:24.976418 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:24.976396    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89e7667_8bb2_4f80_9c27_06ddd435c2ee.slice/crio-3ee2fd8f911464e8071eefdac709746c8b60460889f4d46729b29e85efc4410d WatchSource:0}: Error finding container 3ee2fd8f911464e8071eefdac709746c8b60460889f4d46729b29e85efc4410d: Status 404 returned error can't find the container with id 3ee2fd8f911464e8071eefdac709746c8b60460889f4d46729b29e85efc4410d
Jul 22 21:05:24.981821 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:24.981801    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c988042_9c0b_4ab1_af14_a4e22255c99e.slice/crio-34165e299b8a78fdb110993265a094da3287f5567460adfc0ce0a22e164f112b WatchSource:0}: Error finding container 34165e299b8a78fdb110993265a094da3287f5567460adfc0ce0a22e164f112b: Status 404 returned error can't find the container with id 34165e299b8a78fdb110993265a094da3287f5567460adfc0ce0a22e164f112b
Jul 22 21:05:24.985016 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.984999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:24.993743 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:24.993721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ae3d51_1c70_4159_a81f_278945a2cfc5.slice/crio-52b7403ecbdb412231fb77c4aa0c3f2217e6871954600b02a195c6d1abbaf4bc WatchSource:0}: Error finding container 52b7403ecbdb412231fb77c4aa0c3f2217e6871954600b02a195c6d1abbaf4bc: Status 404 returned error can't find the container with id 52b7403ecbdb412231fb77c4aa0c3f2217e6871954600b02a195c6d1abbaf4bc
Jul 22 21:05:24.997087 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:24.997053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk"
Jul 22 21:05:25.004976 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:25.004957    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1c1608_2198_4b25_9098_0bdd58c5b265.slice/crio-0517e9c0bbaa1edf71f40552320668eae9a50e8ee4a45bdc9e00b7d3f8d7ddb5 WatchSource:0}: Error finding container 0517e9c0bbaa1edf71f40552320668eae9a50e8ee4a45bdc9e00b7d3f8d7ddb5: Status 404 returned error can't find the container with id 0517e9c0bbaa1edf71f40552320668eae9a50e8ee4a45bdc9e00b7d3f8d7ddb5
Jul 22 21:05:25.014465 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.014449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rk8w2"
Jul 22 21:05:25.022775 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:25.022759    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6369a9b6_f821_4279_b5cb_6e705932b299.slice/crio-d0ae4813072957e1988866b5c573c3f4ce2baf150c42a5ce7e326b7a847f3d5a WatchSource:0}: Error finding container d0ae4813072957e1988866b5c573c3f4ce2baf150c42a5ce7e326b7a847f3d5a: Status 404 returned error can't find the container with id d0ae4813072957e1988866b5c573c3f4ce2baf150c42a5ce7e326b7a847f3d5a
Jul 22 21:05:25.028736 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.028721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wng62"
Jul 22 21:05:25.036382 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:25.036364    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33091d94_1a6c_49c3_aeac_b99407eaf5ff.slice/crio-d3082a0bfee8b76d42da1bd62d793fb0b7f9b7975e1cd9777c806baf6577d09f WatchSource:0}: Error finding container d3082a0bfee8b76d42da1bd62d793fb0b7f9b7975e1cd9777c806baf6577d09f: Status 404 returned error can't find the container with id d3082a0bfee8b76d42da1bd62d793fb0b7f9b7975e1cd9777c806baf6577d09f
Jul 22 21:05:25.050616 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.050598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfhpg"
Jul 22 21:05:25.058820 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:25.058801    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b85b30_681a_4ef0_a982_cfad490eed20.slice/crio-484a9e2ae4f3472c22bdbdd0712060991b159b876ded7548cdb31302a86ddb70 WatchSource:0}: Error finding container 484a9e2ae4f3472c22bdbdd0712060991b159b876ded7548cdb31302a86ddb70: Status 404 returned error can't find the container with id 484a9e2ae4f3472c22bdbdd0712060991b159b876ded7548cdb31302a86ddb70
Jul 22 21:05:25.066758 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.066743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:25.074923 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:25.074904    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29dd71b_4548_4c9b_a4d5_af413dfcf903.slice/crio-5d963c000fda64453706b2f94cc3aadf49b3140bcabe78c27ed93a4115e7e7e1 WatchSource:0}: Error finding container 5d963c000fda64453706b2f94cc3aadf49b3140bcabe78c27ed93a4115e7e7e1: Status 404 returned error can't find the container with id 5d963c000fda64453706b2f94cc3aadf49b3140bcabe78c27ed93a4115e7e7e1
Jul 22 21:05:25.128484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.128395    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:25.352709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.352672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:25.352898 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.352722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:25.352898 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.352833    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:25.353327 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.353310    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:25.355185 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.353439    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:26.352871081 +0000 UTC m=+3.135772879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:25.355185 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.353472    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:26.353453425 +0000 UTC m=+3.136355223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:25.453492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.453401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:25.453654 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.453561    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:25.453654 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.453586    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:25.453654 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.453599    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:25.453830 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:25.453656    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:26.45363721 +0000 UTC m=+3.236539026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:25.687954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.687821    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 21:00:24 +0000 UTC" deadline="2028-01-03 15:25:29.374944525 +0000 UTC"
Jul 22 21:05:25.687954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.687886    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12714h20m3.687063359s"
Jul 22 21:05:25.775767 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.775539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"5d963c000fda64453706b2f94cc3aadf49b3140bcabe78c27ed93a4115e7e7e1"}
Jul 22 21:05:25.792527 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.792486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfhpg" event={"ID":"b4b85b30-681a-4ef0-a982-cfad490eed20","Type":"ContainerStarted","Data":"484a9e2ae4f3472c22bdbdd0712060991b159b876ded7548cdb31302a86ddb70"}
Jul 22 21:05:25.806166 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.806130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wng62" event={"ID":"33091d94-1a6c-49c3-aeac-b99407eaf5ff","Type":"ContainerStarted","Data":"d3082a0bfee8b76d42da1bd62d793fb0b7f9b7975e1cd9777c806baf6577d09f"}
Jul 22 21:05:25.808607 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.808204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk" event={"ID":"7a1c1608-2198-4b25-9098-0bdd58c5b265","Type":"ContainerStarted","Data":"0517e9c0bbaa1edf71f40552320668eae9a50e8ee4a45bdc9e00b7d3f8d7ddb5"}
Jul 22 21:05:25.822888 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.822854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerStarted","Data":"34165e299b8a78fdb110993265a094da3287f5567460adfc0ce0a22e164f112b"}
Jul 22 21:05:25.831110 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.830986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"c7bfd2e96f7567a0d58475c9b87cbb79","Type":"ContainerStarted","Data":"3710af02c190069dca01bbefd79aa7aeb2d25bd977df7d825e4a77c907b54acb"}
Jul 22 21:05:25.841058 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.840898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" event={"ID":"5e1e12e96403c8859930639c889248d4","Type":"ContainerStarted","Data":"9567b17e99755e522d707dc14469d3d3275b999f5618bf65de7c63bf931fad54"}
Jul 22 21:05:25.850053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.849863    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 21:05:25.854975 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.854891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rk8w2" event={"ID":"6369a9b6-f821-4279-b5cb-6e705932b299","Type":"ContainerStarted","Data":"d0ae4813072957e1988866b5c573c3f4ce2baf150c42a5ce7e326b7a847f3d5a"}
Jul 22 21:05:25.873441 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.873406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7lzrc" event={"ID":"52ae3d51-1c70-4159-a81f-278945a2cfc5","Type":"ContainerStarted","Data":"52b7403ecbdb412231fb77c4aa0c3f2217e6871954600b02a195c6d1abbaf4bc"}
Jul 22 21:05:25.882055 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.882022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9nlvs" event={"ID":"e89e7667-8bb2-4f80-9c27-06ddd435c2ee","Type":"ContainerStarted","Data":"3ee2fd8f911464e8071eefdac709746c8b60460889f4d46729b29e85efc4410d"}
Jul 22 21:05:25.898301 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:25.898267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7446q" event={"ID":"1f491988-38ed-4326-958b-ebd036164685","Type":"ContainerStarted","Data":"d2605245171dffa472f484c7d67d8664f8910d486d355d9648862b423a3293f1"}
Jul 22 21:05:26.360526 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.359714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:26.360526 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.359805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:26.360526 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.359947    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:26.360526 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.360014    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:28.359993023 +0000 UTC m=+5.142894845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:26.360526 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.360441    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:26.360526 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.360489    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:28.360474282 +0000 UTC m=+5.143376082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:26.460494 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.460454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:26.460674 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.460636    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:26.460674 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.460659    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:26.460674 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.460671    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:26.460841 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.460748    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:28.460719769 +0000 UTC m=+5.243621580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:26.689014 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.688921    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 21:00:24 +0000 UTC" deadline="2028-02-02 12:09:54.217832656 +0000 UTC"
Jul 22 21:05:26.689014 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.688961    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13431h4m27.528874326s"
Jul 22 21:05:26.744551 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.744520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:26.744725 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.744642    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:26.745062 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.745040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:26.745180 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.745160    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:26.745245 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:26.745227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:26.745314 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:26.745297    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:28.379130 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:28.378871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:28.379588 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:28.379178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:28.379588 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.379241    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:28.379588 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.379317    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:32.379294155 +0000 UTC m=+9.162195955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:28.379588 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.379346    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:28.379588 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.379394    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:32.379380629 +0000 UTC m=+9.162282441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:28.479806 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:28.479770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:28.479974 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.479961    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:28.480049 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.479984    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:28.480049 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.479998    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:28.480193 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.480055    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:32.480036908 +0000 UTC m=+9.262938717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:28.744849 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:28.744778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:28.744849 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:28.744807    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:28.745055 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.744899    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:28.745258 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:28.744778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:28.745384 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.745340    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:28.745468 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:28.745415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:30.745307 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:30.745271    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:30.745762 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:30.745313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:30.745762 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:30.745398    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:30.745762 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:30.745693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:30.745923 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:30.745768    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:30.745923 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:30.745829    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:32.411445 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:32.411361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:32.411445 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:32.411428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:32.411919 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.411594    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:32.411919 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.411656    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:40.41163705 +0000 UTC m=+17.194538851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:32.411919 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.411720    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:32.411919 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.411761    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:40.411750927 +0000 UTC m=+17.194652723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:32.512769 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:32.512735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:32.512970 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.512946    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:32.513017 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.512981    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:32.513017 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.512996    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:32.513107 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.513057    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:40.513036961 +0000 UTC m=+17.295938770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:32.744916 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:32.744830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:32.744916 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:32.744857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:32.745124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:32.744823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:32.745124 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.744972    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:32.745213 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.745126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:32.745273 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:32.745211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:34.744516 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:34.744485    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:34.744893 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:34.744620    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:34.744944 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:34.744936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:34.745036 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:34.745013    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:34.745105 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:34.745092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:34.745201 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:34.745183    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:36.744755 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:36.744724    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:36.745162 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:36.744758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:36.745162 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:36.744770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:36.745162 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:36.744861    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:36.745162 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:36.744942    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:36.745162 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:36.745020    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:38.745409 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:38.744914    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:38.745409 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:38.744959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:38.745409 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:38.745030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:38.745409 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:38.745053    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:38.745409 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:38.745151    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:38.745409 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:38.745233    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:40.468679 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:40.468641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:40.469154 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:40.468690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:40.469154 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.468791    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:40.469154 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.468792    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:40.469154 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.468842    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:56.468829487 +0000 UTC m=+33.251731283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:40.469154 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.468856    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:56.468849436 +0000 UTC m=+33.251751231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:40.569511 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:40.569476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:40.569671 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.569637    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:40.569671 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.569657    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:40.569671 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.569667    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:40.569780 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.569738    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:56.569724416 +0000 UTC m=+33.352626215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:40.744459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:40.744400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:40.744459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:40.744442    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:40.744600 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:40.744442    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:40.744600 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.744506    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:40.744663 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.744605    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:40.744696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:40.744663    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:42.745309 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:42.745275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:42.745814 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:42.745320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:42.745814 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:42.745321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:42.745814 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:42.745403    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:42.745814 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:42.745483    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:42.745814 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:42.745576    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:44.745117 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:44.745080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:44.745117 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:44.745099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:44.745582 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:44.745226    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:44.745582 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:44.745284    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:44.745582 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:44.745326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:44.745582 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:44.745411    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:45.949357 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.948465    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.951669    2576 generic.go:356] "Generic (PLEG): container finished" podID="f29dd71b-4548-4c9b-a4d5-af413dfcf903" containerID="08bb20acc8f65e1386849910a2e1deb85075e2c3d53e93aad630e9e523703952" exitCode=1
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.951922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"8c8644105d0a179039871f44035ca071d8494e859c397042f1715e86bc68b6c3"}
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.952006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"b5a3a613c1829b25279b9c42707d04f81e92d33496277485671617e6f0da2e10"}
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.952063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"41053e39c5b92e63319b5354de681f8a9a4411e357eb48617b31869ad9126776"}
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.952154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerDied","Data":"08bb20acc8f65e1386849910a2e1deb85075e2c3d53e93aad630e9e523703952"}
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.952208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"b71e41a9c26ea907464bd10528fbf2205f7ba5dcf52784b96da225622fadd7b0"}
Jul 22 21:05:45.955816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.954346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wng62" event={"ID":"33091d94-1a6c-49c3-aeac-b99407eaf5ff","Type":"ContainerStarted","Data":"743d2550a5f3c2c2b905551ed15397f387b36c6d5dd7d9593ce34ced25b2bd87"}
Jul 22 21:05:45.956803 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.956776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk" event={"ID":"7a1c1608-2198-4b25-9098-0bdd58c5b265","Type":"ContainerStarted","Data":"34d6714e19f2c84a221177a284eaa3bc994c91dcb3b57a512ec0ee3fe66594d5"}
Jul 22 21:05:45.958787 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.958758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerStarted","Data":"78f5dde3a1a3df70af044ee712a85581a7ab2e8ffa36c564ba9113e089a7d4b2"}
Jul 22 21:05:45.960987 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.960891    2576 generic.go:356] "Generic (PLEG): container finished" podID="c7bfd2e96f7567a0d58475c9b87cbb79" containerID="8b68cc88eefb962d5290bc6e49782b3a2e20a5f6bd746c7203df54e0337d1202" exitCode=0
Jul 22 21:05:45.960987 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.960965    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"c7bfd2e96f7567a0d58475c9b87cbb79","Type":"ContainerDied","Data":"8b68cc88eefb962d5290bc6e49782b3a2e20a5f6bd746c7203df54e0337d1202"}
Jul 22 21:05:45.962493 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.962473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" event={"ID":"5e1e12e96403c8859930639c889248d4","Type":"ContainerStarted","Data":"a80f9c6e8f1777f463cbab498888f71db7758ea9209382c77c3e3b345c2eee2e"}
Jul 22 21:05:45.964173 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.964150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rk8w2" event={"ID":"6369a9b6-f821-4279-b5cb-6e705932b299","Type":"ContainerStarted","Data":"e684e6969a0a400e4905e6b017e94439082682e09d19a403ae2b46c17e55f99b"}
Jul 22 21:05:45.965416 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.965394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7lzrc" event={"ID":"52ae3d51-1c70-4159-a81f-278945a2cfc5","Type":"ContainerStarted","Data":"a2514469f0e32090a6cc5559374a2edc878f5e47603502f84eac3e6650613f2f"}
Jul 22 21:05:45.967089 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.967046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9nlvs" event={"ID":"e89e7667-8bb2-4f80-9c27-06ddd435c2ee","Type":"ContainerStarted","Data":"05d63863461598606916c3845d4b271bd8812ba5f53be6a04b66580726b3e588"}
Jul 22 21:05:45.968429 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.968403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7446q" event={"ID":"1f491988-38ed-4326-958b-ebd036164685","Type":"ContainerStarted","Data":"a91c6a7539ccfe158c9d1eed53ea37acf56efd281f34726d213b755192577af0"}
Jul 22 21:05:45.974365 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.974329    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wng62" podStartSLOduration=1.9059309070000001 podStartE2EDuration="21.974318191s" totalImagesPullingTime="20.068387284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:45.974104441 +0000 UTC m=+22.757006256" watchObservedRunningTime="2026-07-22 21:05:45.974318191 +0000 UTC m=+22.757220009"
Jul 22 21:05:45.995716 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:45.995671    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rk8w2" podStartSLOduration=1.919619194 podStartE2EDuration="21.995658997s" totalImagesPullingTime="20.076039803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:45.995331703 +0000 UTC m=+22.778233522" watchObservedRunningTime="2026-07-22 21:05:45.995658997 +0000 UTC m=+22.778560816"
Jul 22 21:05:46.020690 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.020644    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7446q" podStartSLOduration=2.348462261 podStartE2EDuration="23.020628847s" totalImagesPullingTime="20.672166586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:46.019806909 +0000 UTC m=+22.802708730" watchObservedRunningTime="2026-07-22 21:05:46.020628847 +0000 UTC m=+22.803530665"
Jul 22 21:05:46.039698 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.039651    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9nlvs" podStartSLOduration=2.9060007150000002 podStartE2EDuration="23.039636444s" totalImagesPullingTime="20.133635729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:46.039170309 +0000 UTC m=+22.822072128" watchObservedRunningTime="2026-07-22 21:05:46.039636444 +0000 UTC m=+22.822538262"
Jul 22 21:05:46.096595 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.096533    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" podStartSLOduration=22.096516649 podStartE2EDuration="22.096516649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:46.095927698 +0000 UTC m=+22.878829515" watchObservedRunningTime="2026-07-22 21:05:46.096516649 +0000 UTC m=+22.879418474"
Jul 22 21:05:46.745148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.745029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:46.745148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.745105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:46.745380 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.745189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:46.745380 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:46.745192    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:46.745380 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:46.745277    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:46.745533 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:46.745381    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:46.973197 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.973134    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:05:46.973608 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.973495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"506a2450b83a9d94de0f784e1208e7afce22d2616f891a3ecb2b00aefeea4eef"}
Jul 22 21:05:46.974859 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.974833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfhpg" event={"ID":"b4b85b30-681a-4ef0-a982-cfad490eed20","Type":"ContainerStarted","Data":"6a14ebd0d5a78d8d5e431f69162b31eb8d274af7f7463ea47852e101987f71f8"}
Jul 22 21:05:46.976327 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.976306    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c988042-9c0b-4ab1-af14-a4e22255c99e" containerID="78f5dde3a1a3df70af044ee712a85581a7ab2e8ffa36c564ba9113e089a7d4b2" exitCode=0
Jul 22 21:05:46.976450 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.976433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerDied","Data":"78f5dde3a1a3df70af044ee712a85581a7ab2e8ffa36c564ba9113e089a7d4b2"}
Jul 22 21:05:46.988876 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:46.988832    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7lzrc" podStartSLOduration=2.883565205 podStartE2EDuration="22.988816178s" totalImagesPullingTime="20.105250973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:46.110600302 +0000 UTC m=+22.893502119" watchObservedRunningTime="2026-07-22 21:05:46.988816178 +0000 UTC m=+23.771717996"
Jul 22 21:05:47.002678 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.002633    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kfhpg" podStartSLOduration=2.962486266 podStartE2EDuration="23.002618515s" totalImagesPullingTime="20.040132249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:46.988751144 +0000 UTC m=+23.771652961" watchObservedRunningTime="2026-07-22 21:05:47.002618515 +0000 UTC m=+23.785520332"
Jul 22 21:05:47.312675 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.312650    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 21:05:47.706349 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.706254    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T21:05:47.312669198Z","UUID":"1b4a0516-2b03-48a1-a35c-a8e11af14612","Handler":null,"Name":"","Endpoint":""}
Jul 22 21:05:47.707721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.707703    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 21:05:47.707825 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.707738    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 21:05:47.981238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.981059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk" event={"ID":"7a1c1608-2198-4b25-9098-0bdd58c5b265","Type":"ContainerStarted","Data":"247b5da07b95fe7a2206e29c6238adf98bf40f4e09e0a3ac1ca46582afa9a610"}
Jul 22 21:05:47.984025 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.983994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"c7bfd2e96f7567a0d58475c9b87cbb79","Type":"ContainerStarted","Data":"153717ecbf38db07a695b2f14e8dfbbb902f175d3c6612ec174b75f5da90e60c"}
Jul 22 21:05:47.999916 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:47.999865    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" podStartSLOduration=23.999850371 podStartE2EDuration="23.999850371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:47.999240555 +0000 UTC m=+24.782142373" watchObservedRunningTime="2026-07-22 21:05:47.999850371 +0000 UTC m=+24.782752188"
Jul 22 21:05:48.744488 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:48.744456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:48.744653 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:48.744569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:48.744653 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:48.744570    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:48.744759 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:48.744672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:48.744759 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:48.744674    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:48.744846 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:48.744759    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:48.990962 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:48.990883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:05:48.991345 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:48.991288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"198c1dba9d63caadd1fdbc3822cb58d2e78f4aae9758ab20b04fb67499bdc282"}
Jul 22 21:05:48.993107 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:48.993082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk" event={"ID":"7a1c1608-2198-4b25-9098-0bdd58c5b265","Type":"ContainerStarted","Data":"1ad530fcc14bfd3ae076ec8aee1edb56cb4dc23516248a0612da45168203154b"}
Jul 22 21:05:49.014027 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:49.013986    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lp7qk" podStartSLOduration=2.348884793 podStartE2EDuration="25.013972722s" totalImagesPullingTime="22.665087929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:49.01392994 +0000 UTC m=+25.796831758" watchObservedRunningTime="2026-07-22 21:05:49.013972722 +0000 UTC m=+25.796874518"
Jul 22 21:05:49.111307 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:49.111280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:49.111846 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:49.111821    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:49.996028 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:49.995991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:49.996539 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:49.996524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7lzrc"
Jul 22 21:05:50.744883 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:50.744794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:50.745033 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:50.744908    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:50.745133 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:50.745113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:50.745249 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:50.745227    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:50.745327 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:50.745259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:50.745365 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:50.745326    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:52.005528 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.005362    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:05:52.006347 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.005920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"abebf59860a80a20e332dc127b4308ffff3fd7a0c41243e7114cb50c1eeee9dd"}
Jul 22 21:05:52.006347 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.006184    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:52.006468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.006357    2576 scope.go:117] "RemoveContainer" containerID="08bb20acc8f65e1386849910a2e1deb85075e2c3d53e93aad630e9e523703952"
Jul 22 21:05:52.744818 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.744644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:52.744981 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.744679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:52.744981 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:52.744914    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:52.744981 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:52.744706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:52.745119 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:52.744982    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:52.745119 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:52.745028    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:53.011595 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.011499    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:05:53.011960 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.011850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" event={"ID":"f29dd71b-4548-4c9b-a4d5-af413dfcf903","Type":"ContainerStarted","Data":"cc4b47dbb24f73297ddd7d20b3b17a6b348b4ed0211ca518be67e4e75ab399cc"}
Jul 22 21:05:53.012141 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.012119    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:53.012232 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.012201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:53.013712 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.013689    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c988042-9c0b-4ab1-af14-a4e22255c99e" containerID="7c2ebce7981f946c748c8f0984eec94ced36f32b6f3ae56c5742cbb70265fea4" exitCode=0
Jul 22 21:05:53.013712 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.013716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerDied","Data":"7c2ebce7981f946c748c8f0984eec94ced36f32b6f3ae56c5742cbb70265fea4"}
Jul 22 21:05:53.029457 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.029434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:53.029564 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.029552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:05:53.039043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:53.039004    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm" podStartSLOduration=8.699374896 podStartE2EDuration="29.038992031s" totalImagesPullingTime="20.339617135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:05:53.037292387 +0000 UTC m=+29.820194205" watchObservedRunningTime="2026-07-22 21:05:53.038992031 +0000 UTC m=+29.821893848"
Jul 22 21:05:54.009992 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:54.009967    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vqjdz"]
Jul 22 21:05:54.010160 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:54.010145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:54.010257 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:54.010240    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:54.012965 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:54.012945    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4nxf6"]
Jul 22 21:05:54.013274 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:54.013035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:54.013274 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:54.013134    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:54.021394 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:54.021376    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8h2b5"]
Jul 22 21:05:54.021491 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:54.021461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:54.021579 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:54.021549    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:55.020954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:55.020925    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c988042-9c0b-4ab1-af14-a4e22255c99e" containerID="351dc5c05974ba94435e6375d6b88a0a8b6f85d7bc044b73016479bc7c1d5548" exitCode=0
Jul 22 21:05:55.021410 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:55.021003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerDied","Data":"351dc5c05974ba94435e6375d6b88a0a8b6f85d7bc044b73016479bc7c1d5548"}
Jul 22 21:05:55.745005 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:55.744970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:55.745005 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:55.745002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:55.745237 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:55.744972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:55.745237 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:55.745150    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:55.745355 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:55.745243    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:55.745355 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:55.745344    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:56.487716 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:56.487571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:56.488004 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.487719    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:56.488004 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:56.487739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:56.488004 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.487784    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:28.487761334 +0000 UTC m=+65.270663148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 21:05:56.488004 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.487816    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:56.488004 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.487856    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret podName:dd82aa96-ead0-4184-a4fd-016a555d2d87 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:28.487843845 +0000 UTC m=+65.270745644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret") pod "global-pull-secret-syncer-vqjdz" (UID: "dd82aa96-ead0-4184-a4fd-016a555d2d87") : object "kube-system"/"original-pull-secret" not registered
Jul 22 21:05:56.588128 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:56.588036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:56.588258 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.588190    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 21:05:56.588258 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.588208    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 21:05:56.588258 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.588217    2576 projected.go:196] Error preparing data for projected volume kube-api-access-n28qx for pod openshift-network-diagnostics/network-check-target-8h2b5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:56.588369 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:56.588265    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx podName:cfb3a67b-2a26-4c5f-9c86-82b71e07fae9 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:28.588251569 +0000 UTC m=+65.371153368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n28qx" (UniqueName: "kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx") pod "network-check-target-8h2b5" (UID: "cfb3a67b-2a26-4c5f-9c86-82b71e07fae9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 21:05:57.029813 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:57.029733    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c988042-9c0b-4ab1-af14-a4e22255c99e" containerID="84c7a3e413782a2c03ab2a047674b8c31f0f35210d902ceefb6dfbd389280b28" exitCode=0
Jul 22 21:05:57.029813 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:57.029787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerDied","Data":"84c7a3e413782a2c03ab2a047674b8c31f0f35210d902ceefb6dfbd389280b28"}
Jul 22 21:05:57.745240 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:57.745211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:57.745240 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:57.745222    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:57.745240 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:57.745232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:57.745652 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:57.745309    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:05:57.745652 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:57.745394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vqjdz" podUID="dd82aa96-ead0-4184-a4fd-016a555d2d87"
Jul 22 21:05:57.745652 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:57.745482    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8h2b5" podUID="cfb3a67b-2a26-4c5f-9c86-82b71e07fae9"
Jul 22 21:05:58.531611 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.531525    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeReady"
Jul 22 21:05:58.531759 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.531633    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 21:05:58.563208 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.563182    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"]
Jul 22 21:05:58.567051 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.567037    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:58.568845 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.568824    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f989dbbdb-28kx7"]
Jul 22 21:05:58.569817 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.569799    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 21:05:58.569927 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.569828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4pwwf\""
Jul 22 21:05:58.569927 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.569842    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 21:05:58.572607 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.572590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.574938 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.574919    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 21:05:58.575424 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.575405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 21:05:58.575807 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.575790    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 21:05:58.576581 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.576550    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"]
Jul 22 21:05:58.576581 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.576571    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7thd2\""
Jul 22 21:05:58.580964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.580944    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 21:05:58.582694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.582676    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l7s4j"]
Jul 22 21:05:58.587097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.587049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.589049 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.589025    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2dhw2"]
Jul 22 21:05:58.589645 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.589613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 21:05:58.589930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.589916    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dq9z\""
Jul 22 21:05:58.590086 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.590052    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 21:05:58.590215 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.590198    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 21:05:58.592838 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.592821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f989dbbdb-28kx7"]
Jul 22 21:05:58.592922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.592910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.595188 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.595148    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 21:05:58.595302 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.595261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2svwz\""
Jul 22 21:05:58.595551 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.595536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 21:05:58.595760 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.595745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l7s4j"]
Jul 22 21:05:58.601706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.601687    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2dhw2"]
Jul 22 21:05:58.704281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:58.704281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1730023d-9ded-4304-94fd-3d08ea7314be-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:58.704492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-trusted-ca\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-bound-sa-token\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/744b520d-1f70-4927-93c4-c739d227a58b-config-volume\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.704492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzpm\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-kube-api-access-vgzpm\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee137d5e-68e7-46aa-868b-fb8a28affe40-cert\") pod \"ingress-canary-l7s4j\" (UID: \"ee137d5e-68e7-46aa-868b-fb8a28affe40\") " pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-image-registry-private-configuration\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e08d3017-87d9-4690-9530-0fd1e00ad082-ca-trust-extracted\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/744b520d-1f70-4927-93c4-c739d227a58b-tmp-dir\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbv7n\" (UniqueName: \"kubernetes.io/projected/ee137d5e-68e7-46aa-868b-fb8a28affe40-kube-api-access-rbv7n\") pod \"ingress-canary-l7s4j\" (UID: \"ee137d5e-68e7-46aa-868b-fb8a28affe40\") " pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxg6\" (UniqueName: \"kubernetes.io/projected/744b520d-1f70-4927-93c4-c739d227a58b-kube-api-access-bnxg6\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.704669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-certificates\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704887 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-installation-pull-secrets\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.704887 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.704695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.743169 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.743122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7lzrc_52ae3d51-1c70-4159-a81f-278945a2cfc5/konnectivity-agent/0.log" limit=1024
Jul 22 21:05:58.805396 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:58.805396 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1730023d-9ded-4304-94fd-3d08ea7314be-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:58.805396 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-trusted-ca\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-bound-sa-token\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.805475    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.805535    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:05:59.305520229 +0000 UTC m=+36.088422027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/744b520d-1f70-4927-93c4-c739d227a58b-config-volume\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzpm\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-kube-api-access-vgzpm\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee137d5e-68e7-46aa-868b-fb8a28affe40-cert\") pod \"ingress-canary-l7s4j\" (UID: \"ee137d5e-68e7-46aa-868b-fb8a28affe40\") " pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-image-registry-private-configuration\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e08d3017-87d9-4690-9530-0fd1e00ad082-ca-trust-extracted\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.805809    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.805823    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.805878    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:05:59.305863709 +0000 UTC m=+36.088765519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:05:58.805920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/744b520d-1f70-4927-93c4-c739d227a58b-tmp-dir\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.805976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbv7n\" (UniqueName: \"kubernetes.io/projected/ee137d5e-68e7-46aa-868b-fb8a28affe40-kube-api-access-rbv7n\") pod \"ingress-canary-l7s4j\" (UID: \"ee137d5e-68e7-46aa-868b-fb8a28affe40\") " pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxg6\" (UniqueName: \"kubernetes.io/projected/744b520d-1f70-4927-93c4-c739d227a58b-kube-api-access-bnxg6\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-certificates\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806141    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1730023d-9ded-4304-94fd-3d08ea7314be-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/744b520d-1f70-4927-93c4-c739d227a58b-config-volume\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e08d3017-87d9-4690-9530-0fd1e00ad082-ca-trust-extracted\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-installation-pull-secrets\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-trusted-ca\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/744b520d-1f70-4927-93c4-c739d227a58b-tmp-dir\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.806483    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:05:58.806512 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:58.806522    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:05:59.30651151 +0000 UTC m=+36.089413306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:05:58.807011 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.806521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-certificates\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.810190 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.810168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-installation-pull-secrets\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.810190 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.810179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-image-registry-private-configuration\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.810324 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.810185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee137d5e-68e7-46aa-868b-fb8a28affe40-cert\") pod \"ingress-canary-l7s4j\" (UID: \"ee137d5e-68e7-46aa-868b-fb8a28affe40\") " pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.814170 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.814143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxg6\" (UniqueName: \"kubernetes.io/projected/744b520d-1f70-4927-93c4-c739d227a58b-kube-api-access-bnxg6\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:58.814257 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.814188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-bound-sa-token\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.814257 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.814209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbv7n\" (UniqueName: \"kubernetes.io/projected/ee137d5e-68e7-46aa-868b-fb8a28affe40-kube-api-access-rbv7n\") pod \"ingress-canary-l7s4j\" (UID: \"ee137d5e-68e7-46aa-868b-fb8a28affe40\") " pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:58.814924 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.814908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzpm\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-kube-api-access-vgzpm\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:58.824923 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.824885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7lzrc_52ae3d51-1c70-4159-a81f-278945a2cfc5/konnectivity-agent/0.log" limit=1024
Jul 22 21:05:58.897285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:58.897247    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l7s4j"
Jul 22 21:05:59.045694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.045664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l7s4j"]
Jul 22 21:05:59.051142 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:05:59.051112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee137d5e_68e7_46aa_868b_fb8a28affe40.slice/crio-64089b25e0c3005be010a9ab8118ffeb34d88cb9c65bfad2a77327b7a8ffdb70 WatchSource:0}: Error finding container 64089b25e0c3005be010a9ab8118ffeb34d88cb9c65bfad2a77327b7a8ffdb70: Status 404 returned error can't find the container with id 64089b25e0c3005be010a9ab8118ffeb34d88cb9c65bfad2a77327b7a8ffdb70
Jul 22 21:05:59.311278 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.311230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:05:59.311453 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.311293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:05:59.311453 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.311365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:05:59.311453 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311384    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:05:59.311553 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311454    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:05:59.311553 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311462    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:06:00.311446261 +0000 UTC m=+37.094348057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:05:59.311553 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311459    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:05:59.311553 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311479    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:05:59.311553 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311501    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:06:00.311486559 +0000 UTC m=+37.094388373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:05:59.311553 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:05:59.311517    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:00.311506706 +0000 UTC m=+37.094408518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:05:59.747555 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.747522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:05:59.747710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.747566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:05:59.747710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.747621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:05:59.751659 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.751635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 21:05:59.751795 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.751674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2zj6\""
Jul 22 21:05:59.751795 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.751682    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 21:05:59.751795 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.751674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8629h\""
Jul 22 21:05:59.751795 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.751685    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 21:05:59.752003 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:05:59.751675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 21:06:00.038892 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:00.038802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l7s4j" event={"ID":"ee137d5e-68e7-46aa-868b-fb8a28affe40","Type":"ContainerStarted","Data":"64089b25e0c3005be010a9ab8118ffeb34d88cb9c65bfad2a77327b7a8ffdb70"}
Jul 22 21:06:00.320732 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:00.320696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:06:00.320934 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:00.320762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:06:00.320934 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.320865    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:06:00.320934 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.320868    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:06:00.320934 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.320890    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:06:00.320934 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:00.320915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:06:00.321220 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.320943    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:06:02.320921744 +0000 UTC m=+39.103823554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:06:00.321220 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.320981    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:00.321220 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.321025    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:02.320997104 +0000 UTC m=+39.103898917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:06:00.321220 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:00.321056    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:06:02.321048803 +0000 UTC m=+39.103950600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:02.339877 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:02.339642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.339802    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:02.339999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:02.340043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.340006    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.340137    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.340184    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:06.340157319 +0000 UTC m=+43.123059138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.340184    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.340209    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:06:06.340198345 +0000 UTC m=+43.123100141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:02.340419 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:02.340242    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:06:06.340225276 +0000 UTC m=+43.123127087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:06:06.054442 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.054394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l7s4j" event={"ID":"ee137d5e-68e7-46aa-868b-fb8a28affe40","Type":"ContainerStarted","Data":"f5083316edee2913873dae520588428dc6d3101d3c9cab4987659d56cbc81b70"}
Jul 22 21:06:06.057106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.057081    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c988042-9c0b-4ab1-af14-a4e22255c99e" containerID="89e0cf99f4110e7c70f5746c43b3ea5733258fea3dfa752aad8fed6247f17aa3" exitCode=0
Jul 22 21:06:06.057225 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.057125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerDied","Data":"89e0cf99f4110e7c70f5746c43b3ea5733258fea3dfa752aad8fed6247f17aa3"}
Jul 22 21:06:06.070054 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.070010    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l7s4j" podStartSLOduration=2.154002134 podStartE2EDuration="8.069995757s" totalImagesPullingTime="5.915993623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:06.069187236 +0000 UTC m=+42.852089053" watchObservedRunningTime="2026-07-22 21:06:06.069995757 +0000 UTC m=+42.852897574"
Jul 22 21:06:06.379280 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.379238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:06:06.379459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.379287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:06:06.379459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:06.379316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:06:06.379459 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379405    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:06:06.379459 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379405    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:06:06.379619 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379470    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:06:14.379454525 +0000 UTC m=+51.162356321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:06:06.379619 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379405    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:06.379619 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379542    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:06:14.379530113 +0000 UTC m=+51.162431912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:06.379619 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379416    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:06:06.379619 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:06.379569    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:14.379562943 +0000 UTC m=+51.162464743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:06:07.062355 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:07.062315    2576 generic.go:356] "Generic (PLEG): container finished" podID="9c988042-9c0b-4ab1-af14-a4e22255c99e" containerID="c5f241db605492f87542e014407c59db079d72f7b3ef314a09f4caf4f72bfdc1" exitCode=0
Jul 22 21:06:07.062776 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:07.062405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerDied","Data":"c5f241db605492f87542e014407c59db079d72f7b3ef314a09f4caf4f72bfdc1"}
Jul 22 21:06:08.067798 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:08.067766    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" event={"ID":"9c988042-9c0b-4ab1-af14-a4e22255c99e","Type":"ContainerStarted","Data":"876ad90a5970771444c54190f406001ed407d436be228cc2920ca7abbbc7313f"}
Jul 22 21:06:08.098365 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:08.098311    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xwmt5" podStartSLOduration=8.835390061 podStartE2EDuration="45.098293908s" totalImagesPullingTime="36.262903847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:08.096597833 +0000 UTC m=+44.879499653" watchObservedRunningTime="2026-07-22 21:06:08.098293908 +0000 UTC m=+44.881195726"
Jul 22 21:06:14.439748 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:14.439702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:14.439794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:14.439818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439839    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439865    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439904    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439917    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439927    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:06:30.43990911 +0000 UTC m=+67.222810910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439946    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:06:30.439934629 +0000 UTC m=+67.222836424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:06:14.440208 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:14.439958    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:06:30.439952351 +0000 UTC m=+67.222854147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:25.034503 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:25.034475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27pfm"
Jul 22 21:06:28.548419 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.548371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:06:28.548419 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.548429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:06:28.551145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.551126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 21:06:28.551225 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.551176    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 21:06:28.559541 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:28.559519    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:06:28.559657 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:28.559593    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:07:32.559574389 +0000 UTC m=+129.342476205 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : secret "metrics-daemon-secret" not found
Jul 22 21:06:28.562645 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.562624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd82aa96-ead0-4184-a4fd-016a555d2d87-original-pull-secret\") pod \"global-pull-secret-syncer-vqjdz\" (UID: \"dd82aa96-ead0-4184-a4fd-016a555d2d87\") " pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:06:28.648826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.648779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:06:28.651594 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.651574    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 21:06:28.661937 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.661917    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 21:06:28.672398 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.672372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28qx\" (UniqueName: \"kubernetes.io/projected/cfb3a67b-2a26-4c5f-9c86-82b71e07fae9-kube-api-access-n28qx\") pod \"network-check-target-8h2b5\" (UID: \"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9\") " pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:06:28.857549 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.857520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vqjdz"
Jul 22 21:06:28.870437 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.870407    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2zj6\""
Jul 22 21:06:28.878810 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.878787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:06:28.989841 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:28.989796    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vqjdz"]
Jul 22 21:06:28.992182 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:06:28.992151    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd82aa96_ead0_4184_a4fd_016a555d2d87.slice/crio-e26127438398abc1df9df8f3cc09da69d286438a578ad16f1be3129e2e8a117b WatchSource:0}: Error finding container e26127438398abc1df9df8f3cc09da69d286438a578ad16f1be3129e2e8a117b: Status 404 returned error can't find the container with id e26127438398abc1df9df8f3cc09da69d286438a578ad16f1be3129e2e8a117b
Jul 22 21:06:29.003675 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:29.003653    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8h2b5"]
Jul 22 21:06:29.006886 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:06:29.006864    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb3a67b_2a26_4c5f_9c86_82b71e07fae9.slice/crio-c24904fa088152968176435db74e682587105bff561b28e9d29c1211b8e4fc16 WatchSource:0}: Error finding container c24904fa088152968176435db74e682587105bff561b28e9d29c1211b8e4fc16: Status 404 returned error can't find the container with id c24904fa088152968176435db74e682587105bff561b28e9d29c1211b8e4fc16
Jul 22 21:06:29.120494 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:29.120406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8h2b5" event={"ID":"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9","Type":"ContainerStarted","Data":"c24904fa088152968176435db74e682587105bff561b28e9d29c1211b8e4fc16"}
Jul 22 21:06:29.121455 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:29.121430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vqjdz" event={"ID":"dd82aa96-ead0-4184-a4fd-016a555d2d87","Type":"ContainerStarted","Data":"e26127438398abc1df9df8f3cc09da69d286438a578ad16f1be3129e2e8a117b"}
Jul 22 21:06:30.460747 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:30.460706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:30.460811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:30.460842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.460895    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.460918    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.460929    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.460977    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:07:02.460959946 +0000 UTC m=+99.243861742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.460995    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:07:02.460985922 +0000 UTC m=+99.243887718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.461056    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:06:30.461238 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:06:30.461103    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:07:02.461092762 +0000 UTC m=+99.243994560 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:06:33.135823 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:33.135776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8h2b5" event={"ID":"cfb3a67b-2a26-4c5f-9c86-82b71e07fae9","Type":"ContainerStarted","Data":"385ea080a5210c0623ca49e18c8c9fee173c38c20f23471ba15f18b7678e8f79"}
Jul 22 21:06:33.136343 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:33.135953    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:06:33.153570 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:33.153512    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8h2b5" podStartSLOduration=66.00724389 podStartE2EDuration="1m9.153496554s" totalImagesPullingTime="3.146252664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:33.152184836 +0000 UTC m=+69.935086655" watchObservedRunningTime="2026-07-22 21:06:33.153496554 +0000 UTC m=+69.936398372"
Jul 22 21:06:35.142111 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:35.142081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vqjdz" event={"ID":"dd82aa96-ead0-4184-a4fd-016a555d2d87","Type":"ContainerStarted","Data":"26f681913d843e9485d83dc56373ac9fa741201720125d32818c3ebcb4977892"}
Jul 22 21:06:35.160188 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:06:35.160134    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vqjdz" podStartSLOduration=65.3792278 podStartE2EDuration="1m11.160118796s" totalImagesPullingTime="5.780890996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:06:35.159703556 +0000 UTC m=+71.942605374" watchObservedRunningTime="2026-07-22 21:06:35.160118796 +0000 UTC m=+71.943020592"
Jul 22 21:07:02.497183 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:07:02.497130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:07:02.497183 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:07:02.497184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497284    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497284    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:07:02.497306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497366    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:08:06.497342701 +0000 UTC m=+163.280244498 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497387    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:08:06.497375596 +0000 UTC m=+163.280277392 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497428    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497445    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:07:02.497624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:02.497497    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:08:06.497482906 +0000 UTC m=+163.280384700 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:07:04.141311 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:07:04.141282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8h2b5"
Jul 22 21:07:32.619812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:07:32.619769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:07:32.620252 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:32.619913    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:07:32.620252 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:07:32.619974    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:09:34.619959031 +0000 UTC m=+251.402860833 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : secret "metrics-daemon-secret" not found
Jul 22 21:08:01.576693 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:01.576631    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx" podUID="1730023d-9ded-4304-94fd-3d08ea7314be"
Jul 22 21:08:01.586829 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:01.586795    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082"
Jul 22 21:08:01.604145 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:01.604114    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2dhw2" podUID="744b520d-1f70-4927-93c4-c739d227a58b"
Jul 22 21:08:02.352647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:02.352616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:08:02.352842 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:02.352616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:08:02.352842 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:02.352624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:08:02.762390 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:02.762293    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:08:06.551319 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:06.551285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:06.551347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:06.551367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551436    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551445    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551456    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f989dbbdb-28kx7: secret "image-registry-tls" not found
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551486    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551504    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert podName:1730023d-9ded-4304-94fd-3d08ea7314be nodeName:}" failed. No retries permitted until 2026-07-22 21:10:08.551490527 +0000 UTC m=+285.334392327 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dtwlx" (UID: "1730023d-9ded-4304-94fd-3d08ea7314be") : secret "networking-console-plugin-cert" not found
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551516    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls podName:e08d3017-87d9-4690-9530-0fd1e00ad082 nodeName:}" failed. No retries permitted until 2026-07-22 21:10:08.551510601 +0000 UTC m=+285.334412397 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls") pod "image-registry-6f989dbbdb-28kx7" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082") : secret "image-registry-tls" not found
Jul 22 21:08:06.551696 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:08:06.551533    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls podName:744b520d-1f70-4927-93c4-c739d227a58b nodeName:}" failed. No retries permitted until 2026-07-22 21:10:08.551519786 +0000 UTC m=+285.334421582 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls") pod "dns-default-2dhw2" (UID: "744b520d-1f70-4927-93c4-c739d227a58b") : secret "dns-default-metrics-tls" not found
Jul 22 21:08:16.744882 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:08:16.744797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:09:34.646314 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:34.646278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:09:34.646789 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:34.646413    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 21:09:34.646789 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:34.646471    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs podName:3e5abe72-4167-40ef-a1de-c353e22e6ed4 nodeName:}" failed. No retries permitted until 2026-07-22 21:11:36.64645567 +0000 UTC m=+373.429357465 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs") pod "network-metrics-daemon-4nxf6" (UID: "3e5abe72-4167-40ef-a1de-c353e22e6ed4") : secret "metrics-daemon-secret" not found
Jul 22 21:09:48.817016 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.816960    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-lb2vp"]
Jul 22 21:09:48.819803 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.819765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.821605 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.821585    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ttdhl"]
Jul 22 21:09:48.822990 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.822970    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 21:09:48.823362 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.823345    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 21:09:48.823534 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.823515    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 21:09:48.824200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.824178    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"]
Jul 22 21:09:48.824270 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.824222    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 21:09:48.824270 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.824233    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rk9zj\""
Jul 22 21:09:48.824368 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.824309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.826922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.826905    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"]
Jul 22 21:09:48.827023 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.827003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"
Jul 22 21:09:48.827346 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.827328    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vjs8w\""
Jul 22 21:09:48.827780 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.827470    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 21:09:48.827780 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.827494    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 21:09:48.827899 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.827886    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 21:09:48.828469 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.828453    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:09:48.830009 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.829991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.830117 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.830083    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 21:09:48.830469 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.830451    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pbg6x\""
Jul 22 21:09:48.832742 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.832722    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-lb2vp"]
Jul 22 21:09:48.833585 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.833565    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 21:09:48.833754 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.833719    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 21:09:48.833938 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.833921    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:09:48.834021 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.833949    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 21:09:48.835441 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.835421    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 21:09:48.835931 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.835914    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4d4mf\""
Jul 22 21:09:48.836444 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.836426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"]
Jul 22 21:09:48.840251 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"]
Jul 22 21:09:48.840450 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5324b774-3afc-450b-81ab-a7f00bbdfbf9-tmp\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.840526 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-config\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.840587 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5324b774-3afc-450b-81ab-a7f00bbdfbf9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.840638 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5324b774-3afc-450b-81ab-a7f00bbdfbf9-serving-cert\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.840638 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbdn\" (UniqueName: \"kubernetes.io/projected/49f296b7-68b2-4dc9-8581-b7045123b76d-kube-api-access-8lbdn\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.840740 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5324b774-3afc-450b-81ab-a7f00bbdfbf9-snapshots\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.840740 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh5t2\" (UniqueName: \"kubernetes.io/projected/5324b774-3afc-450b-81ab-a7f00bbdfbf9-kube-api-access-wh5t2\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.840835 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-serving-cert\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.840835 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-trusted-ca\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.840835 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49f296b7-68b2-4dc9-8581-b7045123b76d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.840976 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49f296b7-68b2-4dc9-8581-b7045123b76d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.840976 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blzrc\" (UniqueName: \"kubernetes.io/projected/f8c1b92a-d513-491d-b781-14330d015420-kube-api-access-blzrc\") pod \"network-check-source-7bc5b6bf85-tlln9\" (UID: \"f8c1b92a-d513-491d-b781-14330d015420\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"
Jul 22 21:09:48.840976 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77rjz\" (UniqueName: \"kubernetes.io/projected/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-kube-api-access-77rjz\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.841198 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.840983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5324b774-3afc-450b-81ab-a7f00bbdfbf9-service-ca-bundle\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.846219 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.846202    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ttdhl"]
Jul 22 21:09:48.914197 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.914173    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"]
Jul 22 21:09:48.917111 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.917095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:48.921302 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.921281    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 21:09:48.921405 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.921335    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 21:09:48.922279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.922259    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:09:48.922381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.922297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vstjv\""
Jul 22 21:09:48.924713 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.924695    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 21:09:48.926861 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.926845    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"]
Jul 22 21:09:48.941429 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77rjz\" (UniqueName: \"kubernetes.io/projected/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-kube-api-access-77rjz\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.941553 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5324b774-3afc-450b-81ab-a7f00bbdfbf9-service-ca-bundle\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.941553 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0749d8d5-b38f-49a7-9b26-be1dd674fa98-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:48.941553 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5324b774-3afc-450b-81ab-a7f00bbdfbf9-tmp\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.941717 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-config\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.941768 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5324b774-3afc-450b-81ab-a7f00bbdfbf9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.941819 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5324b774-3afc-450b-81ab-a7f00bbdfbf9-serving-cert\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.941819 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbdn\" (UniqueName: \"kubernetes.io/projected/49f296b7-68b2-4dc9-8581-b7045123b76d-kube-api-access-8lbdn\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.941920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0749d8d5-b38f-49a7-9b26-be1dd674fa98-config\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:48.941920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brxt\" (UniqueName: \"kubernetes.io/projected/0749d8d5-b38f-49a7-9b26-be1dd674fa98-kube-api-access-6brxt\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:48.942018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5324b774-3afc-450b-81ab-a7f00bbdfbf9-tmp\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.942018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5324b774-3afc-450b-81ab-a7f00bbdfbf9-snapshots\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.942018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.941996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh5t2\" (UniqueName: \"kubernetes.io/projected/5324b774-3afc-450b-81ab-a7f00bbdfbf9-kube-api-access-wh5t2\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.942018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-serving-cert\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.942237 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-trusted-ca\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.942237 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49f296b7-68b2-4dc9-8581-b7045123b76d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.942237 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49f296b7-68b2-4dc9-8581-b7045123b76d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.942237 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blzrc\" (UniqueName: \"kubernetes.io/projected/f8c1b92a-d513-491d-b781-14330d015420-kube-api-access-blzrc\") pod \"network-check-source-7bc5b6bf85-tlln9\" (UID: \"f8c1b92a-d513-491d-b781-14330d015420\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"
Jul 22 21:09:48.942424 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5324b774-3afc-450b-81ab-a7f00bbdfbf9-service-ca-bundle\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.942924 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942900    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-config\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.943017 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-trusted-ca\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.943017 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.942943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49f296b7-68b2-4dc9-8581-b7045123b76d-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.943145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.943038    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5324b774-3afc-450b-81ab-a7f00bbdfbf9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.943211 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.943194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5324b774-3afc-450b-81ab-a7f00bbdfbf9-snapshots\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.944812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.944794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-serving-cert\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.945295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.945277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49f296b7-68b2-4dc9-8581-b7045123b76d-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.945383 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.945354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5324b774-3afc-450b-81ab-a7f00bbdfbf9-serving-cert\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.960011 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.959985    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbdn\" (UniqueName: \"kubernetes.io/projected/49f296b7-68b2-4dc9-8581-b7045123b76d-kube-api-access-8lbdn\") pod \"kube-storage-version-migrator-operator-7658d9b749-b8c6l\" (UID: \"49f296b7-68b2-4dc9-8581-b7045123b76d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:48.960500 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.960474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77rjz\" (UniqueName: \"kubernetes.io/projected/442d3f1c-3031-4bfe-a8eb-fbf20f5fda39-kube-api-access-77rjz\") pod \"console-operator-565b7b569d-ttdhl\" (UID: \"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39\") " pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:48.960580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.960510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh5t2\" (UniqueName: \"kubernetes.io/projected/5324b774-3afc-450b-81ab-a7f00bbdfbf9-kube-api-access-wh5t2\") pod \"insights-operator-555d9d7885-lb2vp\" (UID: \"5324b774-3afc-450b-81ab-a7f00bbdfbf9\") " pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:48.960580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:48.960523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blzrc\" (UniqueName: \"kubernetes.io/projected/f8c1b92a-d513-491d-b781-14330d015420-kube-api-access-blzrc\") pod \"network-check-source-7bc5b6bf85-tlln9\" (UID: \"f8c1b92a-d513-491d-b781-14330d015420\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"
Jul 22 21:09:49.042650 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.042625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0749d8d5-b38f-49a7-9b26-be1dd674fa98-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.042744 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.042688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0749d8d5-b38f-49a7-9b26-be1dd674fa98-config\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.042922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.042903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brxt\" (UniqueName: \"kubernetes.io/projected/0749d8d5-b38f-49a7-9b26-be1dd674fa98-kube-api-access-6brxt\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.043168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.043154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0749d8d5-b38f-49a7-9b26-be1dd674fa98-config\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.044745 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.044731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0749d8d5-b38f-49a7-9b26-be1dd674fa98-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.050146 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.050130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brxt\" (UniqueName: \"kubernetes.io/projected/0749d8d5-b38f-49a7-9b26-be1dd674fa98-kube-api-access-6brxt\") pod \"service-ca-operator-5bcbc94c78-xr2sq\" (UID: \"0749d8d5-b38f-49a7-9b26-be1dd674fa98\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.130452 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.130436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-lb2vp"
Jul 22 21:09:49.138596 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.138577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:49.148543 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.148526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"
Jul 22 21:09:49.153250 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.153230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"
Jul 22 21:09:49.227129 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.226758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"
Jul 22 21:09:49.282323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.282267    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-lb2vp"]
Jul 22 21:09:49.311401 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:49.311346    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5324b774_3afc_450b_81ab_a7f00bbdfbf9.slice/crio-be51c6004ab4c2bc0d5bbe1aa495f56c1c9ba7df1de0c8bad97863dfc6c1bf2b WatchSource:0}: Error finding container be51c6004ab4c2bc0d5bbe1aa495f56c1c9ba7df1de0c8bad97863dfc6c1bf2b: Status 404 returned error can't find the container with id be51c6004ab4c2bc0d5bbe1aa495f56c1c9ba7df1de0c8bad97863dfc6c1bf2b
Jul 22 21:09:49.320952 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.320927    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-ttdhl"]
Jul 22 21:09:49.324005 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:49.323974    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442d3f1c_3031_4bfe_a8eb_fbf20f5fda39.slice/crio-f7c3bc6705bcfe80890b0eb1778f26a81f81f4065092eecd86f260397c2167a3 WatchSource:0}: Error finding container f7c3bc6705bcfe80890b0eb1778f26a81f81f4065092eecd86f260397c2167a3: Status 404 returned error can't find the container with id f7c3bc6705bcfe80890b0eb1778f26a81f81f4065092eecd86f260397c2167a3
Jul 22 21:09:49.383587 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.383569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq"]
Jul 22 21:09:49.385637 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:49.385613    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0749d8d5_b38f_49a7_9b26_be1dd674fa98.slice/crio-bcdfe25dc0df86547cb3873dc3840b7dfb2b87f941aee06e47444f6b73ee9515 WatchSource:0}: Error finding container bcdfe25dc0df86547cb3873dc3840b7dfb2b87f941aee06e47444f6b73ee9515: Status 404 returned error can't find the container with id bcdfe25dc0df86547cb3873dc3840b7dfb2b87f941aee06e47444f6b73ee9515
Jul 22 21:09:49.532692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.532668    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l"]
Jul 22 21:09:49.535531 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.535510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9"]
Jul 22 21:09:49.536500 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:49.536475    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f296b7_68b2_4dc9_8581_b7045123b76d.slice/crio-909e2e83c34980a16d1881e3d2f6e2e55ca56c6191612e6557675d87af8df071 WatchSource:0}: Error finding container 909e2e83c34980a16d1881e3d2f6e2e55ca56c6191612e6557675d87af8df071: Status 404 returned error can't find the container with id 909e2e83c34980a16d1881e3d2f6e2e55ca56c6191612e6557675d87af8df071
Jul 22 21:09:49.538460 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:49.538440    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c1b92a_d513_491d_b781_14330d015420.slice/crio-cf651e263ffcc77945d2934ad4b5f9ac5d4092cdaac7a12ec355f1732ccf1ae3 WatchSource:0}: Error finding container cf651e263ffcc77945d2934ad4b5f9ac5d4092cdaac7a12ec355f1732ccf1ae3: Status 404 returned error can't find the container with id cf651e263ffcc77945d2934ad4b5f9ac5d4092cdaac7a12ec355f1732ccf1ae3
Jul 22 21:09:49.593592 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.593567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" event={"ID":"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39","Type":"ContainerStarted","Data":"f7c3bc6705bcfe80890b0eb1778f26a81f81f4065092eecd86f260397c2167a3"}
Jul 22 21:09:49.594550 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.594520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq" event={"ID":"0749d8d5-b38f-49a7-9b26-be1dd674fa98","Type":"ContainerStarted","Data":"bcdfe25dc0df86547cb3873dc3840b7dfb2b87f941aee06e47444f6b73ee9515"}
Jul 22 21:09:49.595535 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.595513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9" event={"ID":"f8c1b92a-d513-491d-b781-14330d015420","Type":"ContainerStarted","Data":"cf651e263ffcc77945d2934ad4b5f9ac5d4092cdaac7a12ec355f1732ccf1ae3"}
Jul 22 21:09:49.596490 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.596473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l" event={"ID":"49f296b7-68b2-4dc9-8581-b7045123b76d","Type":"ContainerStarted","Data":"909e2e83c34980a16d1881e3d2f6e2e55ca56c6191612e6557675d87af8df071"}
Jul 22 21:09:49.597457 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:49.597438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lb2vp" event={"ID":"5324b774-3afc-450b-81ab-a7f00bbdfbf9","Type":"ContainerStarted","Data":"be51c6004ab4c2bc0d5bbe1aa495f56c1c9ba7df1de0c8bad97863dfc6c1bf2b"}
Jul 22 21:09:50.605095 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:50.604639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9" event={"ID":"f8c1b92a-d513-491d-b781-14330d015420","Type":"ContainerStarted","Data":"9ee52680435f956fafae54fe1b9f742f9373aad00370e8e3d5ed6c3f3908c8ad"}
Jul 22 21:09:50.623408 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:50.622902    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tlln9" podStartSLOduration=2.622856275 podStartE2EDuration="2.622856275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:50.62150208 +0000 UTC m=+267.404403922" watchObservedRunningTime="2026-07-22 21:09:50.622856275 +0000 UTC m=+267.405758073"
Jul 22 21:09:53.616914 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.616875    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq" event={"ID":"0749d8d5-b38f-49a7-9b26-be1dd674fa98","Type":"ContainerStarted","Data":"15d72a8320d2cfb3304bc7c535925d3398137fdc2a156de88f56652b16a392f9"}
Jul 22 21:09:53.618704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.618672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l" event={"ID":"49f296b7-68b2-4dc9-8581-b7045123b76d","Type":"ContainerStarted","Data":"1246bb0605abaae55a3827cdf9a67f3119dea7a980ec712ecb517542007c2785"}
Jul 22 21:09:53.620183 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.620158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lb2vp" event={"ID":"5324b774-3afc-450b-81ab-a7f00bbdfbf9","Type":"ContainerStarted","Data":"a49254eee6382280ca3a41acf89efeb3389f4406f267f5079362b77e17852ebe"}
Jul 22 21:09:53.621860 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.621839    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/0.log"
Jul 22 21:09:53.621964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.621878    2576 generic.go:356] "Generic (PLEG): container finished" podID="442d3f1c-3031-4bfe-a8eb-fbf20f5fda39" containerID="bc91d03d3846965c76ec1d4eb232c13912d404022bea7909e6a9c48d84df74f7" exitCode=255
Jul 22 21:09:53.621964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.621903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" event={"ID":"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39","Type":"ContainerDied","Data":"bc91d03d3846965c76ec1d4eb232c13912d404022bea7909e6a9c48d84df74f7"}
Jul 22 21:09:53.622146 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.622118    2576 scope.go:117] "RemoveContainer" containerID="bc91d03d3846965c76ec1d4eb232c13912d404022bea7909e6a9c48d84df74f7"
Jul 22 21:09:53.636242 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.636184    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq" podStartSLOduration=2.112054529 podStartE2EDuration="5.636166763s" totalImagesPullingTime="3.524112234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:53.635668592 +0000 UTC m=+270.418570411" watchObservedRunningTime="2026-07-22 21:09:53.636166763 +0000 UTC m=+270.419068582"
Jul 22 21:09:53.670939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.670889    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l" podStartSLOduration=2.297033045 podStartE2EDuration="5.670866782s" totalImagesPullingTime="3.373833737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:53.669329995 +0000 UTC m=+270.452231810" watchObservedRunningTime="2026-07-22 21:09:53.670866782 +0000 UTC m=+270.453768598"
Jul 22 21:09:53.689249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:53.689198    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-lb2vp" podStartSLOduration=2.085468787 podStartE2EDuration="5.689178992s" totalImagesPullingTime="3.603710205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:53.687868367 +0000 UTC m=+270.470770185" watchObservedRunningTime="2026-07-22 21:09:53.689178992 +0000 UTC m=+270.472080810"
Jul 22 21:09:54.390843 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.390808    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cqxcr"]
Jul 22 21:09:54.394535 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.394504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.396930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.396909    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 21:09:54.397123 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.397107    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f4mgb\""
Jul 22 21:09:54.397206 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.397140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 21:09:54.402499 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.402407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cqxcr"]
Jul 22 21:09:54.494309 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.494278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r6qm\" (UniqueName: \"kubernetes.io/projected/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-api-access-8r6qm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.494309 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.494312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-data-volume\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.494489 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.494414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.494489 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.494470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.494550 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.494522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-crio-socket\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595087 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-crio-socket\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r6qm\" (UniqueName: \"kubernetes.io/projected/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-api-access-8r6qm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-data-volume\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595261 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:54.595201    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:54.595261 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:54.595265    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:09:55.095249282 +0000 UTC m=+271.878151079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:54.595540 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:54.595281    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:54.595540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-crio-socket\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.595540 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:54.595351    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:09:55.095331666 +0000 UTC m=+271.878233484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:54.595540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.595458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-data-volume\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.605629 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.605599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r6qm\" (UniqueName: \"kubernetes.io/projected/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-api-access-8r6qm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:54.626527 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.626505    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:09:54.626870 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.626863    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/0.log"
Jul 22 21:09:54.626925 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.626898    2576 generic.go:356] "Generic (PLEG): container finished" podID="442d3f1c-3031-4bfe-a8eb-fbf20f5fda39" containerID="7a829e814d20db7df32db62bec6549ac7e3e6245d28df85538e2b162879c73b1" exitCode=255
Jul 22 21:09:54.626973 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.626929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" event={"ID":"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39","Type":"ContainerDied","Data":"7a829e814d20db7df32db62bec6549ac7e3e6245d28df85538e2b162879c73b1"}
Jul 22 21:09:54.627018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.626987    2576 scope.go:117] "RemoveContainer" containerID="bc91d03d3846965c76ec1d4eb232c13912d404022bea7909e6a9c48d84df74f7"
Jul 22 21:09:54.627372 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.627240    2576 scope.go:117] "RemoveContainer" containerID="7a829e814d20db7df32db62bec6549ac7e3e6245d28df85538e2b162879c73b1"
Jul 22 21:09:54.627800 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:54.627757    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ttdhl_openshift-console-operator(442d3f1c-3031-4bfe-a8eb-fbf20f5fda39)\"" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" podUID="442d3f1c-3031-4bfe-a8eb-fbf20f5fda39"
Jul 22 21:09:54.866834 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.866797    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"]
Jul 22 21:09:54.871171 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.871144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"
Jul 22 21:09:54.873978 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.873955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-spxm8\""
Jul 22 21:09:54.873978 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.873975    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 21:09:54.874172 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.873955    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 21:09:54.878726 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.878705    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"]
Jul 22 21:09:54.898113 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.898064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqbfs\" (UniqueName: \"kubernetes.io/projected/9ccbbe69-f3d7-4dfb-8bdf-b7a174981027-kube-api-access-pqbfs\") pod \"migrator-7cc9c7ffd7-756kn\" (UID: \"9ccbbe69-f3d7-4dfb-8bdf-b7a174981027\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"
Jul 22 21:09:54.999168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:54.999134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqbfs\" (UniqueName: \"kubernetes.io/projected/9ccbbe69-f3d7-4dfb-8bdf-b7a174981027-kube-api-access-pqbfs\") pod \"migrator-7cc9c7ffd7-756kn\" (UID: \"9ccbbe69-f3d7-4dfb-8bdf-b7a174981027\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"
Jul 22 21:09:55.007554 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.007523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqbfs\" (UniqueName: \"kubernetes.io/projected/9ccbbe69-f3d7-4dfb-8bdf-b7a174981027-kube-api-access-pqbfs\") pod \"migrator-7cc9c7ffd7-756kn\" (UID: \"9ccbbe69-f3d7-4dfb-8bdf-b7a174981027\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"
Jul 22 21:09:55.100283 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.100247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:55.100283 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.100299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:55.100473 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:55.100362    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:55.100473 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:55.100387    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:55.100473 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:55.100414    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:09:56.10040001 +0000 UTC m=+272.883301806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:55.100473 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:55.100434    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:09:56.100421439 +0000 UTC m=+272.883323235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:55.180626 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.180542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"
Jul 22 21:09:55.301743 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.301724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn"]
Jul 22 21:09:55.303684 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:55.303658    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccbbe69_f3d7_4dfb_8bdf_b7a174981027.slice/crio-cd7e4ef2e2fb9c6bf24d0327955fa517b03927d7840fb0994086225f609fcce3 WatchSource:0}: Error finding container cd7e4ef2e2fb9c6bf24d0327955fa517b03927d7840fb0994086225f609fcce3: Status 404 returned error can't find the container with id cd7e4ef2e2fb9c6bf24d0327955fa517b03927d7840fb0994086225f609fcce3
Jul 22 21:09:55.631883 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.631856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:09:55.632327 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.632282    2576 scope.go:117] "RemoveContainer" containerID="7a829e814d20db7df32db62bec6549ac7e3e6245d28df85538e2b162879c73b1"
Jul 22 21:09:55.632462 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:55.632439    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ttdhl_openshift-console-operator(442d3f1c-3031-4bfe-a8eb-fbf20f5fda39)\"" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" podUID="442d3f1c-3031-4bfe-a8eb-fbf20f5fda39"
Jul 22 21:09:55.633046 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:55.633024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn" event={"ID":"9ccbbe69-f3d7-4dfb-8bdf-b7a174981027","Type":"ContainerStarted","Data":"cd7e4ef2e2fb9c6bf24d0327955fa517b03927d7840fb0994086225f609fcce3"}
Jul 22 21:09:56.109277 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.109250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:56.109429 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.109297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:56.109429 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:56.109386    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:56.109429 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:56.109403    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:56.109526 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:56.109442    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:09:58.109427951 +0000 UTC m=+274.892329771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:56.109526 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:56.109455    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:09:58.10944966 +0000 UTC m=+274.892351456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:56.187171 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.187149    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rk8w2_6369a9b6-f821-4279-b5cb-6e705932b299/dns-node-resolver/0.log"
Jul 22 21:09:56.771635 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.771598    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bfqtj"]
Jul 22 21:09:56.774627 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.774607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.777193 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.777169    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 21:09:56.777306 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.777236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 21:09:56.777306 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.777247    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 21:09:56.778303 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.778284    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 21:09:56.778396 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.778336    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sdt27\""
Jul 22 21:09:56.783190 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.783171    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bfqtj"]
Jul 22 21:09:56.815920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.815892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfbkp\" (UniqueName: \"kubernetes.io/projected/74c9c269-634c-4bef-a2eb-6443beb91d67-kube-api-access-zfbkp\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.816061 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.816039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74c9c269-634c-4bef-a2eb-6443beb91d67-signing-cabundle\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.816144 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.816113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74c9c269-634c-4bef-a2eb-6443beb91d67-signing-key\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.917026 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.916997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74c9c269-634c-4bef-a2eb-6443beb91d67-signing-key\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.917187 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.917046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfbkp\" (UniqueName: \"kubernetes.io/projected/74c9c269-634c-4bef-a2eb-6443beb91d67-kube-api-access-zfbkp\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.917187 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.917132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74c9c269-634c-4bef-a2eb-6443beb91d67-signing-cabundle\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.917679 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.917661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74c9c269-634c-4bef-a2eb-6443beb91d67-signing-cabundle\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.919468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.919445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74c9c269-634c-4bef-a2eb-6443beb91d67-signing-key\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:56.926564 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:56.926546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfbkp\" (UniqueName: \"kubernetes.io/projected/74c9c269-634c-4bef-a2eb-6443beb91d67-kube-api-access-zfbkp\") pod \"service-ca-58598695f7-bfqtj\" (UID: \"74c9c269-634c-4bef-a2eb-6443beb91d67\") " pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:57.083939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.083914    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-bfqtj"
Jul 22 21:09:57.423435 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.423413    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bfqtj"]
Jul 22 21:09:57.425037 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:09:57.425016    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c9c269_634c_4bef_a2eb_6443beb91d67.slice/crio-f648dd598692ac1401b8045aac43013d0e5736e00ed3166ce33fd10c7adf47bf WatchSource:0}: Error finding container f648dd598692ac1401b8045aac43013d0e5736e00ed3166ce33fd10c7adf47bf: Status 404 returned error can't find the container with id f648dd598692ac1401b8045aac43013d0e5736e00ed3166ce33fd10c7adf47bf
Jul 22 21:09:57.589218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.589191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wng62_33091d94-1a6c-49c3-aeac-b99407eaf5ff/node-ca/0.log"
Jul 22 21:09:57.641955 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.641864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-bfqtj" event={"ID":"74c9c269-634c-4bef-a2eb-6443beb91d67","Type":"ContainerStarted","Data":"301040df81bd36c3a38cf7754f0515b51a5c55748b7bcea0d6f9c68512b837a4"}
Jul 22 21:09:57.641955 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.641920    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-bfqtj" event={"ID":"74c9c269-634c-4bef-a2eb-6443beb91d67","Type":"ContainerStarted","Data":"f648dd598692ac1401b8045aac43013d0e5736e00ed3166ce33fd10c7adf47bf"}
Jul 22 21:09:57.643617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.643594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn" event={"ID":"9ccbbe69-f3d7-4dfb-8bdf-b7a174981027","Type":"ContainerStarted","Data":"fc276b10b33fcdd39568a76f6645d3c582d23770a8ceeb7d9085d766734ee3ef"}
Jul 22 21:09:57.643747 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.643634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn" event={"ID":"9ccbbe69-f3d7-4dfb-8bdf-b7a174981027","Type":"ContainerStarted","Data":"18d7425f64ef46ae3ae7f31809feed74f7c5a4a43cefea93dcca41dca976e96e"}
Jul 22 21:09:57.660490 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.660442    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-bfqtj" podStartSLOduration=1.660428047 podStartE2EDuration="1.660428047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:57.658861365 +0000 UTC m=+274.441763182" watchObservedRunningTime="2026-07-22 21:09:57.660428047 +0000 UTC m=+274.443329863"
Jul 22 21:09:57.675505 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:57.675465    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-756kn" podStartSLOduration=1.626270085 podStartE2EDuration="3.675450748s" totalImagesPullingTime="2.049180663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:09:57.674391454 +0000 UTC m=+274.457293271" watchObservedRunningTime="2026-07-22 21:09:57.675450748 +0000 UTC m=+274.458352564"
Jul 22 21:09:58.126511 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:58.126480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:58.126861 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:58.126533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:09:58.126861 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:58.126608    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:09:58.126861 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:58.126632    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:58.126861 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:58.126676    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:10:02.126656257 +0000 UTC m=+278.909558053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : configmap "kube-rbac-proxy" not found
Jul 22 21:09:58.126861 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:58.126693    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:10:02.126684995 +0000 UTC m=+278.909586791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:09:58.388998 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:58.388928    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l7s4j_ee137d5e-68e7-46aa-868b-fb8a28affe40/serve-healthcheck-canary/0.log"
Jul 22 21:09:59.139285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:59.139200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:59.139285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:59.139265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:09:59.139668 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:09:59.139654    2576 scope.go:117] "RemoveContainer" containerID="7a829e814d20db7df32db62bec6549ac7e3e6245d28df85538e2b162879c73b1"
Jul 22 21:09:59.139856 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:09:59.139836    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-ttdhl_openshift-console-operator(442d3f1c-3031-4bfe-a8eb-fbf20f5fda39)\"" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" podUID="442d3f1c-3031-4bfe-a8eb-fbf20f5fda39"
Jul 22 21:10:02.156838 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:02.156803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:02.157260 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:02.156873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:02.157260 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:02.156960    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 21:10:02.157260 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:02.156990    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 21:10:02.157260 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:02.157032    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:10:10.157014214 +0000 UTC m=+286.939916010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : secret "insights-runtime-extractor-tls" not found
Jul 22 21:10:02.157260 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:02.157045    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm podName:2cd2b52b-469d-4bcd-9b35-5fc39b14228a nodeName:}" failed. No retries permitted until 2026-07-22 21:10:10.157038813 +0000 UTC m=+286.939940608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cqxcr" (UID: "2cd2b52b-469d-4bcd-9b35-5fc39b14228a") : configmap "kube-rbac-proxy" not found
Jul 22 21:10:05.353202 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:05.353159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082"
Jul 22 21:10:05.353202 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:05.353182    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx" podUID="1730023d-9ded-4304-94fd-3d08ea7314be"
Jul 22 21:10:05.353202 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:05.353159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2dhw2" podUID="744b520d-1f70-4927-93c4-c739d227a58b"
Jul 22 21:10:05.669510 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:05.669439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:10:05.669510 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:05.669447    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:10:05.669709 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:05.669439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:10:08.611602 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.611571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:10:08.611943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.611612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:10:08.611943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.611648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:10:08.614106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.614063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/744b520d-1f70-4927-93c4-c739d227a58b-metrics-tls\") pod \"dns-default-2dhw2\" (UID: \"744b520d-1f70-4927-93c4-c739d227a58b\") " pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:10:08.614106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.614102    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1730023d-9ded-4304-94fd-3d08ea7314be-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dtwlx\" (UID: \"1730023d-9ded-4304-94fd-3d08ea7314be\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:10:08.614276 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.614147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"image-registry-6f989dbbdb-28kx7\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") " pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:10:08.673956 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.673928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2svwz\""
Jul 22 21:10:08.673956 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.673942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7thd2\""
Jul 22 21:10:08.674207 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.673983    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4pwwf\""
Jul 22 21:10:08.679806 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.679786    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"
Jul 22 21:10:08.679894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.679811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:10:08.679925 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.679904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:10:08.849891 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.849866    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx"]
Jul 22 21:10:08.853262 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:08.853226    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1730023d_9ded_4304_94fd_3d08ea7314be.slice/crio-f11c605159cbf13194fb1f0f33ec961b32e95744fc3f5b6596e2d43e0d4eddb4 WatchSource:0}: Error finding container f11c605159cbf13194fb1f0f33ec961b32e95744fc3f5b6596e2d43e0d4eddb4: Status 404 returned error can't find the container with id f11c605159cbf13194fb1f0f33ec961b32e95744fc3f5b6596e2d43e0d4eddb4
Jul 22 21:10:08.865250 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.865185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2dhw2"]
Jul 22 21:10:08.868030 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:08.867999    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744b520d_1f70_4927_93c4_c739d227a58b.slice/crio-d2ea3cd6bf980a02ea8548f03e02ef6954dc8109a056bf4db48b7ff28e1ead67 WatchSource:0}: Error finding container d2ea3cd6bf980a02ea8548f03e02ef6954dc8109a056bf4db48b7ff28e1ead67: Status 404 returned error can't find the container with id d2ea3cd6bf980a02ea8548f03e02ef6954dc8109a056bf4db48b7ff28e1ead67
Jul 22 21:10:08.883739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:08.883717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f989dbbdb-28kx7"]
Jul 22 21:10:08.886757 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:08.886725    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08d3017_87d9_4690_9530_0fd1e00ad082.slice/crio-109a5d0589c91adcde4f020f12fe638752280f46984109cf831e43dfa627a6e5 WatchSource:0}: Error finding container 109a5d0589c91adcde4f020f12fe638752280f46984109cf831e43dfa627a6e5: Status 404 returned error can't find the container with id 109a5d0589c91adcde4f020f12fe638752280f46984109cf831e43dfa627a6e5
Jul 22 21:10:09.681825 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.681783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2dhw2" event={"ID":"744b520d-1f70-4927-93c4-c739d227a58b","Type":"ContainerStarted","Data":"d2ea3cd6bf980a02ea8548f03e02ef6954dc8109a056bf4db48b7ff28e1ead67"}
Jul 22 21:10:09.683156 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.683121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx" event={"ID":"1730023d-9ded-4304-94fd-3d08ea7314be","Type":"ContainerStarted","Data":"f11c605159cbf13194fb1f0f33ec961b32e95744fc3f5b6596e2d43e0d4eddb4"}
Jul 22 21:10:09.684717 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.684689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" event={"ID":"e08d3017-87d9-4690-9530-0fd1e00ad082","Type":"ContainerStarted","Data":"733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470"}
Jul 22 21:10:09.684825 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.684734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" event={"ID":"e08d3017-87d9-4690-9530-0fd1e00ad082","Type":"ContainerStarted","Data":"109a5d0589c91adcde4f020f12fe638752280f46984109cf831e43dfa627a6e5"}
Jul 22 21:10:09.684874 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.684826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:10:09.706206 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.706158    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" podStartSLOduration=285.706141392 podStartE2EDuration="4m45.706141392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:09.705033396 +0000 UTC m=+286.487935213" watchObservedRunningTime="2026-07-22 21:10:09.706141392 +0000 UTC m=+286.489043203"
Jul 22 21:10:09.744653 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:09.744633    2576 scope.go:117] "RemoveContainer" containerID="7a829e814d20db7df32db62bec6549ac7e3e6245d28df85538e2b162879c73b1"
Jul 22 21:10:10.224279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.224239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:10.224462 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.224290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:10.224771 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.224748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:10.226704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.226682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd2b52b-469d-4bcd-9b35-5fc39b14228a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqxcr\" (UID: \"2cd2b52b-469d-4bcd-9b35-5fc39b14228a\") " pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:10.305775 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.305744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cqxcr"
Jul 22 21:10:10.698975 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.698915    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:10:10.703485 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.703207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" event={"ID":"442d3f1c-3031-4bfe-a8eb-fbf20f5fda39","Type":"ContainerStarted","Data":"1d1fa4725e2c1961e38e261ac88167a5391807280d0abe3b4bb1995996e917ba"}
Jul 22 21:10:10.704093 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.703689    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:10:10.710723 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.710696    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl"
Jul 22 21:10:10.720700 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:10.720653    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-ttdhl" podStartSLOduration=19.131430996 podStartE2EDuration="22.720638709s" totalImagesPullingTime="3.589207713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:09:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:10.719093952 +0000 UTC m=+287.501995771" watchObservedRunningTime="2026-07-22 21:10:10.720638709 +0000 UTC m=+287.503540526"
Jul 22 21:10:11.265046 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.265011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cqxcr"]
Jul 22 21:10:11.268357 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:11.268326    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd2b52b_469d_4bcd_9b35_5fc39b14228a.slice/crio-aa7b1eac47bb1397d65f3ae666118d44f4846a0c15164f4377a4d843699097b4 WatchSource:0}: Error finding container aa7b1eac47bb1397d65f3ae666118d44f4846a0c15164f4377a4d843699097b4: Status 404 returned error can't find the container with id aa7b1eac47bb1397d65f3ae666118d44f4846a0c15164f4377a4d843699097b4
Jul 22 21:10:11.704789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.704751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2dhw2" event={"ID":"744b520d-1f70-4927-93c4-c739d227a58b","Type":"ContainerStarted","Data":"d1f8a206f95407d3a6f033f46902231f65872a364d3db0d3f22cd44fbbf94dc9"}
Jul 22 21:10:11.705212 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.704814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2dhw2" event={"ID":"744b520d-1f70-4927-93c4-c739d227a58b","Type":"ContainerStarted","Data":"87f1da285e1b00e595c2bf3b03fccb327465894c1a6a4480212b1bffe83bf7e2"}
Jul 22 21:10:11.705212 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.704877    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:10:11.706119 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.706097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx" event={"ID":"1730023d-9ded-4304-94fd-3d08ea7314be","Type":"ContainerStarted","Data":"ce1d0493469d7409453666b16989c2ba180848fa72dccd3e5ba9ab7522f9827e"}
Jul 22 21:10:11.706981 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.706962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqxcr" event={"ID":"2cd2b52b-469d-4bcd-9b35-5fc39b14228a","Type":"ContainerStarted","Data":"aa7b1eac47bb1397d65f3ae666118d44f4846a0c15164f4377a4d843699097b4"}
Jul 22 21:10:11.725058 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.725021    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2dhw2" podStartSLOduration=251.459384549 podStartE2EDuration="4m13.725007123s" totalImagesPullingTime="2.265622574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:11.724309637 +0000 UTC m=+288.507211460" watchObservedRunningTime="2026-07-22 21:10:11.725007123 +0000 UTC m=+288.507908939"
Jul 22 21:10:11.741443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:11.741407    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dtwlx" podStartSLOduration=260.461304996 podStartE2EDuration="4m22.741394851s" totalImagesPullingTime="2.280089855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:11.74089289 +0000 UTC m=+288.523794724" watchObservedRunningTime="2026-07-22 21:10:11.741394851 +0000 UTC m=+288.524296718"
Jul 22 21:10:16.729811 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:16.729768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqxcr" event={"ID":"2cd2b52b-469d-4bcd-9b35-5fc39b14228a","Type":"ContainerStarted","Data":"4bf533bfd670e81427fa5c6f1db3ed1e615b20c7e789320c4c73dfc69869f21b"}
Jul 22 21:10:19.741391 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:19.741308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqxcr" event={"ID":"2cd2b52b-469d-4bcd-9b35-5fc39b14228a","Type":"ContainerStarted","Data":"bc5d789afad8cd0009768c8d19eca80fac7fff1c473b4ac490d53b51c8b720d3"}
Jul 22 21:10:19.745640 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:19.745618    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4nxf6" podUID="3e5abe72-4167-40ef-a1de-c353e22e6ed4"
Jul 22 21:10:21.714187 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:21.714156    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2dhw2"
Jul 22 21:10:23.644692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.644668    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:10:23.645525 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.645506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:10:23.648808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.648782    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:10:23.649983 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.649965    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:10:23.656276 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.656257    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 21:10:23.859413 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.756676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqxcr" event={"ID":"2cd2b52b-469d-4bcd-9b35-5fc39b14228a","Type":"ContainerStarted","Data":"df73c204a4b5d36b2899cd460abf904c6b6c0510a83e495e8fbcfcb1f408189f"}
Jul 22 21:10:23.859413 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:23.775291    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cqxcr" podStartSLOduration=17.551331633 podStartE2EDuration="29.775275721s" totalImagesPullingTime="12.223944088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:09:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:23.774087628 +0000 UTC m=+300.556989437" watchObservedRunningTime="2026-07-22 21:10:23.775275721 +0000 UTC m=+300.558177536"
Jul 22 21:10:28.684418 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.684384    2576 patch_prober.go:28] interesting pod/image-registry-6f989dbbdb-28kx7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 21:10:28.684789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.684435    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 21:10:28.691835 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.691809    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"]
Jul 22 21:10:28.694369 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.694354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.698188 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.698167    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 21:10:28.698478 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.698430    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 21:10:28.698597 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.698591    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 21:10:28.698662 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.698637    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 21:10:28.698727 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.698712    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-89vzq\""
Jul 22 21:10:28.698780 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.698746    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 21:10:28.706235 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.706215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"]
Jul 22 21:10:28.791850 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.791821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b90f9bec-ef27-4846-851d-aa396e4605aa-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.792032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.791888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.792032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.791951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmdp\" (UniqueName: \"kubernetes.io/projected/b90f9bec-ef27-4846-851d-aa396e4605aa-kube-api-access-bsmdp\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.792032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.791999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.892439 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.892411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmdp\" (UniqueName: \"kubernetes.io/projected/b90f9bec-ef27-4846-851d-aa396e4605aa-kube-api-access-bsmdp\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.892439 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.892442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.892629 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.892467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b90f9bec-ef27-4846-851d-aa396e4605aa-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.892629 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.892521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.892629 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:28.892575    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 22 21:10:28.892767 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:28.892656    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls podName:b90f9bec-ef27-4846-851d-aa396e4605aa nodeName:}" failed. No retries permitted until 2026-07-22 21:10:29.39263833 +0000 UTC m=+306.175540142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-clw5b" (UID: "b90f9bec-ef27-4846-851d-aa396e4605aa") : secret "prometheus-operator-tls" not found
Jul 22 21:10:28.893331 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.893308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b90f9bec-ef27-4846-851d-aa396e4605aa-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.895015 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.894995    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:28.901157 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:28.901137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmdp\" (UniqueName: \"kubernetes.io/projected/b90f9bec-ef27-4846-851d-aa396e4605aa-kube-api-access-bsmdp\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:29.395691 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:29.395657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:29.395880 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:29.395806    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 22 21:10:29.395880 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:29.395878    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls podName:b90f9bec-ef27-4846-851d-aa396e4605aa nodeName:}" failed. No retries permitted until 2026-07-22 21:10:30.395862309 +0000 UTC m=+307.178764124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-clw5b" (UID: "b90f9bec-ef27-4846-851d-aa396e4605aa") : secret "prometheus-operator-tls" not found
Jul 22 21:10:30.405448 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.405414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:30.407789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.407769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b90f9bec-ef27-4846-851d-aa396e4605aa-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-clw5b\" (UID: \"b90f9bec-ef27-4846-851d-aa396e4605aa\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:30.503749 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.503720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"
Jul 22 21:10:30.629541 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.629509    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-clw5b"]
Jul 22 21:10:30.632390 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:30.632364    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90f9bec_ef27_4846_851d_aa396e4605aa.slice/crio-67f242f09cce01fe4316a07d7b833700cd01c6d26aa0227cf13b3771c40e40fe WatchSource:0}: Error finding container 67f242f09cce01fe4316a07d7b833700cd01c6d26aa0227cf13b3771c40e40fe: Status 404 returned error can't find the container with id 67f242f09cce01fe4316a07d7b833700cd01c6d26aa0227cf13b3771c40e40fe
Jul 22 21:10:30.634681 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.634663    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:10:30.711437 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.711364    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:10:30.781324 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:30.781296    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b" event={"ID":"b90f9bec-ef27-4846-851d-aa396e4605aa","Type":"ContainerStarted","Data":"67f242f09cce01fe4316a07d7b833700cd01c6d26aa0227cf13b3771c40e40fe"}
Jul 22 21:10:32.545092 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.544981    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d96b4fb5c-v9ktq"]
Jul 22 21:10:32.548219 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.548197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.550990 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.550967    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 21:10:32.551147 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.551046    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 21:10:32.552341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.552176    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 21:10:32.552341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.552194    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 21:10:32.552341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.552211    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 21:10:32.552341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.552219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rvbmx\""
Jul 22 21:10:32.552341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.552246    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 21:10:32.552341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.552266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 21:10:32.556284 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.556258    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 21:10:32.557597 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.557578    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d96b4fb5c-v9ktq"]
Jul 22 21:10:32.621522 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4x5g\" (UniqueName: \"kubernetes.io/projected/e4d23160-5963-4aa3-87ae-346257fca92a-kube-api-access-b4x5g\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.621651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-trusted-ca-bundle\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.621651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-serving-cert\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.621651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-oauth-serving-cert\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.621651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-console-config\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.621778 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-oauth-config\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.621778 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.621698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-service-ca\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.722840 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-oauth-config\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.722840 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-service-ca\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4x5g\" (UniqueName: \"kubernetes.io/projected/e4d23160-5963-4aa3-87ae-346257fca92a-kube-api-access-b4x5g\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-trusted-ca-bundle\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-serving-cert\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-oauth-serving-cert\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723042 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.722993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-console-config\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.723708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-oauth-serving-cert\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723847 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.723828    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-console-config\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723908 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.723893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-trusted-ca-bundle\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.723946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.723894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-service-ca\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.725433 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.725410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-oauth-config\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.725514 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.725505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-serving-cert\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.731472 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.731451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4x5g\" (UniqueName: \"kubernetes.io/projected/e4d23160-5963-4aa3-87ae-346257fca92a-kube-api-access-b4x5g\") pod \"console-5d96b4fb5c-v9ktq\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") " pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.791380 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.791347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b" event={"ID":"b90f9bec-ef27-4846-851d-aa396e4605aa","Type":"ContainerStarted","Data":"8850e7825d9542912843f6f67fb8fcdec85f3ecefc1b66e8e711ef61b2dc58db"}
Jul 22 21:10:32.791526 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.791397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b" event={"ID":"b90f9bec-ef27-4846-851d-aa396e4605aa","Type":"ContainerStarted","Data":"2c6a8cea98ce48114f6cfb8b4d6ea2937d53b4160488e75eafab5ca84120fee4"}
Jul 22 21:10:32.812123 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.809355    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-clw5b" podStartSLOduration=3.339939771 podStartE2EDuration="4.809335439s" totalImagesPullingTime="1.469395668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:32.806832931 +0000 UTC m=+309.589734768" watchObservedRunningTime="2026-07-22 21:10:32.809335439 +0000 UTC m=+309.592237256"
Jul 22 21:10:32.856814 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.856779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:32.987734 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:32.987708    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d96b4fb5c-v9ktq"]
Jul 22 21:10:32.990177 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:32.990152    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d23160_5963_4aa3_87ae_346257fca92a.slice/crio-b419117135b319c2a0223eb60c2378c8b686977c1651f80ae8ede313cfdb1e78 WatchSource:0}: Error finding container b419117135b319c2a0223eb60c2378c8b686977c1651f80ae8ede313cfdb1e78: Status 404 returned error can't find the container with id b419117135b319c2a0223eb60c2378c8b686977c1651f80ae8ede313cfdb1e78
Jul 22 21:10:33.796803 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:33.796770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d96b4fb5c-v9ktq" event={"ID":"e4d23160-5963-4aa3-87ae-346257fca92a","Type":"ContainerStarted","Data":"b419117135b319c2a0223eb60c2378c8b686977c1651f80ae8ede313cfdb1e78"}
Jul 22 21:10:34.744836 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:34.744803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:10:35.060008 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.059535    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"]
Jul 22 21:10:35.063504 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.063480    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bwzpt"]
Jul 22 21:10:35.063638 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.063619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.066399 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.066378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q4vkk\""
Jul 22 21:10:35.066622 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.066600    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 21:10:35.067214 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.066920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.067669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.067519    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 21:10:35.067669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.067610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 21:10:35.069252 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.069234    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 21:10:35.069800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.069542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 21:10:35.069800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.069587    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 21:10:35.069948 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.069920    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbmlg\""
Jul 22 21:10:35.078094 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.078040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"]
Jul 22 21:10:35.150570 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-wtmp\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.150733 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm6wz\" (UniqueName: \"kubernetes.io/projected/73f503ea-1b45-4d3c-8548-68888c54b2b5-kube-api-access-tm6wz\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.150733 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-tls\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.150733 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.150733 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.150733 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.150733 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.151020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mhhm\" (UniqueName: \"kubernetes.io/projected/ec012bd2-8df6-486f-b14e-390c00c80238-kube-api-access-5mhhm\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.151020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.151020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f503ea-1b45-4d3c-8548-68888c54b2b5-metrics-client-ca\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.151020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-sys\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.151020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-textfile\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.151020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.150988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec012bd2-8df6-486f-b14e-390c00c80238-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.151318 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.151037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec012bd2-8df6-486f-b14e-390c00c80238-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.151318 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.151099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-root\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-root\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-wtmp\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm6wz\" (UniqueName: \"kubernetes.io/projected/73f503ea-1b45-4d3c-8548-68888c54b2b5-kube-api-access-tm6wz\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252241    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-root\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-tls\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-wtmp\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mhhm\" (UniqueName: \"kubernetes.io/projected/ec012bd2-8df6-486f-b14e-390c00c80238-kube-api-access-5mhhm\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f503ea-1b45-4d3c-8548-68888c54b2b5-metrics-client-ca\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-sys\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-textfile\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec012bd2-8df6-486f-b14e-390c00c80238-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.252688 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec012bd2-8df6-486f-b14e-390c00c80238-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.253206 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.252817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73f503ea-1b45-4d3c-8548-68888c54b2b5-sys\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.253206 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.253030    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ec012bd2-8df6-486f-b14e-390c00c80238-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.253299 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.253275    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-textfile\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.253383 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.253358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.253751 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.253724    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73f503ea-1b45-4d3c-8548-68888c54b2b5-metrics-client-ca\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.253859 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:35.252342    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 21:10:35.253859 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:35.253815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-tls podName:73f503ea-1b45-4d3c-8548-68888c54b2b5 nodeName:}" failed. No retries permitted until 2026-07-22 21:10:35.753798031 +0000 UTC m=+312.536699827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-tls") pod "node-exporter-bwzpt" (UID: "73f503ea-1b45-4d3c-8548-68888c54b2b5") : secret "node-exporter-tls" not found
Jul 22 21:10:35.253973 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.253943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.253973 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.253959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec012bd2-8df6-486f-b14e-390c00c80238-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.254093 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:35.254036    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 22 21:10:35.254155 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:10:35.254114    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-tls podName:ec012bd2-8df6-486f-b14e-390c00c80238 nodeName:}" failed. No retries permitted until 2026-07-22 21:10:35.754093406 +0000 UTC m=+312.536995215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-w6hn9" (UID: "ec012bd2-8df6-486f-b14e-390c00c80238") : secret "kube-state-metrics-tls" not found
Jul 22 21:10:35.256764 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.256661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.256928 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.256905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.261798 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.261725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mhhm\" (UniqueName: \"kubernetes.io/projected/ec012bd2-8df6-486f-b14e-390c00c80238-kube-api-access-5mhhm\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.261798 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.261745    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm6wz\" (UniqueName: \"kubernetes.io/projected/73f503ea-1b45-4d3c-8548-68888c54b2b5-kube-api-access-tm6wz\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.758209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.758172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-tls\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.758396 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.758225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.761263 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.761233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec012bd2-8df6-486f-b14e-390c00c80238-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-w6hn9\" (UID: \"ec012bd2-8df6-486f-b14e-390c00c80238\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.761412 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.761240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73f503ea-1b45-4d3c-8548-68888c54b2b5-node-exporter-tls\") pod \"node-exporter-bwzpt\" (UID: \"73f503ea-1b45-4d3c-8548-68888c54b2b5\") " pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:35.979652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.979623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"
Jul 22 21:10:35.986243 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:35.986221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwzpt"
Jul 22 21:10:36.148134 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:36.147725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-w6hn9"]
Jul 22 21:10:36.150102 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:36.150059    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec012bd2_8df6_486f_b14e_390c00c80238.slice/crio-e953d4660678b00877e8e9670efad14045b4ecdd64fe5d435a7ac038a7ed23dd WatchSource:0}: Error finding container e953d4660678b00877e8e9670efad14045b4ecdd64fe5d435a7ac038a7ed23dd: Status 404 returned error can't find the container with id e953d4660678b00877e8e9670efad14045b4ecdd64fe5d435a7ac038a7ed23dd
Jul 22 21:10:36.811311 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:36.811270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9" event={"ID":"ec012bd2-8df6-486f-b14e-390c00c80238","Type":"ContainerStarted","Data":"e953d4660678b00877e8e9670efad14045b4ecdd64fe5d435a7ac038a7ed23dd"}
Jul 22 21:10:36.813230 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:36.813198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d96b4fb5c-v9ktq" event={"ID":"e4d23160-5963-4aa3-87ae-346257fca92a","Type":"ContainerStarted","Data":"4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66"}
Jul 22 21:10:36.814660 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:36.814631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwzpt" event={"ID":"73f503ea-1b45-4d3c-8548-68888c54b2b5","Type":"ContainerStarted","Data":"68bc66e41efcd98de117ba96315cabd94defe1c824eb003b1dd4598dc184b636"}
Jul 22 21:10:36.836586 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:36.836535    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d96b4fb5c-v9ktq" podStartSLOduration=1.815449683 podStartE2EDuration="4.836518501s" totalImagesPullingTime="3.021068818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:36.833842206 +0000 UTC m=+313.616744023" watchObservedRunningTime="2026-07-22 21:10:36.836518501 +0000 UTC m=+313.619420317"
Jul 22 21:10:37.819760 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:37.819724    2576 generic.go:356] "Generic (PLEG): container finished" podID="73f503ea-1b45-4d3c-8548-68888c54b2b5" containerID="f5a8d7e47460768c56a808cd00b02bb8112c6e28ceff076d896ab0bd3e82bd31" exitCode=0
Jul 22 21:10:37.820197 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:37.819813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwzpt" event={"ID":"73f503ea-1b45-4d3c-8548-68888c54b2b5","Type":"ContainerDied","Data":"f5a8d7e47460768c56a808cd00b02bb8112c6e28ceff076d896ab0bd3e82bd31"}
Jul 22 21:10:37.821915 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:37.821888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9" event={"ID":"ec012bd2-8df6-486f-b14e-390c00c80238","Type":"ContainerStarted","Data":"84c19bf05d1d70eeb0d417b27c17d3ea4e35564d074d08f8147dd18066a0b3dd"}
Jul 22 21:10:37.822043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:37.821953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9" event={"ID":"ec012bd2-8df6-486f-b14e-390c00c80238","Type":"ContainerStarted","Data":"25a4407236e7b5c45d92981d0872d2e9ef344c0d2da830f271389500643f54f2"}
Jul 22 21:10:37.822043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:37.821973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9" event={"ID":"ec012bd2-8df6-486f-b14e-390c00c80238","Type":"ContainerStarted","Data":"37aea11407a9a91f827561a2e18efc4ddd243023dd45fa4075dc1b8cd4147dd8"}
Jul 22 21:10:37.859946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:37.859891    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-w6hn9" podStartSLOduration=1.5616318059999998 podStartE2EDuration="2.859875342s" totalImagesPullingTime="1.298243536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:37.858645297 +0000 UTC m=+314.641547114" watchObservedRunningTime="2026-07-22 21:10:37.859875342 +0000 UTC m=+314.642777160"
Jul 22 21:10:38.827314 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:38.827278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwzpt" event={"ID":"73f503ea-1b45-4d3c-8548-68888c54b2b5","Type":"ContainerStarted","Data":"e79df5e4a2a5d375debe817feb8cb302cb935f42ec33a8f533936326a24bb831"}
Jul 22 21:10:38.827790 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:38.827337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwzpt" event={"ID":"73f503ea-1b45-4d3c-8548-68888c54b2b5","Type":"ContainerStarted","Data":"987e025049d4b789b7258902d68cf29d2ff1ef5ecf26ec21d79d95a37ea80b60"}
Jul 22 21:10:38.846967 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:38.846920    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bwzpt" podStartSLOduration=2.755888891 podStartE2EDuration="3.846904311s" totalImagesPullingTime="1.015130534s" totalInitContainerRuntime="75.884886ms" isStatefulPod=true podCreationTimestamp="2026-07-22 21:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:38.845032948 +0000 UTC m=+315.627934764" watchObservedRunningTime="2026-07-22 21:10:38.846904311 +0000 UTC m=+315.629806542"
Jul 22 21:10:40.285424 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.285392    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78df9b994c-9rxz9"]
Jul 22 21:10:40.288890 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.288866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.291691 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.291661    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 21:10:40.291826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.291691    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 21:10:40.291826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.291702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 21:10:40.291972 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.291955    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 21:10:40.292221 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.292205    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-njhqc\""
Jul 22 21:10:40.292350 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.292315    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 21:10:40.298562 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.298542    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 21:10:40.301621 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.301602    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78df9b994c-9rxz9"]
Jul 22 21:10:40.401404 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-telemeter-client-tls\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401592 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401592 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401592 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrj2g\" (UniqueName: \"kubernetes.io/projected/3f77f16f-b171-47c9-ac24-a7c09029e354-kube-api-access-wrj2g\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-secret-telemeter-client\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-federate-client-tls\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-serving-certs-ca-bundle\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.401823 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.401713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-metrics-client-ca\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502038 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-metrics-client-ca\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502038 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-telemeter-client-tls\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrj2g\" (UniqueName: \"kubernetes.io/projected/3f77f16f-b171-47c9-ac24-a7c09029e354-kube-api-access-wrj2g\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-secret-telemeter-client\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-federate-client-tls\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-serving-certs-ca-bundle\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.502923 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.502850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-metrics-client-ca\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.503183 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.503140    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.503436 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.503410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f77f16f-b171-47c9-ac24-a7c09029e354-serving-certs-ca-bundle\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.504882 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.504855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-secret-telemeter-client\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.504970 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.504932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-federate-client-tls\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.505021 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.504970    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.505224 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.505207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f77f16f-b171-47c9-ac24-a7c09029e354-telemeter-client-tls\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.516959 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.516935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrj2g\" (UniqueName: \"kubernetes.io/projected/3f77f16f-b171-47c9-ac24-a7c09029e354-kube-api-access-wrj2g\") pod \"telemeter-client-78df9b994c-9rxz9\" (UID: \"3f77f16f-b171-47c9-ac24-a7c09029e354\") " pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.565233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.565165    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d96b4fb5c-v9ktq"]
Jul 22 21:10:40.599783 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.599745    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79b464cfb-tqbqt"]
Jul 22 21:10:40.599944 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.599881    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9"
Jul 22 21:10:40.607528 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.604784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.615851 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.615822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b464cfb-tqbqt"]
Jul 22 21:10:40.704779 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.704746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-serving-cert\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.704944 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.704792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-service-ca\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.704944 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.704864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-oauth-config\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.704944 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.704905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dljhk\" (UniqueName: \"kubernetes.io/projected/26fa0780-0c3f-498b-86d5-a68bb410c48d-kube-api-access-dljhk\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.705112 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.704976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-trusted-ca-bundle\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.705666 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.705046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-config\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.705808 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.705732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-oauth-serving-cert\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.753046 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.752897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78df9b994c-9rxz9"]
Jul 22 21:10:40.754953 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:40.754927    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f77f16f_b171_47c9_ac24_a7c09029e354.slice/crio-141b360a887ad48391638cbe1e9da13806397b09baecde8551d695b4d5abc57b WatchSource:0}: Error finding container 141b360a887ad48391638cbe1e9da13806397b09baecde8551d695b4d5abc57b: Status 404 returned error can't find the container with id 141b360a887ad48391638cbe1e9da13806397b09baecde8551d695b4d5abc57b
Jul 22 21:10:40.807211 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-trusted-ca-bundle\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.807393 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-config\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.807393 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-oauth-serving-cert\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.807393 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-serving-cert\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.807393 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-service-ca\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.807393 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-oauth-config\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.807633 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dljhk\" (UniqueName: \"kubernetes.io/projected/26fa0780-0c3f-498b-86d5-a68bb410c48d-kube-api-access-dljhk\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.808031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.807989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-config\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.808031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.808029    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-oauth-serving-cert\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.808346 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.808329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-service-ca\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.808662 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.808637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-trusted-ca-bundle\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.810051 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.810028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-oauth-config\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.810107 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.810036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-serving-cert\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.815892 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.815842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dljhk\" (UniqueName: \"kubernetes.io/projected/26fa0780-0c3f-498b-86d5-a68bb410c48d-kube-api-access-dljhk\") pod \"console-79b464cfb-tqbqt\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") " pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:40.836845 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.836808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9" event={"ID":"3f77f16f-b171-47c9-ac24-a7c09029e354","Type":"ContainerStarted","Data":"141b360a887ad48391638cbe1e9da13806397b09baecde8551d695b4d5abc57b"}
Jul 22 21:10:40.933871 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:40.933837    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:41.080256 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.080180    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b464cfb-tqbqt"]
Jul 22 21:10:41.083544 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:41.083511    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fa0780_0c3f_498b_86d5_a68bb410c48d.slice/crio-3852da4a50e4c6a4f01f86060e78538e2c26862cdf77f15a5e463b7a16c84586 WatchSource:0}: Error finding container 3852da4a50e4c6a4f01f86060e78538e2c26862cdf77f15a5e463b7a16c84586: Status 404 returned error can't find the container with id 3852da4a50e4c6a4f01f86060e78538e2c26862cdf77f15a5e463b7a16c84586
Jul 22 21:10:41.148932 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.148908    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f989dbbdb-28kx7"]
Jul 22 21:10:41.261519 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.261484    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:10:41.265993 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.265966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.268826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.268577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 21:10:41.268826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.268796    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 21:10:41.269028 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.268990    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 21:10:41.269387 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269360    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 21:10:41.269485 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269395    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 21:10:41.269485 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269440    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 21:10:41.269591 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269501    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 21:10:41.269651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269593    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5c7na8bchdv9j\""
Jul 22 21:10:41.269705 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269689    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 21:10:41.269848 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 21:10:41.269985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.269969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 21:10:41.270156 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.270132    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 21:10:41.270252 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.270239    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 21:10:41.270469 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.270363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4mm6b\""
Jul 22 21:10:41.270469 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.270384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 21:10:41.272806 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.272778    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 21:10:41.283202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.282739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 21:10:41.283398 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.283373    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:10:41.312420 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-web-config\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.312904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkqb\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-kube-api-access-vtkqb\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.312968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config-out\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.313430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.313234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414436 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config-out\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414436 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414436 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414695 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414695 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414695 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414695 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414695 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-web-config\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.414930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.414956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkqb\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-kube-api-access-vtkqb\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415478 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415478 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415231    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.415478 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.416029 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.416029 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.415919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.417007 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.416716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.417445 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.417418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.417916 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.417816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.418484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.418418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.418648 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.418452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.419238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.419217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.421598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.419578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config-out\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.421598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.419648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.421598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.419804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.421598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.420011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.421598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.420484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.422064 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.422025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.422258 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.422217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.422341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.422267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-web-config\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.422874 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.422834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.430402 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.430379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkqb\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-kube-api-access-vtkqb\") pod \"prometheus-k8s-0\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.579871 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.579829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:10:41.753087 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.753039    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:10:41.757651 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:10:41.757622    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aef01aa_06d0_4d44_ad86_79fd0df6df36.slice/crio-33d8f9427f6a2f652b32c12a7f6cef01e6152b39e5cfa288047338362859760d WatchSource:0}: Error finding container 33d8f9427f6a2f652b32c12a7f6cef01e6152b39e5cfa288047338362859760d: Status 404 returned error can't find the container with id 33d8f9427f6a2f652b32c12a7f6cef01e6152b39e5cfa288047338362859760d
Jul 22 21:10:41.843303 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.843253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"33d8f9427f6a2f652b32c12a7f6cef01e6152b39e5cfa288047338362859760d"}
Jul 22 21:10:41.845147 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.845118    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b464cfb-tqbqt" event={"ID":"26fa0780-0c3f-498b-86d5-a68bb410c48d","Type":"ContainerStarted","Data":"2c139daac1954c70a86f55cce1b7546a37d6b0feef5664aba9277577ff7cc563"}
Jul 22 21:10:41.845305 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.845173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b464cfb-tqbqt" event={"ID":"26fa0780-0c3f-498b-86d5-a68bb410c48d","Type":"ContainerStarted","Data":"3852da4a50e4c6a4f01f86060e78538e2c26862cdf77f15a5e463b7a16c84586"}
Jul 22 21:10:41.863006 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:41.862945    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79b464cfb-tqbqt" podStartSLOduration=1.86292455 podStartE2EDuration="1.86292455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:41.862025012 +0000 UTC m=+318.644926864" watchObservedRunningTime="2026-07-22 21:10:41.86292455 +0000 UTC m=+318.645826348"
Jul 22 21:10:42.857484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:42.857442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:10:43.854977 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:43.854946    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6" exitCode=0
Jul 22 21:10:43.855201 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:43.855041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"}
Jul 22 21:10:43.857163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:43.857135    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9" event={"ID":"3f77f16f-b171-47c9-ac24-a7c09029e354","Type":"ContainerStarted","Data":"9d9156d48bc4b4d2bbc23c76eb8f71188ebc6316212b80f65ca011bda31a82bc"}
Jul 22 21:10:43.857281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:43.857189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9" event={"ID":"3f77f16f-b171-47c9-ac24-a7c09029e354","Type":"ContainerStarted","Data":"2a850aae104c36bc5676ef6c2f9a95aa9ec18144acd57f27344d8637b70136b2"}
Jul 22 21:10:43.857281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:43.857210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9" event={"ID":"3f77f16f-b171-47c9-ac24-a7c09029e354","Type":"ContainerStarted","Data":"df3534abb000e9c757eba10afc1ce4a535d2a6aa6d46b3bb77ab5606dbbecb4a"}
Jul 22 21:10:43.905217 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:43.905164    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78df9b994c-9rxz9" podStartSLOduration=1.4536745 podStartE2EDuration="3.905147197s" totalImagesPullingTime="2.451472697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:43.903909681 +0000 UTC m=+320.686811516" watchObservedRunningTime="2026-07-22 21:10:43.905147197 +0000 UTC m=+320.688049013"
Jul 22 21:10:44.749589 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:44.749556    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b464cfb-tqbqt"]
Jul 22 21:10:47.878954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:47.878915    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"}
Jul 22 21:10:47.879341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:47.879002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"}
Jul 22 21:10:49.889812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:49.889781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"}
Jul 22 21:10:49.890200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:49.889849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"}
Jul 22 21:10:49.890200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:49.889882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"}
Jul 22 21:10:49.890200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:49.889907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerStarted","Data":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"}
Jul 22 21:10:49.918978 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:49.918932    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.454449134 podStartE2EDuration="8.918915942s" totalImagesPullingTime="6.440851845s" totalInitContainerRuntime="23.614963ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:10:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:10:49.916017823 +0000 UTC m=+326.698919668" watchObservedRunningTime="2026-07-22 21:10:49.918915942 +0000 UTC m=+326.701817759"
Jul 22 21:10:50.933957 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:50.933930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:10:51.579949 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:10:51.579903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:11:05.592905 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.592842    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d96b4fb5c-v9ktq" podUID="e4d23160-5963-4aa3-87ae-346257fca92a" containerName="console" containerID="cri-o://4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66" gracePeriod=15
Jul 22 21:11:05.842003 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.841981    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:11:05.942053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.941971    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-oauth-serving-cert\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942013    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-console-config\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942053 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-oauth-config\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942088    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-trusted-ca-bundle\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942151    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4x5g\" (UniqueName: \"kubernetes.io/projected/e4d23160-5963-4aa3-87ae-346257fca92a-kube-api-access-b4x5g\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-service-ca\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942212    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-serving-cert\") pod \"e4d23160-5963-4aa3-87ae-346257fca92a\" (UID: \"e4d23160-5963-4aa3-87ae-346257fca92a\") "
Jul 22 21:11:05.942528 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942503    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:05.942594 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942506    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-console-config" (OuterVolumeSpecName: "console-config") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:05.942594 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942553    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:05.942739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.942607    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:05.944574 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.944545    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:05.944692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.944602    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d23160-5963-4aa3-87ae-346257fca92a-kube-api-access-b4x5g" (OuterVolumeSpecName: "kube-api-access-b4x5g") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "kube-api-access-b4x5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:05.944692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.944606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4d23160-5963-4aa3-87ae-346257fca92a" (UID: "e4d23160-5963-4aa3-87ae-346257fca92a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:05.949424 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.949398    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4d23160-5963-4aa3-87ae-346257fca92a" containerID="4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66" exitCode=0
Jul 22 21:11:05.949540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.949442    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d96b4fb5c-v9ktq"
Jul 22 21:11:05.949540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.949484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d96b4fb5c-v9ktq" event={"ID":"e4d23160-5963-4aa3-87ae-346257fca92a","Type":"ContainerDied","Data":"4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66"}
Jul 22 21:11:05.949540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.949536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d96b4fb5c-v9ktq" event={"ID":"e4d23160-5963-4aa3-87ae-346257fca92a","Type":"ContainerDied","Data":"b419117135b319c2a0223eb60c2378c8b686977c1651f80ae8ede313cfdb1e78"}
Jul 22 21:11:05.949692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.949561    2576 scope.go:117] "RemoveContainer" containerID="4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66"
Jul 22 21:11:05.960355 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.960341    2576 scope.go:117] "RemoveContainer" containerID="4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66"
Jul 22 21:11:05.960624 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:11:05.960604    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66\": container with ID starting with 4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66 not found: ID does not exist" containerID="4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66"
Jul 22 21:11:05.960681 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.960632    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66"} err="failed to get container status \"4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66\": rpc error: code = NotFound desc = could not find container \"4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66\": container with ID starting with 4c09315fea75dc4deb1e2c10e5479456e5b652cb27ddbbd5222af1e72926ea66 not found: ID does not exist"
Jul 22 21:11:05.971282 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.971262    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d96b4fb5c-v9ktq"]
Jul 22 21:11:05.974152 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:05.974133    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d96b4fb5c-v9ktq"]
Jul 22 21:11:06.043791 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043755    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-oauth-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.043791 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043786    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.043791 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043795    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4x5g\" (UniqueName: \"kubernetes.io/projected/e4d23160-5963-4aa3-87ae-346257fca92a-kube-api-access-b4x5g\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.044020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043805    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.044020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043815    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d23160-5963-4aa3-87ae-346257fca92a-console-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.044020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043822    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-oauth-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.044020 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.043830    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4d23160-5963-4aa3-87ae-346257fca92a-console-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.169547 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.169508    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082" containerName="registry" containerID="cri-o://733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470" gracePeriod=30
Jul 22 21:11:06.397969 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.397945    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:11:06.448651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.448624    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgzpm\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-kube-api-access-vgzpm\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.448818 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.448666    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-installation-pull-secrets\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.448818 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.448714    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e08d3017-87d9-4690-9530-0fd1e00ad082-ca-trust-extracted\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.448818 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.448769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-image-registry-private-configuration\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.448981 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.448961    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-certificates\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.449041 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.449018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-trusted-ca\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.449112 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.449057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.449169 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.449126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-bound-sa-token\") pod \"e08d3017-87d9-4690-9530-0fd1e00ad082\" (UID: \"e08d3017-87d9-4690-9530-0fd1e00ad082\") "
Jul 22 21:11:06.450273 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.450193    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:06.450415 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.450277    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:06.451723 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.451679    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:06.451868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.451802    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:06.451939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.451909    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-kube-api-access-vgzpm" (OuterVolumeSpecName: "kube-api-access-vgzpm") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "kube-api-access-vgzpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:06.452035 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.452016    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:06.452426 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.452404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:06.457307 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.457285    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e08d3017-87d9-4690-9530-0fd1e00ad082-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e08d3017-87d9-4690-9530-0fd1e00ad082" (UID: "e08d3017-87d9-4690-9530-0fd1e00ad082"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550093    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e08d3017-87d9-4690-9530-0fd1e00ad082-ca-trust-extracted\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550131    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-image-registry-private-configuration\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550141    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-certificates\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550150    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3017-87d9-4690-9530-0fd1e00ad082-trusted-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550158    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-registry-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550167    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-bound-sa-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550174    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgzpm\" (UniqueName: \"kubernetes.io/projected/e08d3017-87d9-4690-9530-0fd1e00ad082-kube-api-access-vgzpm\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.550189 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.550184    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e08d3017-87d9-4690-9530-0fd1e00ad082-installation-pull-secrets\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:06.954762 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.954729    2576 generic.go:356] "Generic (PLEG): container finished" podID="e08d3017-87d9-4690-9530-0fd1e00ad082" containerID="733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470" exitCode=0
Jul 22 21:11:06.955222 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.954777    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7"
Jul 22 21:11:06.955222 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.954811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" event={"ID":"e08d3017-87d9-4690-9530-0fd1e00ad082","Type":"ContainerDied","Data":"733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470"}
Jul 22 21:11:06.955222 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.954865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f989dbbdb-28kx7" event={"ID":"e08d3017-87d9-4690-9530-0fd1e00ad082","Type":"ContainerDied","Data":"109a5d0589c91adcde4f020f12fe638752280f46984109cf831e43dfa627a6e5"}
Jul 22 21:11:06.955222 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.954891    2576 scope.go:117] "RemoveContainer" containerID="733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470"
Jul 22 21:11:06.963001 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.962947    2576 scope.go:117] "RemoveContainer" containerID="733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470"
Jul 22 21:11:06.963309 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:11:06.963281    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470\": container with ID starting with 733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470 not found: ID does not exist" containerID="733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470"
Jul 22 21:11:06.963397 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.963320    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470"} err="failed to get container status \"733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470\": rpc error: code = NotFound desc = could not find container \"733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470\": container with ID starting with 733c255c92d79d51b40c4783ad1bf7095bcbb9b787ef8fe9aa80e34f8f989470 not found: ID does not exist"
Jul 22 21:11:06.976523 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.976496    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f989dbbdb-28kx7"]
Jul 22 21:11:06.980404 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:06.980379    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f989dbbdb-28kx7"]
Jul 22 21:11:07.749547 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:07.749507    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082" path="/var/lib/kubelet/pods/e08d3017-87d9-4690-9530-0fd1e00ad082/volumes"
Jul 22 21:11:07.749971 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:07.749950    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d23160-5963-4aa3-87ae-346257fca92a" path="/var/lib/kubelet/pods/e4d23160-5963-4aa3-87ae-346257fca92a/volumes"
Jul 22 21:11:08.965540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:08.965508    2576 generic.go:356] "Generic (PLEG): container finished" podID="0749d8d5-b38f-49a7-9b26-be1dd674fa98" containerID="15d72a8320d2cfb3304bc7c535925d3398137fdc2a156de88f56652b16a392f9" exitCode=0
Jul 22 21:11:08.965922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:08.965582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq" event={"ID":"0749d8d5-b38f-49a7-9b26-be1dd674fa98","Type":"ContainerDied","Data":"15d72a8320d2cfb3304bc7c535925d3398137fdc2a156de88f56652b16a392f9"}
Jul 22 21:11:08.965922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:08.965874    2576 scope.go:117] "RemoveContainer" containerID="15d72a8320d2cfb3304bc7c535925d3398137fdc2a156de88f56652b16a392f9"
Jul 22 21:11:09.774670 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:09.774628    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79b464cfb-tqbqt" podUID="26fa0780-0c3f-498b-86d5-a68bb410c48d" containerName="console" containerID="cri-o://2c139daac1954c70a86f55cce1b7546a37d6b0feef5664aba9277577ff7cc563" gracePeriod=15
Jul 22 21:11:09.971664 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:09.971634    2576 generic.go:356] "Generic (PLEG): container finished" podID="26fa0780-0c3f-498b-86d5-a68bb410c48d" containerID="2c139daac1954c70a86f55cce1b7546a37d6b0feef5664aba9277577ff7cc563" exitCode=0
Jul 22 21:11:09.972034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:09.971704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b464cfb-tqbqt" event={"ID":"26fa0780-0c3f-498b-86d5-a68bb410c48d","Type":"ContainerDied","Data":"2c139daac1954c70a86f55cce1b7546a37d6b0feef5664aba9277577ff7cc563"}
Jul 22 21:11:09.973690 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:09.973654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xr2sq" event={"ID":"0749d8d5-b38f-49a7-9b26-be1dd674fa98","Type":"ContainerStarted","Data":"c2c8357464b8525a04fdc5a54dfb7afebedb54abc3a4142c67074ee74857ed7c"}
Jul 22 21:11:10.025327 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.025252    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:11:10.081178 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dljhk\" (UniqueName: \"kubernetes.io/projected/26fa0780-0c3f-498b-86d5-a68bb410c48d-kube-api-access-dljhk\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081346 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081205    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-oauth-config\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081346 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081260    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-service-ca\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081346 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081291    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-oauth-serving-cert\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081346 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-config\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081564 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081366    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-trusted-ca-bundle\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081564 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081389    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-serving-cert\") pod \"26fa0780-0c3f-498b-86d5-a68bb410c48d\" (UID: \"26fa0780-0c3f-498b-86d5-a68bb410c48d\") "
Jul 22 21:11:10.081824 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081736    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-service-ca" (OuterVolumeSpecName: "service-ca") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:10.081824 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:10.081962 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.081930    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:10.082117 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.082056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-config" (OuterVolumeSpecName: "console-config") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:10.083714 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.083689    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:10.084005 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.083984    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:10.084052 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.084000    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fa0780-0c3f-498b-86d5-a68bb410c48d-kube-api-access-dljhk" (OuterVolumeSpecName: "kube-api-access-dljhk") pod "26fa0780-0c3f-498b-86d5-a68bb410c48d" (UID: "26fa0780-0c3f-498b-86d5-a68bb410c48d"). InnerVolumeSpecName "kube-api-access-dljhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:10.182895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182852    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dljhk\" (UniqueName: \"kubernetes.io/projected/26fa0780-0c3f-498b-86d5-a68bb410c48d-kube-api-access-dljhk\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.182895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182893    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-oauth-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.182895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182902    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.182895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182911    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-oauth-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.182895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182919    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.183233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182928    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fa0780-0c3f-498b-86d5-a68bb410c48d-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.183233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.182936    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26fa0780-0c3f-498b-86d5-a68bb410c48d-console-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:10.978300 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.978266    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b464cfb-tqbqt"
Jul 22 21:11:10.978731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.978266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b464cfb-tqbqt" event={"ID":"26fa0780-0c3f-498b-86d5-a68bb410c48d","Type":"ContainerDied","Data":"3852da4a50e4c6a4f01f86060e78538e2c26862cdf77f15a5e463b7a16c84586"}
Jul 22 21:11:10.978731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.978425    2576 scope.go:117] "RemoveContainer" containerID="2c139daac1954c70a86f55cce1b7546a37d6b0feef5664aba9277577ff7cc563"
Jul 22 21:11:10.997706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:10.997677    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b464cfb-tqbqt"]
Jul 22 21:11:11.002421 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:11.002396    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79b464cfb-tqbqt"]
Jul 22 21:11:11.749619 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:11.749587    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26fa0780-0c3f-498b-86d5-a68bb410c48d" path="/var/lib/kubelet/pods/26fa0780-0c3f-498b-86d5-a68bb410c48d/volumes"
Jul 22 21:11:19.013829 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:19.013797    2576 generic.go:356] "Generic (PLEG): container finished" podID="5324b774-3afc-450b-81ab-a7f00bbdfbf9" containerID="a49254eee6382280ca3a41acf89efeb3389f4406f267f5079362b77e17852ebe" exitCode=0
Jul 22 21:11:19.014163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:19.013869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lb2vp" event={"ID":"5324b774-3afc-450b-81ab-a7f00bbdfbf9","Type":"ContainerDied","Data":"a49254eee6382280ca3a41acf89efeb3389f4406f267f5079362b77e17852ebe"}
Jul 22 21:11:19.014209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:19.014169    2576 scope.go:117] "RemoveContainer" containerID="a49254eee6382280ca3a41acf89efeb3389f4406f267f5079362b77e17852ebe"
Jul 22 21:11:20.019914 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:20.019879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-lb2vp" event={"ID":"5324b774-3afc-450b-81ab-a7f00bbdfbf9","Type":"ContainerStarted","Data":"89e84f6d2299d4b982b7d486c3f1e8632c23d8fba87bacc54dab9e746b171175"}
Jul 22 21:11:24.036035 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:24.036000    2576 generic.go:356] "Generic (PLEG): container finished" podID="49f296b7-68b2-4dc9-8581-b7045123b76d" containerID="1246bb0605abaae55a3827cdf9a67f3119dea7a980ec712ecb517542007c2785" exitCode=0
Jul 22 21:11:24.036458 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:24.036096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l" event={"ID":"49f296b7-68b2-4dc9-8581-b7045123b76d","Type":"ContainerDied","Data":"1246bb0605abaae55a3827cdf9a67f3119dea7a980ec712ecb517542007c2785"}
Jul 22 21:11:24.036458 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:24.036406    2576 scope.go:117] "RemoveContainer" containerID="1246bb0605abaae55a3827cdf9a67f3119dea7a980ec712ecb517542007c2785"
Jul 22 21:11:25.042973 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:25.042933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-b8c6l" event={"ID":"49f296b7-68b2-4dc9-8581-b7045123b76d","Type":"ContainerStarted","Data":"30074ed1d65db83e2bfed856061f04c5872d3e4005a7c80981e359947a36e150"}
Jul 22 21:11:36.722417 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:36.722384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:11:36.724820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:36.724800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5abe72-4167-40ef-a1de-c353e22e6ed4-metrics-certs\") pod \"network-metrics-daemon-4nxf6\" (UID: \"3e5abe72-4167-40ef-a1de-c353e22e6ed4\") " pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:11:36.848272 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:36.848246    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8629h\""
Jul 22 21:11:36.856283 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:36.856265    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4nxf6"
Jul 22 21:11:36.981993 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:36.981961    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4nxf6"]
Jul 22 21:11:36.984513 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:11:36.984488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5abe72_4167_40ef_a1de_c353e22e6ed4.slice/crio-a030971221ea80830d4f321eaf06b2ffeb00dcc35e600347c958c53f65c203f4 WatchSource:0}: Error finding container a030971221ea80830d4f321eaf06b2ffeb00dcc35e600347c958c53f65c203f4: Status 404 returned error can't find the container with id a030971221ea80830d4f321eaf06b2ffeb00dcc35e600347c958c53f65c203f4
Jul 22 21:11:37.092325 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:37.092293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4nxf6" event={"ID":"3e5abe72-4167-40ef-a1de-c353e22e6ed4","Type":"ContainerStarted","Data":"a030971221ea80830d4f321eaf06b2ffeb00dcc35e600347c958c53f65c203f4"}
Jul 22 21:11:39.100933 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:39.100892    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4nxf6" event={"ID":"3e5abe72-4167-40ef-a1de-c353e22e6ed4","Type":"ContainerStarted","Data":"e0a9125fac1daad0262b0ec6e967346966c28e616adee30da58141627fd7c29e"}
Jul 22 21:11:39.101304 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:39.100958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4nxf6" event={"ID":"3e5abe72-4167-40ef-a1de-c353e22e6ed4","Type":"ContainerStarted","Data":"5d774e310bd7ba94bb2e721c1b84a140d61993a52182f188da529bb99006eab7"}
Jul 22 21:11:39.117413 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:39.117372    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4nxf6" podStartSLOduration=374.002705162 podStartE2EDuration="6m15.117358087s" totalImagesPullingTime="1.114652925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:11:39.117201915 +0000 UTC m=+375.900103732" watchObservedRunningTime="2026-07-22 21:11:39.117358087 +0000 UTC m=+375.900259903"
Jul 22 21:11:41.581022 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:41.580985    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:11:41.599762 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:41.599738    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:11:42.128282 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:42.128254    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:11:59.594159 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594125    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:11:59.594768 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594714    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="prometheus" containerID="cri-o://f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5" gracePeriod=600
Jul 22 21:11:59.594888 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594817    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981" gracePeriod=600
Jul 22 21:11:59.594955 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594754    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy" containerID="cri-o://c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79" gracePeriod=600
Jul 22 21:11:59.594955 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594776    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="thanos-sidecar" containerID="cri-o://daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562" gracePeriod=600
Jul 22 21:11:59.595045 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594807    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="config-reloader" containerID="cri-o://fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5" gracePeriod=600
Jul 22 21:11:59.595045 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.594797    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-web" containerID="cri-o://091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634" gracePeriod=600
Jul 22 21:11:59.851847 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.851784    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:11:59.914580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914548    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-grpc-tls\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-1\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-kube-rbac-proxy\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914639    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-metrics-client-ca\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914674    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-tls\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-thanos-prometheus-http-client-file\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914724    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtkqb\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-kube-api-access-vtkqb\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.914809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-web-config\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914849    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-kubelet-serving-ca-bundle\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-0\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914914    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-2\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config-out\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914947    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-db\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.915000    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.915031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-tls-assets\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915292 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.915059    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-metrics-client-certs\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:11:59.915877 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.915351    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:11:59.917338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.914969    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:59.917338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.916055    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:59.917338 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.916313    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:59.917599 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.917545    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.917806 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.917781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.917902 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.917825    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:11:59.918407 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.918377    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.918556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.918532    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:11:59.919181 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.919145    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.919970 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.919942    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.920889 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.920868    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.920889 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.920877    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:59.921016 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.920934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.921242 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.921224    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config" (OuterVolumeSpecName: "config") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:11:59.921305 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.921245    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-kube-api-access-vtkqb" (OuterVolumeSpecName: "kube-api-access-vtkqb") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "kube-api-access-vtkqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:11:59.922209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.922190    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config-out" (OuterVolumeSpecName: "config-out") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:11:59.930535 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:11:59.930512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-web-config" (OuterVolumeSpecName: "web-config") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:12:00.016096 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-serving-certs-ca-bundle\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:12:00.016208 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016111    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-trusted-ca-bundle\") pod \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\" (UID: \"4aef01aa-06d0-4d44-ad86-79fd0df6df36\") "
Jul 22 21:12:00.016367 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:12:00.016443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016370    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016387    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016400    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016413    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config-out\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016425    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-k8s-db\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016443 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016437    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016449    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-tls-assets\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4aef01aa-06d0-4d44-ad86-79fd0df6df36" (UID: "4aef01aa-06d0-4d44-ad86-79fd0df6df36"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016460    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-metrics-client-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016505    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-grpc-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016523    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-kube-rbac-proxy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016542    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-metrics-client-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016557    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016571    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016585    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016599    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtkqb\" (UniqueName: \"kubernetes.io/projected/4aef01aa-06d0-4d44-ad86-79fd0df6df36-kube-api-access-vtkqb\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016614    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.016704 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.016654    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4aef01aa-06d0-4d44-ad86-79fd0df6df36-web-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.117326 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.117259    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.117326 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.117281    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aef01aa-06d0-4d44-ad86-79fd0df6df36-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:12:00.190815 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190787    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981" exitCode=0
Jul 22 21:12:00.190815 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190810    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79" exitCode=0
Jul 22 21:12:00.190815 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190816    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634" exitCode=0
Jul 22 21:12:00.190985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190824    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562" exitCode=0
Jul 22 21:12:00.190985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190830    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5" exitCode=0
Jul 22 21:12:00.190985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190836    2576 generic.go:356] "Generic (PLEG): container finished" podID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5" exitCode=0
Jul 22 21:12:00.190985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190867    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.190985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"}
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.190997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"}
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.191025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"}
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.191051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"}
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.191060    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.191089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"}
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.191113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"}
Jul 22 21:12:00.191148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.191137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4aef01aa-06d0-4d44-ad86-79fd0df6df36","Type":"ContainerDied","Data":"33d8f9427f6a2f652b32c12a7f6cef01e6152b39e5cfa288047338362859760d"}
Jul 22 21:12:00.199003 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.198988    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.205941 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.205926    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.212966 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.212943    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.214161 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.214123    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:12:00.219867 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.219849    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:12:00.220126 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.220111    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.226484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.226472    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.233598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.233583    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.240228 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240210    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.240481 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.240465    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.240527 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240489    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"} err="failed to get container status \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist"
Jul 22 21:12:00.240527 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240506    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.240720 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.240703    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.240766 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240727    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"} err="failed to get container status \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist"
Jul 22 21:12:00.240766 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240742    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.240950 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.240931    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.241012 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240959    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"} err="failed to get container status \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist"
Jul 22 21:12:00.241012 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.240983    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.241212 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.241198    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.241278 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241216    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"} err="failed to get container status \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist"
Jul 22 21:12:00.241278 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241229    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.241423 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.241411    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.241464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241426    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"} err="failed to get container status \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist"
Jul 22 21:12:00.241464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241437    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.241618 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.241601    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.241681 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241624    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"} err="failed to get container status \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist"
Jul 22 21:12:00.241681 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241643    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.241856 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:12:00.241843    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.241895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241858    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"} err="failed to get container status \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist"
Jul 22 21:12:00.241895 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.241872    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.242363 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.242340    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"} err="failed to get container status \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist"
Jul 22 21:12:00.242417 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.242365    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.242597 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.242578    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"} err="failed to get container status \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist"
Jul 22 21:12:00.242666 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.242598    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.242810 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.242789    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"} err="failed to get container status \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist"
Jul 22 21:12:00.242855 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.242813    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.243024 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243006    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"} err="failed to get container status \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist"
Jul 22 21:12:00.243062 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243025    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.243234 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243219    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"} err="failed to get container status \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist"
Jul 22 21:12:00.243271 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243236    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.243444 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243427    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"} err="failed to get container status \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist"
Jul 22 21:12:00.243487 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243445    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.243646 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243629    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"} err="failed to get container status \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist"
Jul 22 21:12:00.243686 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243647    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.243835 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243818    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"} err="failed to get container status \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist"
Jul 22 21:12:00.243880 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243835    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.244004 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.243989    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"} err="failed to get container status \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist"
Jul 22 21:12:00.244049 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244004    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.244218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244196    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"} err="failed to get container status \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist"
Jul 22 21:12:00.244218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244209    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.244438 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244421    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"} err="failed to get container status \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist"
Jul 22 21:12:00.244491 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244440    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.244651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244633    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"} err="failed to get container status \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist"
Jul 22 21:12:00.244686 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244653    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.244874 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244857    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"} err="failed to get container status \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist"
Jul 22 21:12:00.244916 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.244875    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.245102 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245083    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"} err="failed to get container status \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist"
Jul 22 21:12:00.245159 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245103    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.245317 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245300    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"} err="failed to get container status \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist"
Jul 22 21:12:00.245371 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245320    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.245505 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245490    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"} err="failed to get container status \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist"
Jul 22 21:12:00.245549 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245506    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.245707 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245688    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"} err="failed to get container status \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist"
Jul 22 21:12:00.245768 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245709    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.245926 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245910    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"} err="failed to get container status \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist"
Jul 22 21:12:00.245989 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.245927    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.246167 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246145    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"} err="failed to get container status \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist"
Jul 22 21:12:00.246242 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246168    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.246413 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246397    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"} err="failed to get container status \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist"
Jul 22 21:12:00.246461 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246414    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.246640 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246626    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"} err="failed to get container status \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist"
Jul 22 21:12:00.246692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246640    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.246843 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246825    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"} err="failed to get container status \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist"
Jul 22 21:12:00.246933 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.246842    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.247034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247020    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"} err="failed to get container status \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist"
Jul 22 21:12:00.247104 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247035    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.247243 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247220    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"} err="failed to get container status \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist"
Jul 22 21:12:00.247288 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247243    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.247531 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247485    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"} err="failed to get container status \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist"
Jul 22 21:12:00.247531 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247508    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.247841 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247816    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"} err="failed to get container status \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist"
Jul 22 21:12:00.247841 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.247843    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.248276 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.248252    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"} err="failed to get container status \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist"
Jul 22 21:12:00.248276 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.248273    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.248538 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.248520    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"} err="failed to get container status \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist"
Jul 22 21:12:00.248618 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.248570    2576 scope.go:117] "RemoveContainer" containerID="c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"
Jul 22 21:12:00.248851 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.248833    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981"} err="failed to get container status \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": rpc error: code = NotFound desc = could not find container \"c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981\": container with ID starting with c9b8198f31b0133ac5ca3ea9cfc5fe0f983bb659eb8099c2fcf338178b72f981 not found: ID does not exist"
Jul 22 21:12:00.248928 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.248852    2576 scope.go:117] "RemoveContainer" containerID="c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"
Jul 22 21:12:00.249138 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249112    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79"} err="failed to get container status \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": rpc error: code = NotFound desc = could not find container \"c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79\": container with ID starting with c6e4c194a19e873ef30ead7f80e16cd939e50b81ba461de223626227c44a9b79 not found: ID does not exist"
Jul 22 21:12:00.249198 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249139    2576 scope.go:117] "RemoveContainer" containerID="091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"
Jul 22 21:12:00.249348 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249329    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634"} err="failed to get container status \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": rpc error: code = NotFound desc = could not find container \"091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634\": container with ID starting with 091fba3d6b8e4d67a66d1797402f9ff81a5e246a8ef33414a264ae76e43a7634 not found: ID does not exist"
Jul 22 21:12:00.249410 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249350    2576 scope.go:117] "RemoveContainer" containerID="daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"
Jul 22 21:12:00.249522 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249503    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:12:00.249611 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249536    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562"} err="failed to get container status \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": rpc error: code = NotFound desc = could not find container \"daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562\": container with ID starting with daa81b6a785a6cbdb68159896c6dbd5a5a8e06eff881d23cd8a9f9a5187ed562 not found: ID does not exist"
Jul 22 21:12:00.249611 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249552    2576 scope.go:117] "RemoveContainer" containerID="fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"
Jul 22 21:12:00.249784 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249768    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5"} err="failed to get container status \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": rpc error: code = NotFound desc = could not find container \"fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5\": container with ID starting with fa62ddcd8a0b1bb60228d45570ebacbdf2b7b315444d2f7d0d78d7fdbbc358d5 not found: ID does not exist"
Jul 22 21:12:00.249854 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249791    2576 scope.go:117] "RemoveContainer" containerID="f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"
Jul 22 21:12:00.249854 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249774    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-web"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249853    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-web"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249881    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="prometheus"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249891    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="prometheus"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249908    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="init-config-reloader"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249916    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="init-config-reloader"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249925    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249933    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249946    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="thanos-sidecar"
Jul 22 21:12:00.249951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249953    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="thanos-sidecar"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-thanos"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249982    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-thanos"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.249993    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082" containerName="registry"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250000    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082" containerName="registry"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250008    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fa0780-0c3f-498b-86d5-a68bb410c48d" containerName="console"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250016    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fa0780-0c3f-498b-86d5-a68bb410c48d" containerName="console"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250025    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="config-reloader"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250032    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="config-reloader"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250048    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d23160-5963-4aa3-87ae-346257fca92a" containerName="console"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250055    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d23160-5963-4aa3-87ae-346257fca92a" containerName="console"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250012    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5"} err="failed to get container status \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": rpc error: code = NotFound desc = could not find container \"f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5\": container with ID starting with f75041f86a542a4df634dde5a1b3ebf40674bcd2d573cad7fd49cee300aaceb5 not found: ID does not exist"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250094    2576 scope.go:117] "RemoveContainer" containerID="c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250163    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fa0780-0c3f-498b-86d5-a68bb410c48d" containerName="console"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250179    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="config-reloader"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250190    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250200    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-web"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250208    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="kube-rbac-proxy-thanos"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250218    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d23160-5963-4aa3-87ae-346257fca92a" containerName="console"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250226    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="prometheus"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250236    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" containerName="thanos-sidecar"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250244    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e08d3017-87d9-4690-9530-0fd1e00ad082" containerName="registry"
Jul 22 21:12:00.250381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.250293    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6"} err="failed to get container status \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": rpc error: code = NotFound desc = could not find container \"c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6\": container with ID starting with c87511bafea2e0cab9b02a6bbd2e57141603a03219cf4a9bf3e0b95ac61541a6 not found: ID does not exist"
Jul 22 21:12:00.256845 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.256826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.259475 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 21:12:00.259591 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 21:12:00.259669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259575    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 21:12:00.259669 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259654    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5c7na8bchdv9j\""
Jul 22 21:12:00.259812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 21:12:00.259812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259681    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 21:12:00.259812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259691    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4mm6b\""
Jul 22 21:12:00.259812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 21:12:00.260000 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.259824    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 21:12:00.260097 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.260027    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 21:12:00.260139 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.260108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 21:12:00.260190 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.260108    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 21:12:00.260190 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.260151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 21:12:00.260299 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.260226    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 21:12:00.260299 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.260257    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 21:12:00.263052 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.263035    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 21:12:00.265109 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.265091    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 21:12:00.269843 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.269824    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:12:00.318322 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08e3f7a5-4c5d-4410-a2ec-85509667fba7-config-out\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318322 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn4mr\" (UniqueName: \"kubernetes.io/projected/08e3f7a5-4c5d-4410-a2ec-85509667fba7-kube-api-access-cn4mr\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08e3f7a5-4c5d-4410-a2ec-85509667fba7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.318739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-config\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.319019 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-web-config\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.319019 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.318843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.419696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08e3f7a5-4c5d-4410-a2ec-85509667fba7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.419696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-config\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.419696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-web-config\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.419911 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.419911 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08e3f7a5-4c5d-4410-a2ec-85509667fba7-config-out\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.419911 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420094 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.419927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420260 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420364 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420364 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420364 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420515 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420515 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4mr\" (UniqueName: \"kubernetes.io/projected/08e3f7a5-4c5d-4410-a2ec-85509667fba7-kube-api-access-cn4mr\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420626 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.420926 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.420248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.421188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.421459    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.421848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.421972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.422092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.422556 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.422485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.423671 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.423643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.424180 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.424157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.424344 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.424326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08e3f7a5-4c5d-4410-a2ec-85509667fba7-config-out\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.424720 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.424694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-config\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.424720 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.424717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.424866 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.424843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.425282 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.425262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08e3f7a5-4c5d-4410-a2ec-85509667fba7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.425361 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.425284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.425361 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.425290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.425361 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.425345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-web-config\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.425532 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.425512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08e3f7a5-4c5d-4410-a2ec-85509667fba7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.426479 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.426454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08e3f7a5-4c5d-4410-a2ec-85509667fba7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.430887 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.430866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn4mr\" (UniqueName: \"kubernetes.io/projected/08e3f7a5-4c5d-4410-a2ec-85509667fba7-kube-api-access-cn4mr\") pod \"prometheus-k8s-0\" (UID: \"08e3f7a5-4c5d-4410-a2ec-85509667fba7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.567154 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.567128    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:12:00.741145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:00.738510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 21:12:00.744762 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:12:00.744733    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e3f7a5_4c5d_4410_a2ec_85509667fba7.slice/crio-cffb36f8d8b57e6b32300582f77388b1326b8e48fcd833721dbcf2a57137b295 WatchSource:0}: Error finding container cffb36f8d8b57e6b32300582f77388b1326b8e48fcd833721dbcf2a57137b295: Status 404 returned error can't find the container with id cffb36f8d8b57e6b32300582f77388b1326b8e48fcd833721dbcf2a57137b295
Jul 22 21:12:01.199412 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:01.199375    2576 generic.go:356] "Generic (PLEG): container finished" podID="08e3f7a5-4c5d-4410-a2ec-85509667fba7" containerID="665980ff77386617ad6af79d2560de3d82e346167df93e03473d169eb40b8e8e" exitCode=0
Jul 22 21:12:01.199580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:01.199458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerDied","Data":"665980ff77386617ad6af79d2560de3d82e346167df93e03473d169eb40b8e8e"}
Jul 22 21:12:01.199580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:01.199518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"cffb36f8d8b57e6b32300582f77388b1326b8e48fcd833721dbcf2a57137b295"}
Jul 22 21:12:01.752219 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:01.752139    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aef01aa-06d0-4d44-ad86-79fd0df6df36" path="/var/lib/kubelet/pods/4aef01aa-06d0-4d44-ad86-79fd0df6df36/volumes"
Jul 22 21:12:02.207771 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.207740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"1010a9026f6eabdbe9ff8a05d880353e88bfc9916ae7f3b0968e878c5030b48e"}
Jul 22 21:12:02.207936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.207796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"96c846376bfa8d72c5374bac7d4041e569022aa0757fcad8fc518769d007fcfc"}
Jul 22 21:12:02.207936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.207821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"87de8b6d1932cec624fd4d8e829846b66adf8a24789384ee4f48b2cd9e483f36"}
Jul 22 21:12:02.207936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.207843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"79011009201f12ed60889315c569c42aba2006ab5caa4bb3e172488efd68fe7f"}
Jul 22 21:12:02.207936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.207868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"bc1a22904e65e3654a2f21f2df3f996052cf92b3006475c6a7ad3e5b587eac97"}
Jul 22 21:12:02.207936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.207889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08e3f7a5-4c5d-4410-a2ec-85509667fba7","Type":"ContainerStarted","Data":"4cacea26915a7a43ad6ce5edab435c4d84ae07569c3f02e4a33bd372d8005e4f"}
Jul 22 21:12:02.238645 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:02.238588    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.220630868 podStartE2EDuration="2.238566768s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.9359ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:12:02.235839856 +0000 UTC m=+399.018741683" watchObservedRunningTime="2026-07-22 21:12:02.238566768 +0000 UTC m=+399.021468588"
Jul 22 21:12:05.567325 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:12:05.567284    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:13:00.568147 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:00.568109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:13:00.583927 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:00.583904    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:13:01.452765 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:01.452736    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 21:13:31.610358 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.610329    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2459l"]
Jul 22 21:13:31.614729 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.614700    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.617775 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.617753    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pqxnz\""
Jul 22 21:13:31.617879 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.617761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 21:13:31.618747 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.618734    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 21:13:31.622060 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.622046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2459l"]
Jul 22 21:13:31.629852 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.629834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/378b5bf4-05a4-4899-b3e1-c4e6913c0778-bound-sa-token\") pod \"cert-manager-55b4d954d5-2459l\" (UID: \"378b5bf4-05a4-4899-b3e1-c4e6913c0778\") " pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.629938 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.629865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ppvl\" (UniqueName: \"kubernetes.io/projected/378b5bf4-05a4-4899-b3e1-c4e6913c0778-kube-api-access-5ppvl\") pod \"cert-manager-55b4d954d5-2459l\" (UID: \"378b5bf4-05a4-4899-b3e1-c4e6913c0778\") " pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.730600 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.730571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/378b5bf4-05a4-4899-b3e1-c4e6913c0778-bound-sa-token\") pod \"cert-manager-55b4d954d5-2459l\" (UID: \"378b5bf4-05a4-4899-b3e1-c4e6913c0778\") " pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.730722 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.730616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ppvl\" (UniqueName: \"kubernetes.io/projected/378b5bf4-05a4-4899-b3e1-c4e6913c0778-kube-api-access-5ppvl\") pod \"cert-manager-55b4d954d5-2459l\" (UID: \"378b5bf4-05a4-4899-b3e1-c4e6913c0778\") " pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.740558 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.740530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/378b5bf4-05a4-4899-b3e1-c4e6913c0778-bound-sa-token\") pod \"cert-manager-55b4d954d5-2459l\" (UID: \"378b5bf4-05a4-4899-b3e1-c4e6913c0778\") " pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.740653 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.740601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ppvl\" (UniqueName: \"kubernetes.io/projected/378b5bf4-05a4-4899-b3e1-c4e6913c0778-kube-api-access-5ppvl\") pod \"cert-manager-55b4d954d5-2459l\" (UID: \"378b5bf4-05a4-4899-b3e1-c4e6913c0778\") " pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:31.933573 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:31.933483    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2459l"
Jul 22 21:13:32.058828 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:32.058806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2459l"]
Jul 22 21:13:32.061010 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:13:32.060975    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod378b5bf4_05a4_4899_b3e1_c4e6913c0778.slice/crio-e7e6d3d7a782214352de2dfb2ebb4fa1dc20368e2b4cc7bcb5777b8837174a9a WatchSource:0}: Error finding container e7e6d3d7a782214352de2dfb2ebb4fa1dc20368e2b4cc7bcb5777b8837174a9a: Status 404 returned error can't find the container with id e7e6d3d7a782214352de2dfb2ebb4fa1dc20368e2b4cc7bcb5777b8837174a9a
Jul 22 21:13:32.552589 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:32.552556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2459l" event={"ID":"378b5bf4-05a4-4899-b3e1-c4e6913c0778","Type":"ContainerStarted","Data":"e7e6d3d7a782214352de2dfb2ebb4fa1dc20368e2b4cc7bcb5777b8837174a9a"}
Jul 22 21:13:35.567936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:35.567855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2459l" event={"ID":"378b5bf4-05a4-4899-b3e1-c4e6913c0778","Type":"ContainerStarted","Data":"d59263e7ba2ccd814afbaaf263157c795c7e6ff46124b3b7505537df363c1709"}
Jul 22 21:13:35.584100 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:35.584022    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2459l" podStartSLOduration=1.368652492 podStartE2EDuration="4.58400847s" totalImagesPullingTime="3.215355978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:13:35.583180283 +0000 UTC m=+492.366082096" watchObservedRunningTime="2026-07-22 21:13:35.58400847 +0000 UTC m=+492.366910286"
Jul 22 21:13:45.134234 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.134201    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"]
Jul 22 21:13:45.137384 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.137368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.140110 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.140063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 21:13:45.141247 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.141228    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 21:13:45.141355 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.141278    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dsg6t\""
Jul 22 21:13:45.145432 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.145410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"]
Jul 22 21:13:45.242096 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.242038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44-tmp\") pod \"openshift-lws-operator-fd8ccff4c-87q77\" (UID: \"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.242263 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.242110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj67k\" (UniqueName: \"kubernetes.io/projected/53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44-kube-api-access-cj67k\") pod \"openshift-lws-operator-fd8ccff4c-87q77\" (UID: \"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.343397 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.343367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44-tmp\") pod \"openshift-lws-operator-fd8ccff4c-87q77\" (UID: \"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.343397 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.343401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj67k\" (UniqueName: \"kubernetes.io/projected/53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44-kube-api-access-cj67k\") pod \"openshift-lws-operator-fd8ccff4c-87q77\" (UID: \"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.343809 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.343791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44-tmp\") pod \"openshift-lws-operator-fd8ccff4c-87q77\" (UID: \"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.352868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.352848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj67k\" (UniqueName: \"kubernetes.io/projected/53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44-kube-api-access-cj67k\") pod \"openshift-lws-operator-fd8ccff4c-87q77\" (UID: \"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.446737 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.446659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"
Jul 22 21:13:45.571010 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.570986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77"]
Jul 22 21:13:45.573797 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:13:45.573770    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53bd93aa_e2a2_4a43_a7ea_0f6d7810ec44.slice/crio-24e95b5e1cf7b677033534e96e69df9e5b1ecd7c45b62e63626f8c1a8426d0f5 WatchSource:0}: Error finding container 24e95b5e1cf7b677033534e96e69df9e5b1ecd7c45b62e63626f8c1a8426d0f5: Status 404 returned error can't find the container with id 24e95b5e1cf7b677033534e96e69df9e5b1ecd7c45b62e63626f8c1a8426d0f5
Jul 22 21:13:45.605923 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:45.605895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77" event={"ID":"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44","Type":"ContainerStarted","Data":"24e95b5e1cf7b677033534e96e69df9e5b1ecd7c45b62e63626f8c1a8426d0f5"}
Jul 22 21:13:48.621873 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:48.621836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77" event={"ID":"53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44","Type":"ContainerStarted","Data":"7b9db71b820f7ec3e791ad86e797fdd36b2a4e5d3a9865b9dab3bf46715a3333"}
Jul 22 21:13:48.638391 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:48.638337    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-87q77" podStartSLOduration=1.045659504 podStartE2EDuration="3.638318361s" totalImagesPullingTime="2.592658857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:13:48.638276721 +0000 UTC m=+505.421178601" watchObservedRunningTime="2026-07-22 21:13:48.638318361 +0000 UTC m=+505.421220179"
Jul 22 21:13:55.496471 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.496433    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"]
Jul 22 21:13:55.499875 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.499860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.503692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.503665    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hrbzb\""
Jul 22 21:13:55.503692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.503690    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 21:13:55.503863 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.503666    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 21:13:55.503863 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.503670    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 21:13:55.509613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.509594    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"]
Jul 22 21:13:55.624119 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.624060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-cert\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.624119 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.624110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-metrics-cert\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.624378 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.624244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tczx\" (UniqueName: \"kubernetes.io/projected/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-kube-api-access-6tczx\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.624378 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.624272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-manager-config\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.724865 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.724836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tczx\" (UniqueName: \"kubernetes.io/projected/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-kube-api-access-6tczx\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.724865 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.724869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-manager-config\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.725092 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.724901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-cert\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.725092 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.724916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-metrics-cert\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.725534 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.725506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-manager-config\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.727355 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.727327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-cert\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.727458 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.727401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-metrics-cert\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.735501 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.735481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tczx\" (UniqueName: \"kubernetes.io/projected/976d3ff8-dc19-48bd-bb38-ef0c373ddbe3-kube-api-access-6tczx\") pod \"lws-controller-manager-795d667875-dvzbb\" (UID: \"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3\") " pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.808694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.808625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:55.945199 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:55.945155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"]
Jul 22 21:13:55.947874 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:13:55.947852    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976d3ff8_dc19_48bd_bb38_ef0c373ddbe3.slice/crio-b265ad43a4ee64270202c1a81769711de5e354f3df03ecc6f5be27a3f8d610be WatchSource:0}: Error finding container b265ad43a4ee64270202c1a81769711de5e354f3df03ecc6f5be27a3f8d610be: Status 404 returned error can't find the container with id b265ad43a4ee64270202c1a81769711de5e354f3df03ecc6f5be27a3f8d610be
Jul 22 21:13:56.654846 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:56.654808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb" event={"ID":"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3","Type":"ContainerStarted","Data":"b265ad43a4ee64270202c1a81769711de5e354f3df03ecc6f5be27a3f8d610be"}
Jul 22 21:13:57.660455 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:57.660375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb" event={"ID":"976d3ff8-dc19-48bd-bb38-ef0c373ddbe3","Type":"ContainerStarted","Data":"6af058c5353197a39db692d5e46a57139db88f03eb7c01cea26456e81ec44f49"}
Jul 22 21:13:57.660785 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:57.660455    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:13:57.678596 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:13:57.678550    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb" podStartSLOduration=1.248791705 podStartE2EDuration="2.678536391s" totalImagesPullingTime="1.429744686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:13:57.677206054 +0000 UTC m=+514.460107905" watchObservedRunningTime="2026-07-22 21:13:57.678536391 +0000 UTC m=+514.461438269"
Jul 22 21:14:06.089773 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.089744    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"]
Jul 22 21:14:06.096624 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.096604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.099050 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.099025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 21:14:06.099299 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.099280    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 21:14:06.099299 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.099296    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 21:14:06.099440 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.099327    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q65kp\""
Jul 22 21:14:06.099554 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.099541    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 21:14:06.106780 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.106760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"]
Jul 22 21:14:06.207915 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.207887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1aa37c21-d63e-4ecf-a926-382b2073304e-manifests\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.208034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.207924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aa37c21-d63e-4ecf-a926-382b2073304e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.208034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.207949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlc5\" (UniqueName: \"kubernetes.io/projected/1aa37c21-d63e-4ecf-a926-382b2073304e-kube-api-access-6hlc5\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.208034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.207966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aa37c21-d63e-4ecf-a926-382b2073304e-tmp\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.208034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.208004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1aa37c21-d63e-4ecf-a926-382b2073304e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.308831 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.308802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1aa37c21-d63e-4ecf-a926-382b2073304e-manifests\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.308974 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.308847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aa37c21-d63e-4ecf-a926-382b2073304e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.308974 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.308884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlc5\" (UniqueName: \"kubernetes.io/projected/1aa37c21-d63e-4ecf-a926-382b2073304e-kube-api-access-6hlc5\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.308974 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.308907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aa37c21-d63e-4ecf-a926-382b2073304e-tmp\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.308974 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.308940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1aa37c21-d63e-4ecf-a926-382b2073304e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.309267 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.309245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1aa37c21-d63e-4ecf-a926-382b2073304e-manifests\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.311203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.311182    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aa37c21-d63e-4ecf-a926-382b2073304e-tmp\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.311491 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.311473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1aa37c21-d63e-4ecf-a926-382b2073304e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.311552 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.311489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aa37c21-d63e-4ecf-a926-382b2073304e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.316520 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.316497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlc5\" (UniqueName: \"kubernetes.io/projected/1aa37c21-d63e-4ecf-a926-382b2073304e-kube-api-access-6hlc5\") pod \"opendatahub-operator-controller-manager-5b88fc4594-264jv\" (UID: \"1aa37c21-d63e-4ecf-a926-382b2073304e\") " pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.407609 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.407546    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:06.539421 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.539392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"]
Jul 22 21:14:06.544538 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:14:06.544515    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa37c21_d63e_4ecf_a926_382b2073304e.slice/crio-2974126018c89699488c9f0686a99391b44b5e336f6800a62177c60e1d1bf00c WatchSource:0}: Error finding container 2974126018c89699488c9f0686a99391b44b5e336f6800a62177c60e1d1bf00c: Status 404 returned error can't find the container with id 2974126018c89699488c9f0686a99391b44b5e336f6800a62177c60e1d1bf00c
Jul 22 21:14:06.698343 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:06.698282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv" event={"ID":"1aa37c21-d63e-4ecf-a926-382b2073304e","Type":"ContainerStarted","Data":"2974126018c89699488c9f0686a99391b44b5e336f6800a62177c60e1d1bf00c"}
Jul 22 21:14:08.666662 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:08.666637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-795d667875-dvzbb"
Jul 22 21:14:10.718691 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:10.718657    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv" event={"ID":"1aa37c21-d63e-4ecf-a926-382b2073304e","Type":"ContainerStarted","Data":"2e2e4ddf4512970bdaa58d5b1fb1d1838981adb7ae3a6d9e6205e076b2e9b42e"}
Jul 22 21:14:11.723816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:11.723785    2576 generic.go:356] "Generic (PLEG): container finished" podID="1aa37c21-d63e-4ecf-a926-382b2073304e" containerID="2e2e4ddf4512970bdaa58d5b1fb1d1838981adb7ae3a6d9e6205e076b2e9b42e" exitCode=0
Jul 22 21:14:11.723816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:11.723818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv" event={"ID":"1aa37c21-d63e-4ecf-a926-382b2073304e","Type":"ContainerDied","Data":"2e2e4ddf4512970bdaa58d5b1fb1d1838981adb7ae3a6d9e6205e076b2e9b42e"}
Jul 22 21:14:12.730200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:12.730167    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv" event={"ID":"1aa37c21-d63e-4ecf-a926-382b2073304e","Type":"ContainerStarted","Data":"ddaa909b55b53bd3d45bc23217e295741017395500888c5d03ec5896f888a6c0"}
Jul 22 21:14:12.730569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:12.730236    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:12.753418 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:12.751946    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv" podStartSLOduration=1.738879155 podStartE2EDuration="6.751928568s" totalImagesPullingTime="4.051847376s" totalInitContainerRuntime="961.202037ms" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:12.751583185 +0000 UTC m=+529.534485036" watchObservedRunningTime="2026-07-22 21:14:12.751928568 +0000 UTC m=+529.534830384"
Jul 22 21:14:23.737321 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:23.737254    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b88fc4594-264jv"
Jul 22 21:14:25.981112 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.981059    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"]
Jul 22 21:14:25.985865 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.985842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:25.988582 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.988558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 21:14:25.988708 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.988563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 21:14:25.988708 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.988567    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 21:14:25.988708 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.988658    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 21:14:25.989775 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.989757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sx866\""
Jul 22 21:14:25.993675 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:25.993655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"]
Jul 22 21:14:26.070348 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.070321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpnnt\" (UniqueName: \"kubernetes.io/projected/4004b070-de6b-4d38-ba4c-e0b2787c6847-kube-api-access-cpnnt\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.070507 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.070363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4004b070-de6b-4d38-ba4c-e0b2787c6847-tls-certs\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.070507 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.070381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4004b070-de6b-4d38-ba4c-e0b2787c6847-tmp\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.171610 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.171582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4004b070-de6b-4d38-ba4c-e0b2787c6847-tls-certs\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.171610 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.171610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4004b070-de6b-4d38-ba4c-e0b2787c6847-tmp\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.171803 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.171667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpnnt\" (UniqueName: \"kubernetes.io/projected/4004b070-de6b-4d38-ba4c-e0b2787c6847-kube-api-access-cpnnt\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.173954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.173931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4004b070-de6b-4d38-ba4c-e0b2787c6847-tmp\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.174207 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.174191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4004b070-de6b-4d38-ba4c-e0b2787c6847-tls-certs\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.180567 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.180544    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpnnt\" (UniqueName: \"kubernetes.io/projected/4004b070-de6b-4d38-ba4c-e0b2787c6847-kube-api-access-cpnnt\") pod \"kube-auth-proxy-7f89f554cd-dw2fg\" (UID: \"4004b070-de6b-4d38-ba4c-e0b2787c6847\") " pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.297647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.297566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"
Jul 22 21:14:26.439007 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.438981    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg"]
Jul 22 21:14:26.441117 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:14:26.441054    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4004b070_de6b_4d38_ba4c_e0b2787c6847.slice/crio-a35f0d433d5a2aef7a165028c15b23ceb23ac80ae47e8e9aa285ae5a03bfb563 WatchSource:0}: Error finding container a35f0d433d5a2aef7a165028c15b23ceb23ac80ae47e8e9aa285ae5a03bfb563: Status 404 returned error can't find the container with id a35f0d433d5a2aef7a165028c15b23ceb23ac80ae47e8e9aa285ae5a03bfb563
Jul 22 21:14:26.790275 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:26.790237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg" event={"ID":"4004b070-de6b-4d38-ba4c-e0b2787c6847","Type":"ContainerStarted","Data":"a35f0d433d5a2aef7a165028c15b23ceb23ac80ae47e8e9aa285ae5a03bfb563"}
Jul 22 21:14:29.804907 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:29.804872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg" event={"ID":"4004b070-de6b-4d38-ba4c-e0b2787c6847","Type":"ContainerStarted","Data":"f02fb2dffff93b38d54b590adb536bde332edbcc4f538a4982afcacdf392f582"}
Jul 22 21:14:29.823291 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:14:29.823221    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f89f554cd-dw2fg" podStartSLOduration=2.20553388 podStartE2EDuration="4.823189968s" totalImagesPullingTime="2.617656088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:14:29.821171373 +0000 UTC m=+546.604073191" watchObservedRunningTime="2026-07-22 21:14:29.823189968 +0000 UTC m=+546.606091787"
Jul 22 21:15:23.679085 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:15:23.679042    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:15:23.679085 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:15:23.679046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:15:23.682533 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:15:23.682511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:15:23.682533 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:15:23.682519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:16:19.223427 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.223387    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"]
Jul 22 21:16:19.226788 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.226769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.229460 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.229429    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 21:16:19.229575 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.229478    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 21:16:19.229575 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.229497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 21:16:19.230676 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.230661    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-269gt\""
Jul 22 21:16:19.230768 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.230693    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 21:16:19.234613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.234591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"]
Jul 22 21:16:19.304633 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.304587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84729\" (UniqueName: \"kubernetes.io/projected/9378b223-5299-453d-8b09-f4985f68cd80-kube-api-access-84729\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.304633 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.304624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9378b223-5299-453d-8b09-f4985f68cd80-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.304836 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.304722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9378b223-5299-453d-8b09-f4985f68cd80-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.405837 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.405804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9378b223-5299-453d-8b09-f4985f68cd80-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.406021 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.405851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84729\" (UniqueName: \"kubernetes.io/projected/9378b223-5299-453d-8b09-f4985f68cd80-kube-api-access-84729\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.406021 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.405870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9378b223-5299-453d-8b09-f4985f68cd80-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.406021 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:16:19.405958    2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 21:16:19.406177 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:16:19.406030    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9378b223-5299-453d-8b09-f4985f68cd80-plugin-serving-cert podName:9378b223-5299-453d-8b09-f4985f68cd80 nodeName:}" failed. No retries permitted until 2026-07-22 21:16:19.906010952 +0000 UTC m=+656.688912764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9378b223-5299-453d-8b09-f4985f68cd80-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-lrplg" (UID: "9378b223-5299-453d-8b09-f4985f68cd80") : secret "plugin-serving-cert" not found
Jul 22 21:16:19.406520 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.406502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9378b223-5299-453d-8b09-f4985f68cd80-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.414429 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.414405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84729\" (UniqueName: \"kubernetes.io/projected/9378b223-5299-453d-8b09-f4985f68cd80-kube-api-access-84729\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.909140 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.909108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9378b223-5299-453d-8b09-f4985f68cd80-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:19.911589 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:19.911571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9378b223-5299-453d-8b09-f4985f68cd80-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lrplg\" (UID: \"9378b223-5299-453d-8b09-f4985f68cd80\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:20.136418 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:20.136384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"
Jul 22 21:16:20.273763 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:20.273739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg"]
Jul 22 21:16:20.276174 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:16:20.276147    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9378b223_5299_453d_8b09_f4985f68cd80.slice/crio-3017ef261c8a0b4672e594c7c43e15e6763b395db84089a10ea8e95c359f4710 WatchSource:0}: Error finding container 3017ef261c8a0b4672e594c7c43e15e6763b395db84089a10ea8e95c359f4710: Status 404 returned error can't find the container with id 3017ef261c8a0b4672e594c7c43e15e6763b395db84089a10ea8e95c359f4710
Jul 22 21:16:20.277589 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:20.277570    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:16:20.282840 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:20.282801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg" event={"ID":"9378b223-5299-453d-8b09-f4985f68cd80","Type":"ContainerStarted","Data":"3017ef261c8a0b4672e594c7c43e15e6763b395db84089a10ea8e95c359f4710"}
Jul 22 21:16:43.408281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:43.408243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg" event={"ID":"9378b223-5299-453d-8b09-f4985f68cd80","Type":"ContainerStarted","Data":"8063d13851231e320c651091f7e993f0e69cdbcdfb9f08c7f9e60291899dd086"}
Jul 22 21:16:43.427631 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:16:43.427586    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lrplg" podStartSLOduration=1.766159837 podStartE2EDuration="24.427572041s" totalImagesPullingTime="22.661412204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:16:43.426914352 +0000 UTC m=+680.209816192" watchObservedRunningTime="2026-07-22 21:16:43.427572041 +0000 UTC m=+680.210473858"
Jul 22 21:17:14.834530 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:14.834451    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:14.912790 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:14.912752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:14.912961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:14.912875    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:14.915815 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:14.915790    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 21:17:14.950985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:14.950961    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:15.000712 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.000686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5ed8393-d9ff-417f-b45b-45a85ababea9-config-file\") pod \"limitador-limitador-64c94fd64f-kxmqz\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.000834 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.000727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtz9n\" (UniqueName: \"kubernetes.io/projected/b5ed8393-d9ff-417f-b45b-45a85ababea9-kube-api-access-jtz9n\") pod \"limitador-limitador-64c94fd64f-kxmqz\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.101535 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.101469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtz9n\" (UniqueName: \"kubernetes.io/projected/b5ed8393-d9ff-417f-b45b-45a85ababea9-kube-api-access-jtz9n\") pod \"limitador-limitador-64c94fd64f-kxmqz\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.101666 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.101572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5ed8393-d9ff-417f-b45b-45a85ababea9-config-file\") pod \"limitador-limitador-64c94fd64f-kxmqz\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.102141 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.102122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5ed8393-d9ff-417f-b45b-45a85ababea9-config-file\") pod \"limitador-limitador-64c94fd64f-kxmqz\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.109863 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.109833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtz9n\" (UniqueName: \"kubernetes.io/projected/b5ed8393-d9ff-417f-b45b-45a85ababea9-kube-api-access-jtz9n\") pod \"limitador-limitador-64c94fd64f-kxmqz\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.224850 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.224820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:15.448610 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.448583    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:15.450564 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:17:15.450539    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ed8393_d9ff_417f_b45b_45a85ababea9.slice/crio-4353ab818a04d4e9ae715dfb1152fc96af58fe400cda4124b9636bb970d3966d WatchSource:0}: Error finding container 4353ab818a04d4e9ae715dfb1152fc96af58fe400cda4124b9636bb970d3966d: Status 404 returned error can't find the container with id 4353ab818a04d4e9ae715dfb1152fc96af58fe400cda4124b9636bb970d3966d
Jul 22 21:17:15.551422 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:15.551387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz" event={"ID":"b5ed8393-d9ff-417f-b45b-45a85ababea9","Type":"ContainerStarted","Data":"4353ab818a04d4e9ae715dfb1152fc96af58fe400cda4124b9636bb970d3966d"}
Jul 22 21:17:18.568252 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:18.568212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz" event={"ID":"b5ed8393-d9ff-417f-b45b-45a85ababea9","Type":"ContainerStarted","Data":"0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38"}
Jul 22 21:17:18.568644 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:18.568340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:18.587703 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:18.587652    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz" podStartSLOduration=1.979662145 podStartE2EDuration="4.587637409s" totalImagesPullingTime="2.607975264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:18.586622987 +0000 UTC m=+715.369524814" watchObservedRunningTime="2026-07-22 21:17:18.587637409 +0000 UTC m=+715.370539224"
Jul 22 21:17:29.573665 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:29.573638    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:32.385584 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:32.385547    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:32.385970 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:32.385743    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz" podUID="b5ed8393-d9ff-417f-b45b-45a85ababea9" containerName="limitador" containerID="cri-o://0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38" gracePeriod=30
Jul 22 21:17:32.933392 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:32.933368    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:33.053775 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.053696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5ed8393-d9ff-417f-b45b-45a85ababea9-config-file\") pod \"b5ed8393-d9ff-417f-b45b-45a85ababea9\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") "
Jul 22 21:17:33.053775 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.053771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtz9n\" (UniqueName: \"kubernetes.io/projected/b5ed8393-d9ff-417f-b45b-45a85ababea9-kube-api-access-jtz9n\") pod \"b5ed8393-d9ff-417f-b45b-45a85ababea9\" (UID: \"b5ed8393-d9ff-417f-b45b-45a85ababea9\") "
Jul 22 21:17:33.054154 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.054129    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ed8393-d9ff-417f-b45b-45a85ababea9-config-file" (OuterVolumeSpecName: "config-file") pod "b5ed8393-d9ff-417f-b45b-45a85ababea9" (UID: "b5ed8393-d9ff-417f-b45b-45a85ababea9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:17:33.055947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.055930    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ed8393-d9ff-417f-b45b-45a85ababea9-kube-api-access-jtz9n" (OuterVolumeSpecName: "kube-api-access-jtz9n") pod "b5ed8393-d9ff-417f-b45b-45a85ababea9" (UID: "b5ed8393-d9ff-417f-b45b-45a85ababea9"). InnerVolumeSpecName "kube-api-access-jtz9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:17:33.154663 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.154629    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtz9n\" (UniqueName: \"kubernetes.io/projected/b5ed8393-d9ff-417f-b45b-45a85ababea9-kube-api-access-jtz9n\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:17:33.154663 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.154662    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5ed8393-d9ff-417f-b45b-45a85ababea9-config-file\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:17:33.634776 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.634745    2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ed8393-d9ff-417f-b45b-45a85ababea9" containerID="0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38" exitCode=0
Jul 22 21:17:33.635218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.634804    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"
Jul 22 21:17:33.635218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.634831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz" event={"ID":"b5ed8393-d9ff-417f-b45b-45a85ababea9","Type":"ContainerDied","Data":"0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38"}
Jul 22 21:17:33.635218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.634882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kxmqz" event={"ID":"b5ed8393-d9ff-417f-b45b-45a85ababea9","Type":"ContainerDied","Data":"4353ab818a04d4e9ae715dfb1152fc96af58fe400cda4124b9636bb970d3966d"}
Jul 22 21:17:33.635218 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.634909    2576 scope.go:117] "RemoveContainer" containerID="0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38"
Jul 22 21:17:33.643707 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.643690    2576 scope.go:117] "RemoveContainer" containerID="0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38"
Jul 22 21:17:33.643981 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:17:33.643958    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38\": container with ID starting with 0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38 not found: ID does not exist" containerID="0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38"
Jul 22 21:17:33.644060 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.643988    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38"} err="failed to get container status \"0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38\": rpc error: code = NotFound desc = could not find container \"0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38\": container with ID starting with 0a40b259dd0e55c4d4fe45afa769ca8f1ae7b7d4c27bc3749356a94dd375fd38 not found: ID does not exist"
Jul 22 21:17:33.654630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.654606    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:33.659844 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.659822    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kxmqz"]
Jul 22 21:17:33.750465 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:33.750434    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ed8393-d9ff-417f-b45b-45a85ababea9" path="/var/lib/kubelet/pods/b5ed8393-d9ff-417f-b45b-45a85ababea9/volumes"
Jul 22 21:17:36.334303 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.334268    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"]
Jul 22 21:17:36.334728 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.334616    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ed8393-d9ff-417f-b45b-45a85ababea9" containerName="limitador"
Jul 22 21:17:36.334728 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.334626    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ed8393-d9ff-417f-b45b-45a85ababea9" containerName="limitador"
Jul 22 21:17:36.334728 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.334701    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ed8393-d9ff-417f-b45b-45a85ababea9" containerName="limitador"
Jul 22 21:17:36.339039 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.339019    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.341741 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.341722    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 21:17:36.341860 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.341723    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 21:17:36.342812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.342793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 21:17:36.342911 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.342813    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-65rh9\""
Jul 22 21:17:36.348300 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.348278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"]
Jul 22 21:17:36.480342 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.480315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzfvb\" (UniqueName: \"kubernetes.io/projected/f7d97f03-246e-4a22-8372-b0c21b15fa4a-kube-api-access-dzfvb\") pod \"postgres-69fb4594cf-2d9mx\" (UID: \"f7d97f03-246e-4a22-8372-b0c21b15fa4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.480500 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.480372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f7d97f03-246e-4a22-8372-b0c21b15fa4a-data\") pod \"postgres-69fb4594cf-2d9mx\" (UID: \"f7d97f03-246e-4a22-8372-b0c21b15fa4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.580913 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.580887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzfvb\" (UniqueName: \"kubernetes.io/projected/f7d97f03-246e-4a22-8372-b0c21b15fa4a-kube-api-access-dzfvb\") pod \"postgres-69fb4594cf-2d9mx\" (UID: \"f7d97f03-246e-4a22-8372-b0c21b15fa4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.581041 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.580942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f7d97f03-246e-4a22-8372-b0c21b15fa4a-data\") pod \"postgres-69fb4594cf-2d9mx\" (UID: \"f7d97f03-246e-4a22-8372-b0c21b15fa4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.581268 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.581252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f7d97f03-246e-4a22-8372-b0c21b15fa4a-data\") pod \"postgres-69fb4594cf-2d9mx\" (UID: \"f7d97f03-246e-4a22-8372-b0c21b15fa4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.591721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.591666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzfvb\" (UniqueName: \"kubernetes.io/projected/f7d97f03-246e-4a22-8372-b0c21b15fa4a-kube-api-access-dzfvb\") pod \"postgres-69fb4594cf-2d9mx\" (UID: \"f7d97f03-246e-4a22-8372-b0c21b15fa4a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.651142 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.651117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:36.780483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:36.780463    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"]
Jul 22 21:17:36.782448 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:17:36.782421    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d97f03_246e_4a22_8372_b0c21b15fa4a.slice/crio-9a3eb2ba632177ebf0dc3c44056d588424ad4bd9342f836acebf6bbbbdeb83af WatchSource:0}: Error finding container 9a3eb2ba632177ebf0dc3c44056d588424ad4bd9342f836acebf6bbbbdeb83af: Status 404 returned error can't find the container with id 9a3eb2ba632177ebf0dc3c44056d588424ad4bd9342f836acebf6bbbbdeb83af
Jul 22 21:17:37.659869 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:37.659777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx" event={"ID":"f7d97f03-246e-4a22-8372-b0c21b15fa4a","Type":"ContainerStarted","Data":"9a3eb2ba632177ebf0dc3c44056d588424ad4bd9342f836acebf6bbbbdeb83af"}
Jul 22 21:17:42.692424 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:42.692383    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx" event={"ID":"f7d97f03-246e-4a22-8372-b0c21b15fa4a","Type":"ContainerStarted","Data":"d35a0093c5146988c3d7ee19d5837a82be45f3341da51daa2010bad3a194c1db"}
Jul 22 21:17:42.692820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:42.692514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:42.708711 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:42.708666    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx" podStartSLOduration=1.852652833 podStartE2EDuration="6.708652278s" totalImagesPullingTime="4.855999445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:42.706965443 +0000 UTC m=+739.489867261" watchObservedRunningTime="2026-07-22 21:17:42.708652278 +0000 UTC m=+739.491554094"
Jul 22 21:17:48.726273 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:48.726245    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2d9mx"
Jul 22 21:17:55.559522 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.559490    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b89659777-c6m6x"]
Jul 22 21:17:55.584498 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.584459    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b89659777-c6m6x"]
Jul 22 21:17:55.584662 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.584569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.587261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.587236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 21:17:55.587498 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.587479    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bqc5b\""
Jul 22 21:17:55.587619 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.587533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 21:17:55.646599 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.646573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-webhook-cert\") pod \"maas-controller-7b89659777-c6m6x\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") " pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.646687 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.646606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klvxs\" (UniqueName: \"kubernetes.io/projected/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-kube-api-access-klvxs\") pod \"maas-controller-7b89659777-c6m6x\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") " pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.735528 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.735499    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-cn564"]
Jul 22 21:17:55.738912 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.738894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.747663 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.747639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vvd9\" (UniqueName: \"kubernetes.io/projected/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-kube-api-access-9vvd9\") pod \"maas-controller-6c96bf86bd-cn564\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") " pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.747856 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.747840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-webhook-cert\") pod \"maas-controller-6c96bf86bd-cn564\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") " pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.748031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.748010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-webhook-cert\") pod \"maas-controller-7b89659777-c6m6x\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") " pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.748132 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.748056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klvxs\" (UniqueName: \"kubernetes.io/projected/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-kube-api-access-klvxs\") pod \"maas-controller-7b89659777-c6m6x\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") " pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.750675 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.750657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-webhook-cert\") pod \"maas-controller-7b89659777-c6m6x\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") " pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.754528 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.754498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-cn564"]
Jul 22 21:17:55.758692 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.758660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klvxs\" (UniqueName: \"kubernetes.io/projected/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-kube-api-access-klvxs\") pod \"maas-controller-7b89659777-c6m6x\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") " pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:55.848518 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.848490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-webhook-cert\") pod \"maas-controller-6c96bf86bd-cn564\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") " pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.848703 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.848563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vvd9\" (UniqueName: \"kubernetes.io/projected/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-kube-api-access-9vvd9\") pod \"maas-controller-6c96bf86bd-cn564\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") " pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.850974 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.850952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-webhook-cert\") pod \"maas-controller-6c96bf86bd-cn564\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") " pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.861127 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.861105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vvd9\" (UniqueName: \"kubernetes.io/projected/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-kube-api-access-9vvd9\") pod \"maas-controller-6c96bf86bd-cn564\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") " pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:55.894964 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:55.894947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:56.021594 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:56.021554    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b89659777-c6m6x"]
Jul 22 21:17:56.023091 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:17:56.023047    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf978f3db_60d0_4b79_a640_4b33c3cdd3f5.slice/crio-f961f6d716a221a6ea2a90ae69be19be997500e8613a352966e1f57d13352c9c WatchSource:0}: Error finding container f961f6d716a221a6ea2a90ae69be19be997500e8613a352966e1f57d13352c9c: Status 404 returned error can't find the container with id f961f6d716a221a6ea2a90ae69be19be997500e8613a352966e1f57d13352c9c
Jul 22 21:17:56.049725 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:56.049701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:56.174853 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:56.174831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-cn564"]
Jul 22 21:17:56.177354 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:17:56.177332    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89b7abb_ea26_4f43_b1f0_0defb2193ebc.slice/crio-01c874c6d8a3ee21836b15d134dd0e4284baf20e625dd636f6a69697bf79f463 WatchSource:0}: Error finding container 01c874c6d8a3ee21836b15d134dd0e4284baf20e625dd636f6a69697bf79f463: Status 404 returned error can't find the container with id 01c874c6d8a3ee21836b15d134dd0e4284baf20e625dd636f6a69697bf79f463
Jul 22 21:17:56.761434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:56.761306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-cn564" event={"ID":"b89b7abb-ea26-4f43-b1f0-0defb2193ebc","Type":"ContainerStarted","Data":"01c874c6d8a3ee21836b15d134dd0e4284baf20e625dd636f6a69697bf79f463"}
Jul 22 21:17:56.764108 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:56.764018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b89659777-c6m6x" event={"ID":"f978f3db-60d0-4b79-a640-4b33c3cdd3f5","Type":"ContainerStarted","Data":"f961f6d716a221a6ea2a90ae69be19be997500e8613a352966e1f57d13352c9c"}
Jul 22 21:17:58.775623 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:58.775512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-cn564" event={"ID":"b89b7abb-ea26-4f43-b1f0-0defb2193ebc","Type":"ContainerStarted","Data":"9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c"}
Jul 22 21:17:58.776103 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:58.775638    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:17:58.777203 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:58.777174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b89659777-c6m6x" event={"ID":"f978f3db-60d0-4b79-a640-4b33c3cdd3f5","Type":"ContainerStarted","Data":"04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2"}
Jul 22 21:17:58.777333 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:58.777306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:17:58.794118 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:58.794059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c96bf86bd-cn564" podStartSLOduration=1.5237240349999999 podStartE2EDuration="3.794044336s" totalImagesPullingTime="2.270320301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:58.793561444 +0000 UTC m=+755.576463294" watchObservedRunningTime="2026-07-22 21:17:58.794044336 +0000 UTC m=+755.576946152"
Jul 22 21:17:58.812496 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:17:58.812451    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b89659777-c6m6x" podStartSLOduration=1.394255608 podStartE2EDuration="3.812438414s" totalImagesPullingTime="2.418182806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:17:58.811816891 +0000 UTC m=+755.594718708" watchObservedRunningTime="2026-07-22 21:17:58.812438414 +0000 UTC m=+755.595340230"
Jul 22 21:18:09.784672 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:09.784641    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:18:09.785192 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:09.784720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:18:09.849875 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:09.849842    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b89659777-c6m6x"]
Jul 22 21:18:09.850043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:09.850020    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b89659777-c6m6x" podUID="f978f3db-60d0-4b79-a640-4b33c3cdd3f5" containerName="manager" containerID="cri-o://04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2" gracePeriod=30
Jul 22 21:18:10.095528 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.095502    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:18:10.178759 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.178721    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-webhook-cert\") pod \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") "
Jul 22 21:18:10.178952 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.178807    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klvxs\" (UniqueName: \"kubernetes.io/projected/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-kube-api-access-klvxs\") pod \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\" (UID: \"f978f3db-60d0-4b79-a640-4b33c3cdd3f5\") "
Jul 22 21:18:10.181106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.181060    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f978f3db-60d0-4b79-a640-4b33c3cdd3f5" (UID: "f978f3db-60d0-4b79-a640-4b33c3cdd3f5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:18:10.181226 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.181130    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-kube-api-access-klvxs" (OuterVolumeSpecName: "kube-api-access-klvxs") pod "f978f3db-60d0-4b79-a640-4b33c3cdd3f5" (UID: "f978f3db-60d0-4b79-a640-4b33c3cdd3f5"). InnerVolumeSpecName "kube-api-access-klvxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:18:10.279690 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.279659    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klvxs\" (UniqueName: \"kubernetes.io/projected/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-kube-api-access-klvxs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:18:10.279690 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.279687    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f978f3db-60d0-4b79-a640-4b33c3cdd3f5-webhook-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:18:10.830600 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.830566    2576 generic.go:356] "Generic (PLEG): container finished" podID="f978f3db-60d0-4b79-a640-4b33c3cdd3f5" containerID="04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2" exitCode=0
Jul 22 21:18:10.830600 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.830601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b89659777-c6m6x" event={"ID":"f978f3db-60d0-4b79-a640-4b33c3cdd3f5","Type":"ContainerDied","Data":"04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2"}
Jul 22 21:18:10.831100 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.830609    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b89659777-c6m6x"
Jul 22 21:18:10.831100 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.830638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b89659777-c6m6x" event={"ID":"f978f3db-60d0-4b79-a640-4b33c3cdd3f5","Type":"ContainerDied","Data":"f961f6d716a221a6ea2a90ae69be19be997500e8613a352966e1f57d13352c9c"}
Jul 22 21:18:10.831100 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.830660    2576 scope.go:117] "RemoveContainer" containerID="04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2"
Jul 22 21:18:10.839545 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.839527    2576 scope.go:117] "RemoveContainer" containerID="04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2"
Jul 22 21:18:10.839797 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:18:10.839782    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2\": container with ID starting with 04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2 not found: ID does not exist" containerID="04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2"
Jul 22 21:18:10.839834 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.839808    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2"} err="failed to get container status \"04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2\": rpc error: code = NotFound desc = could not find container \"04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2\": container with ID starting with 04b0220bd44e20bf10a753f9e4e423c0182355b83c388e815b2172657a60e8d2 not found: ID does not exist"
Jul 22 21:18:10.850634 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.850609    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b89659777-c6m6x"]
Jul 22 21:18:10.859425 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:10.855146    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b89659777-c6m6x"]
Jul 22 21:18:11.750457 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:11.750424    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f978f3db-60d0-4b79-a640-4b33c3cdd3f5" path="/var/lib/kubelet/pods/f978f3db-60d0-4b79-a640-4b33c3cdd3f5/volumes"
Jul 22 21:18:33.093891 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.093850    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"]
Jul 22 21:18:33.094476 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.094371    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f978f3db-60d0-4b79-a640-4b33c3cdd3f5" containerName="manager"
Jul 22 21:18:33.094476 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.094389    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f978f3db-60d0-4b79-a640-4b33c3cdd3f5" containerName="manager"
Jul 22 21:18:33.094610 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.094486    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f978f3db-60d0-4b79-a640-4b33c3cdd3f5" containerName="manager"
Jul 22 21:18:33.103179 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.103152    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.107229 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.107202    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"]
Jul 22 21:18:33.107804 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.107781    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 21:18:33.107804 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.107794    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7vcqz\""
Jul 22 21:18:33.285933 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.285897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ttp\" (UniqueName: \"kubernetes.io/projected/4b51f374-e906-4c59-b0ee-b93e24f66f4c-kube-api-access-b7ttp\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.286116 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.286032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b51f374-e906-4c59-b0ee-b93e24f66f4c-openshift-service-ca\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.286116 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.286064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b51f374-e906-4c59-b0ee-b93e24f66f4c-maas-api-tls\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.387321 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.387242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ttp\" (UniqueName: \"kubernetes.io/projected/4b51f374-e906-4c59-b0ee-b93e24f66f4c-kube-api-access-b7ttp\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.387493 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.387348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b51f374-e906-4c59-b0ee-b93e24f66f4c-openshift-service-ca\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.387493 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.387381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b51f374-e906-4c59-b0ee-b93e24f66f4c-maas-api-tls\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.388000 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.387973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b51f374-e906-4c59-b0ee-b93e24f66f4c-openshift-service-ca\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.390018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.389969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b51f374-e906-4c59-b0ee-b93e24f66f4c-maas-api-tls\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.395270 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.395250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ttp\" (UniqueName: \"kubernetes.io/projected/4b51f374-e906-4c59-b0ee-b93e24f66f4c-kube-api-access-b7ttp\") pod \"maas-api-68c4b7f449-6sb6s\" (UID: \"4b51f374-e906-4c59-b0ee-b93e24f66f4c\") " pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.415163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.415139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:33.551105 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.551051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"]
Jul 22 21:18:33.553316 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:18:33.553287    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b51f374_e906_4c59_b0ee_b93e24f66f4c.slice/crio-8da13b2818711ae5006011728969e4fe45e0a94f101f0ca6dd88e2ffdffedd34 WatchSource:0}: Error finding container 8da13b2818711ae5006011728969e4fe45e0a94f101f0ca6dd88e2ffdffedd34: Status 404 returned error can't find the container with id 8da13b2818711ae5006011728969e4fe45e0a94f101f0ca6dd88e2ffdffedd34
Jul 22 21:18:33.585284 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.585245    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"]
Jul 22 21:18:33.590441 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.590417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.592802 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.592783    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 21:18:33.600324 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.600280    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"]
Jul 22 21:18:33.690283 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.690201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd05bdfd-2265-4df1-8181-66192112c289-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4k7bp\" (UID: \"fd05bdfd-2265-4df1-8181-66192112c289\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.690283 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.690238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t864p\" (UniqueName: \"kubernetes.io/projected/fd05bdfd-2265-4df1-8181-66192112c289-kube-api-access-t864p\") pod \"payload-pre-processing-7677b774bb-4k7bp\" (UID: \"fd05bdfd-2265-4df1-8181-66192112c289\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.791141 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.791103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd05bdfd-2265-4df1-8181-66192112c289-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4k7bp\" (UID: \"fd05bdfd-2265-4df1-8181-66192112c289\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.791141 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.791148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t864p\" (UniqueName: \"kubernetes.io/projected/fd05bdfd-2265-4df1-8181-66192112c289-kube-api-access-t864p\") pod \"payload-pre-processing-7677b774bb-4k7bp\" (UID: \"fd05bdfd-2265-4df1-8181-66192112c289\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.791833 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.791813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd05bdfd-2265-4df1-8181-66192112c289-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-4k7bp\" (UID: \"fd05bdfd-2265-4df1-8181-66192112c289\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.799337 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.799319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t864p\" (UniqueName: \"kubernetes.io/projected/fd05bdfd-2265-4df1-8181-66192112c289-kube-api-access-t864p\") pod \"payload-pre-processing-7677b774bb-4k7bp\" (UID: \"fd05bdfd-2265-4df1-8181-66192112c289\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.903120 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.903092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:33.936636 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:33.936602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s" event={"ID":"4b51f374-e906-4c59-b0ee-b93e24f66f4c","Type":"ContainerStarted","Data":"8da13b2818711ae5006011728969e4fe45e0a94f101f0ca6dd88e2ffdffedd34"}
Jul 22 21:18:34.033753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:34.033727    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"]
Jul 22 21:18:34.035374 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:18:34.035347    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd05bdfd_2265_4df1_8181_66192112c289.slice/crio-2c9b60329b9ac7005bd357a8b98895690b67eab37888975ad929b4e316d6b681 WatchSource:0}: Error finding container 2c9b60329b9ac7005bd357a8b98895690b67eab37888975ad929b4e316d6b681: Status 404 returned error can't find the container with id 2c9b60329b9ac7005bd357a8b98895690b67eab37888975ad929b4e316d6b681
Jul 22 21:18:34.946183 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:34.946142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp" event={"ID":"fd05bdfd-2265-4df1-8181-66192112c289","Type":"ContainerStarted","Data":"2c9b60329b9ac7005bd357a8b98895690b67eab37888975ad929b4e316d6b681"}
Jul 22 21:18:35.953876 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:35.953773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp" event={"ID":"fd05bdfd-2265-4df1-8181-66192112c289","Type":"ContainerStarted","Data":"d7803b2d20661f8eda371ef5613e19e962a4c94ac63d842890235a9297ade5a1"}
Jul 22 21:18:35.953876 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:35.953844    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:18:35.955368 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:35.955344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s" event={"ID":"4b51f374-e906-4c59-b0ee-b93e24f66f4c","Type":"ContainerStarted","Data":"6e65af0fafd526f89c89e11ecd321766978f2b82f52dde9a53de3e64cf0d4333"}
Jul 22 21:18:35.955500 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:35.955462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:35.970635 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:35.970589    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp" podStartSLOduration=1.3047568840000001 podStartE2EDuration="2.970573678s" totalImagesPullingTime="1.665816794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:18:35.96916933 +0000 UTC m=+792.752071171" watchObservedRunningTime="2026-07-22 21:18:35.970573678 +0000 UTC m=+792.753475494"
Jul 22 21:18:35.984285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:35.984230    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s" podStartSLOduration=1.305987827 podStartE2EDuration="2.984212744s" totalImagesPullingTime="1.678224917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:18:35.983548712 +0000 UTC m=+792.766450530" watchObservedRunningTime="2026-07-22 21:18:35.984212744 +0000 UTC m=+792.767114566"
Jul 22 21:18:41.966559 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:41.966532    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68c4b7f449-6sb6s"
Jul 22 21:18:46.962712 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:18:46.962686    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-4k7bp"
Jul 22 21:19:24.244898 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.244860    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"]
Jul 22 21:19:24.248325 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.248300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.251100 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.251059    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 21:19:24.252145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.252127    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 21:19:24.252145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.252143    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tm5ws\""
Jul 22 21:19:24.252297 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.252129    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 21:19:24.260051 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.260029    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"]
Jul 22 21:19:24.410722 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.410691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.410884 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.410743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjc9k\" (UniqueName: \"kubernetes.io/projected/254dc73d-3828-4496-bfb8-e225f817b633-kube-api-access-rjc9k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.410884 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.410812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.410884 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.410862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.410987 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.410901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254dc73d-3828-4496-bfb8-e225f817b633-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.410987 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.410941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.511620 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.511620 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.511831 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjc9k\" (UniqueName: \"kubernetes.io/projected/254dc73d-3828-4496-bfb8-e225f817b633-kube-api-access-rjc9k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.511831 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.511831 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.511831 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254dc73d-3828-4496-bfb8-e225f817b633-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.512044 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.511965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.512044 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.512019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.512195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.512056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.514115 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.514092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/254dc73d-3828-4496-bfb8-e225f817b633-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.514261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.514246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/254dc73d-3828-4496-bfb8-e225f817b633-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.520716 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.520693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjc9k\" (UniqueName: \"kubernetes.io/projected/254dc73d-3828-4496-bfb8-e225f817b633-kube-api-access-rjc9k\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gqzws\" (UID: \"254dc73d-3828-4496-bfb8-e225f817b633\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.558765 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.558745    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:24.689932 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:24.689903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"]
Jul 22 21:19:24.691630 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:19:24.691601    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254dc73d_3828_4496_bfb8_e225f817b633.slice/crio-f6bc839aa7b7fee0dd8e5919fd2162cfb9e9c61248fd3f0cde3b26dbc7c85db5 WatchSource:0}: Error finding container f6bc839aa7b7fee0dd8e5919fd2162cfb9e9c61248fd3f0cde3b26dbc7c85db5: Status 404 returned error can't find the container with id f6bc839aa7b7fee0dd8e5919fd2162cfb9e9c61248fd3f0cde3b26dbc7c85db5
Jul 22 21:19:25.178337 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:25.178264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws" event={"ID":"254dc73d-3828-4496-bfb8-e225f817b633","Type":"ContainerStarted","Data":"f6bc839aa7b7fee0dd8e5919fd2162cfb9e9c61248fd3f0cde3b26dbc7c85db5"}
Jul 22 21:19:26.184750 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:26.184716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws" event={"ID":"254dc73d-3828-4496-bfb8-e225f817b633","Type":"ContainerStarted","Data":"18dbffafca74a9c2b38dff538129580093cc412b8f8d47063656af934fbad21f"}
Jul 22 21:19:26.201904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:26.201832    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws" podStartSLOduration=1.196956746 podStartE2EDuration="2.20181923s" totalImagesPullingTime="1.004862484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:19:26.200725472 +0000 UTC m=+842.983627291" watchObservedRunningTime="2026-07-22 21:19:26.20181923 +0000 UTC m=+842.984721046"
Jul 22 21:19:34.559924 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:34.559884    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:34.560489 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:34.560220    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:34.572246 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:34.572219    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:19:35.236646 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:19:35.236619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gqzws"
Jul 22 21:20:20.632689 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.632612    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"]
Jul 22 21:20:20.636204 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.636185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.638789 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.638775    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 21:20:20.647332 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.647307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"]
Jul 22 21:20:20.807813 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.807786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.807940 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.807827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a139bb-3e27-43d0-9147-6a02a85d9940-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.807940 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.807846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.807940 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.807903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbm7t\" (UniqueName: \"kubernetes.io/projected/52a139bb-3e27-43d0-9147-6a02a85d9940-kube-api-access-zbm7t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.808129 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.808016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.808129 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.808051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.908744 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.908683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.908744 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.908726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a139bb-3e27-43d0-9147-6a02a85d9940-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.908744 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.908743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.908961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.908760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbm7t\" (UniqueName: \"kubernetes.io/projected/52a139bb-3e27-43d0-9147-6a02a85d9940-kube-api-access-zbm7t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.908961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.908825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.908961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.908849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.909257 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.909229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.909257 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.909247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.909382 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.909288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.911147 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.911120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52a139bb-3e27-43d0-9147-6a02a85d9940-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.911395 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.911357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52a139bb-3e27-43d0-9147-6a02a85d9940-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.916731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.916709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbm7t\" (UniqueName: \"kubernetes.io/projected/52a139bb-3e27-43d0-9147-6a02a85d9940-kube-api-access-zbm7t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dt85l\" (UID: \"52a139bb-3e27-43d0-9147-6a02a85d9940\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:20.965234 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:20.965215    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:21.094234 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:21.094208    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"]
Jul 22 21:20:21.096206 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:20:21.096172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a139bb_3e27_43d0_9147_6a02a85d9940.slice/crio-0d9c6bd430cf61de111c547af944ad1470c061fab2beab7321faf2411e2d60ff WatchSource:0}: Error finding container 0d9c6bd430cf61de111c547af944ad1470c061fab2beab7321faf2411e2d60ff: Status 404 returned error can't find the container with id 0d9c6bd430cf61de111c547af944ad1470c061fab2beab7321faf2411e2d60ff
Jul 22 21:20:21.448496 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:21.448469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l" event={"ID":"52a139bb-3e27-43d0-9147-6a02a85d9940","Type":"ContainerStarted","Data":"0d9c6bd430cf61de111c547af944ad1470c061fab2beab7321faf2411e2d60ff"}
Jul 22 21:20:22.454392 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:22.454357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l" event={"ID":"52a139bb-3e27-43d0-9147-6a02a85d9940","Type":"ContainerStarted","Data":"5fc4810d8b628244db5d9b0b98b9d45926baa3c92eae193b5bf4c52ab99c0ec7"}
Jul 22 21:20:22.478328 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:22.478278    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l" podStartSLOduration=2.152160866 podStartE2EDuration="2.478264384s" totalImagesPullingTime="326.103518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:20:22.476156646 +0000 UTC m=+899.259058463" watchObservedRunningTime="2026-07-22 21:20:22.478264384 +0000 UTC m=+899.261166200"
Jul 22 21:20:23.710111 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:23.710085    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:20:23.710832 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:23.710811    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:20:23.713617 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:23.713599    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:20:23.714366 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:23.714350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:20:30.965379 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:30.965339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:30.965846 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:30.965403    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:30.977765 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:30.977742    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:20:31.508083 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:20:31.508049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dt85l"
Jul 22 21:22:14.977920 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:14.977883    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-cn564"]
Jul 22 21:22:14.978475 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:14.978113    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c96bf86bd-cn564" podUID="b89b7abb-ea26-4f43-b1f0-0defb2193ebc" containerName="manager" containerID="cri-o://9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c" gracePeriod=30
Jul 22 21:22:15.227363 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.227340    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:22:15.327676 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.327639    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vvd9\" (UniqueName: \"kubernetes.io/projected/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-kube-api-access-9vvd9\") pod \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") "
Jul 22 21:22:15.327866 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.327692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-webhook-cert\") pod \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\" (UID: \"b89b7abb-ea26-4f43-b1f0-0defb2193ebc\") "
Jul 22 21:22:15.329939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.329908    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b89b7abb-ea26-4f43-b1f0-0defb2193ebc" (UID: "b89b7abb-ea26-4f43-b1f0-0defb2193ebc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:22:15.329939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.329919    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-kube-api-access-9vvd9" (OuterVolumeSpecName: "kube-api-access-9vvd9") pod "b89b7abb-ea26-4f43-b1f0-0defb2193ebc" (UID: "b89b7abb-ea26-4f43-b1f0-0defb2193ebc"). InnerVolumeSpecName "kube-api-access-9vvd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:22:15.428558 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.428523    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vvd9\" (UniqueName: \"kubernetes.io/projected/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-kube-api-access-9vvd9\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:22:15.428558 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.428555    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b89b7abb-ea26-4f43-b1f0-0defb2193ebc-webhook-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:22:15.975788 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.975751    2576 generic.go:356] "Generic (PLEG): container finished" podID="b89b7abb-ea26-4f43-b1f0-0defb2193ebc" containerID="9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c" exitCode=0
Jul 22 21:22:15.975961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.975800    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-cn564"
Jul 22 21:22:15.975961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.975798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-cn564" event={"ID":"b89b7abb-ea26-4f43-b1f0-0defb2193ebc","Type":"ContainerDied","Data":"9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c"}
Jul 22 21:22:15.975961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.975852    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-cn564" event={"ID":"b89b7abb-ea26-4f43-b1f0-0defb2193ebc","Type":"ContainerDied","Data":"01c874c6d8a3ee21836b15d134dd0e4284baf20e625dd636f6a69697bf79f463"}
Jul 22 21:22:15.975961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.975874    2576 scope.go:117] "RemoveContainer" containerID="9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c"
Jul 22 21:22:15.984448 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.984272    2576 scope.go:117] "RemoveContainer" containerID="9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c"
Jul 22 21:22:15.984667 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:22:15.984513    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c\": container with ID starting with 9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c not found: ID does not exist" containerID="9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c"
Jul 22 21:22:15.984667 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.984540    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c"} err="failed to get container status \"9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c\": rpc error: code = NotFound desc = could not find container \"9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c\": container with ID starting with 9b58770cbccadeef99d00d2577713bd61571e5fa504f8c3e005e4a1a900f292c not found: ID does not exist"
Jul 22 21:22:15.992778 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.992757    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-cn564"]
Jul 22 21:22:15.996031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:15.996011    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-cn564"]
Jul 22 21:22:17.750870 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:22:17.750837    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b89b7abb-ea26-4f43-b1f0-0defb2193ebc" path="/var/lib/kubelet/pods/b89b7abb-ea26-4f43-b1f0-0defb2193ebc/volumes"
Jul 22 21:23:16.795691 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.795621    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-hkkpv"]
Jul 22 21:23:16.796116 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.795974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89b7abb-ea26-4f43-b1f0-0defb2193ebc" containerName="manager"
Jul 22 21:23:16.796116 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.795984    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89b7abb-ea26-4f43-b1f0-0defb2193ebc" containerName="manager"
Jul 22 21:23:16.796116 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.796041    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b89b7abb-ea26-4f43-b1f0-0defb2193ebc" containerName="manager"
Jul 22 21:23:16.799092 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.799057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:16.801850 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.801832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bqc5b\""
Jul 22 21:23:16.802971 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.802955    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 21:23:16.802971 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.802962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 21:23:16.807820 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.807799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-hkkpv"]
Jul 22 21:23:16.888826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.888790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1edd2017-456e-43f0-9574-c78c60597333-webhook-cert\") pod \"maas-controller-6c96bf86bd-hkkpv\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") " pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:16.889008 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.888957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825x9\" (UniqueName: \"kubernetes.io/projected/1edd2017-456e-43f0-9574-c78c60597333-kube-api-access-825x9\") pod \"maas-controller-6c96bf86bd-hkkpv\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") " pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:16.989976 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.989948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1edd2017-456e-43f0-9574-c78c60597333-webhook-cert\") pod \"maas-controller-6c96bf86bd-hkkpv\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") " pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:16.990173 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.990002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825x9\" (UniqueName: \"kubernetes.io/projected/1edd2017-456e-43f0-9574-c78c60597333-kube-api-access-825x9\") pod \"maas-controller-6c96bf86bd-hkkpv\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") " pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:16.992711 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.992685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1edd2017-456e-43f0-9574-c78c60597333-webhook-cert\") pod \"maas-controller-6c96bf86bd-hkkpv\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") " pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:16.998167 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:16.998143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-825x9\" (UniqueName: \"kubernetes.io/projected/1edd2017-456e-43f0-9574-c78c60597333-kube-api-access-825x9\") pod \"maas-controller-6c96bf86bd-hkkpv\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") " pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:17.110404 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:17.110377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:17.246241 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:17.246215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-hkkpv"]
Jul 22 21:23:17.248266 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:23:17.248238    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edd2017_456e_43f0_9574_c78c60597333.slice/crio-b9d3000c161f94b44870466b84320c30c12760ac36b43e481462f16224d67275 WatchSource:0}: Error finding container b9d3000c161f94b44870466b84320c30c12760ac36b43e481462f16224d67275: Status 404 returned error can't find the container with id b9d3000c161f94b44870466b84320c30c12760ac36b43e481462f16224d67275
Jul 22 21:23:17.249649 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:17.249631    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:23:17.259754 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:17.259727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv" event={"ID":"1edd2017-456e-43f0-9574-c78c60597333","Type":"ContainerStarted","Data":"b9d3000c161f94b44870466b84320c30c12760ac36b43e481462f16224d67275"}
Jul 22 21:23:18.271144 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:18.271108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv" event={"ID":"1edd2017-456e-43f0-9574-c78c60597333","Type":"ContainerStarted","Data":"7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58"}
Jul 22 21:23:18.271532 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:18.271212    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:18.291471 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:18.291426    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv" podStartSLOduration=1.8489313950000001 podStartE2EDuration="2.291413297s" totalImagesPullingTime="442.481902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:23:18.290044703 +0000 UTC m=+1075.072946522" watchObservedRunningTime="2026-07-22 21:23:18.291413297 +0000 UTC m=+1075.074315114"
Jul 22 21:23:29.278178 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:29.278148    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:33.907297 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:33.907264    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-hkkpv"]
Jul 22 21:23:33.907872 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:33.907490    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv" podUID="1edd2017-456e-43f0-9574-c78c60597333" containerName="manager" containerID="cri-o://7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58" gracePeriod=30
Jul 22 21:23:34.158110 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.158043    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:34.245998 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.245967    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-825x9\" (UniqueName: \"kubernetes.io/projected/1edd2017-456e-43f0-9574-c78c60597333-kube-api-access-825x9\") pod \"1edd2017-456e-43f0-9574-c78c60597333\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") "
Jul 22 21:23:34.246200 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.246038    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1edd2017-456e-43f0-9574-c78c60597333-webhook-cert\") pod \"1edd2017-456e-43f0-9574-c78c60597333\" (UID: \"1edd2017-456e-43f0-9574-c78c60597333\") "
Jul 22 21:23:34.248226 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.248194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1edd2017-456e-43f0-9574-c78c60597333-kube-api-access-825x9" (OuterVolumeSpecName: "kube-api-access-825x9") pod "1edd2017-456e-43f0-9574-c78c60597333" (UID: "1edd2017-456e-43f0-9574-c78c60597333"). InnerVolumeSpecName "kube-api-access-825x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:23:34.248340 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.248221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1edd2017-456e-43f0-9574-c78c60597333-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1edd2017-456e-43f0-9574-c78c60597333" (UID: "1edd2017-456e-43f0-9574-c78c60597333"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:23:34.346679 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.346651    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-825x9\" (UniqueName: \"kubernetes.io/projected/1edd2017-456e-43f0-9574-c78c60597333-kube-api-access-825x9\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:23:34.346679 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.346680    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1edd2017-456e-43f0-9574-c78c60597333-webhook-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:23:34.347142 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.347118    2576 generic.go:356] "Generic (PLEG): container finished" podID="1edd2017-456e-43f0-9574-c78c60597333" containerID="7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58" exitCode=0
Jul 22 21:23:34.347212 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.347155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv" event={"ID":"1edd2017-456e-43f0-9574-c78c60597333","Type":"ContainerDied","Data":"7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58"}
Jul 22 21:23:34.347212 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.347164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv"
Jul 22 21:23:34.347212 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.347194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-hkkpv" event={"ID":"1edd2017-456e-43f0-9574-c78c60597333","Type":"ContainerDied","Data":"b9d3000c161f94b44870466b84320c30c12760ac36b43e481462f16224d67275"}
Jul 22 21:23:34.347331 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.347217    2576 scope.go:117] "RemoveContainer" containerID="7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58"
Jul 22 21:23:34.357810 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.357787    2576 scope.go:117] "RemoveContainer" containerID="7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58"
Jul 22 21:23:34.359180 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:23:34.359154    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58\": container with ID starting with 7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58 not found: ID does not exist" containerID="7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58"
Jul 22 21:23:34.359278 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.359190    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58"} err="failed to get container status \"7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58\": rpc error: code = NotFound desc = could not find container \"7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58\": container with ID starting with 7f616214d07b54aed55dc1f9ad189c6fb1e086db6f5d7107d40454ea58adfc58 not found: ID does not exist"
Jul 22 21:23:34.371926 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.371904    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-hkkpv"]
Jul 22 21:23:34.373551 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:34.373533    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-hkkpv"]
Jul 22 21:23:35.144193 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.144150    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-484b5"]
Jul 22 21:23:35.144568 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.144552    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1edd2017-456e-43f0-9574-c78c60597333" containerName="manager"
Jul 22 21:23:35.144568 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.144563    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1edd2017-456e-43f0-9574-c78c60597333" containerName="manager"
Jul 22 21:23:35.144661 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.144640    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1edd2017-456e-43f0-9574-c78c60597333" containerName="manager"
Jul 22 21:23:35.148866 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.148850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.151396 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.151371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80713ab6-fc62-46d5-8a5b-05c0ef856108-webhook-cert\") pod \"maas-controller-6c96bf86bd-484b5\" (UID: \"80713ab6-fc62-46d5-8a5b-05c0ef856108\") " pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.151515 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.151416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spbwl\" (UniqueName: \"kubernetes.io/projected/80713ab6-fc62-46d5-8a5b-05c0ef856108-kube-api-access-spbwl\") pod \"maas-controller-6c96bf86bd-484b5\" (UID: \"80713ab6-fc62-46d5-8a5b-05c0ef856108\") " pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.152741 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.152716    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bqc5b\""
Jul 22 21:23:35.152741 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.152725    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 21:23:35.152929 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.152725    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 21:23:35.156015 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.155994    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-484b5"]
Jul 22 21:23:35.252630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.252592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80713ab6-fc62-46d5-8a5b-05c0ef856108-webhook-cert\") pod \"maas-controller-6c96bf86bd-484b5\" (UID: \"80713ab6-fc62-46d5-8a5b-05c0ef856108\") " pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.252813 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.252638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spbwl\" (UniqueName: \"kubernetes.io/projected/80713ab6-fc62-46d5-8a5b-05c0ef856108-kube-api-access-spbwl\") pod \"maas-controller-6c96bf86bd-484b5\" (UID: \"80713ab6-fc62-46d5-8a5b-05c0ef856108\") " pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.255145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.255122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80713ab6-fc62-46d5-8a5b-05c0ef856108-webhook-cert\") pod \"maas-controller-6c96bf86bd-484b5\" (UID: \"80713ab6-fc62-46d5-8a5b-05c0ef856108\") " pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.261157 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.261133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spbwl\" (UniqueName: \"kubernetes.io/projected/80713ab6-fc62-46d5-8a5b-05c0ef856108-kube-api-access-spbwl\") pod \"maas-controller-6c96bf86bd-484b5\" (UID: \"80713ab6-fc62-46d5-8a5b-05c0ef856108\") " pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.460742 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.460638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:35.605202 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.605173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c96bf86bd-484b5"]
Jul 22 21:23:35.606993 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:23:35.606969    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80713ab6_fc62_46d5_8a5b_05c0ef856108.slice/crio-1cd380a5f5a90ea93ca410e1fa2c56ab63e829fce7cef5e73648b3d246ae625f WatchSource:0}: Error finding container 1cd380a5f5a90ea93ca410e1fa2c56ab63e829fce7cef5e73648b3d246ae625f: Status 404 returned error can't find the container with id 1cd380a5f5a90ea93ca410e1fa2c56ab63e829fce7cef5e73648b3d246ae625f
Jul 22 21:23:35.750662 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:35.750565    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1edd2017-456e-43f0-9574-c78c60597333" path="/var/lib/kubelet/pods/1edd2017-456e-43f0-9574-c78c60597333/volumes"
Jul 22 21:23:36.359079 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:36.359043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-484b5" event={"ID":"80713ab6-fc62-46d5-8a5b-05c0ef856108","Type":"ContainerStarted","Data":"840955385a8348a26b83a8a772fa9d469bbeeface8cad5703da3fddaa06d1aa6"}
Jul 22 21:23:36.359474 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:36.359119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c96bf86bd-484b5" event={"ID":"80713ab6-fc62-46d5-8a5b-05c0ef856108","Type":"ContainerStarted","Data":"1cd380a5f5a90ea93ca410e1fa2c56ab63e829fce7cef5e73648b3d246ae625f"}
Jul 22 21:23:36.359474 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:36.359183    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:23:36.377280 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:36.377231    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c96bf86bd-484b5" podStartSLOduration=1.042252181 podStartE2EDuration="1.37721314s" totalImagesPullingTime="334.960959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:23:36.37631343 +0000 UTC m=+1093.159215275" watchObservedRunningTime="2026-07-22 21:23:36.37721314 +0000 UTC m=+1093.160114957"
Jul 22 21:23:47.365921 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:23:47.365887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c96bf86bd-484b5"
Jul 22 21:25:23.742483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:25:23.742456    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:25:23.745022 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:25:23.744998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:25:23.746380 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:25:23.746360    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:25:23.749642 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:25:23.749620    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:30:23.772839 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:30:23.772814    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:30:23.776272 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:30:23.776251    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:30:23.776694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:30:23.776675    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:30:23.780274 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:30:23.780258    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:32:05.228607 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.228563    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"]
Jul 22 21:32:05.232666 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.232644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.235656 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.235631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-71e1eaff-kserve-self-signed-certs\""
Jul 22 21:32:05.241569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.241544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"]
Jul 22 21:32:05.352304 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.352265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tmp-dir\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.352503 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.352350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-home\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.352503 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.352411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tls-certs\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.352503 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.352439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-dshm\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.352503 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.352464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-model-cache\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.352654 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.352565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gpm\" (UniqueName: \"kubernetes.io/projected/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-kube-api-access-46gpm\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-dshm\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453341 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-model-cache\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46gpm\" (UniqueName: \"kubernetes.io/projected/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-kube-api-access-46gpm\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tmp-dir\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-home\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453613 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tls-certs\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453867 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-model-cache\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.453983 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.453960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tmp-dir\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.454240 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.454215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-home\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.455839 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.455805    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-dshm\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.456399 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.456377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tls-certs\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.462739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.462706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gpm\" (UniqueName: \"kubernetes.io/projected/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-kube-api-access-46gpm\") pod \"e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") " pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.544145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.544039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:05.717513 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.717468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"]
Jul 22 21:32:05.721406 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:32:05.721376    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93dd7eee_cd7f_4bb6_b449_2ee8e3e256ee.slice/crio-cc7bde6a4b075f49a8eb06d73f746fd3e698c9dc5e722cc06d594da70f49ca84 WatchSource:0}: Error finding container cc7bde6a4b075f49a8eb06d73f746fd3e698c9dc5e722cc06d594da70f49ca84: Status 404 returned error can't find the container with id cc7bde6a4b075f49a8eb06d73f746fd3e698c9dc5e722cc06d594da70f49ca84
Jul 22 21:32:05.755798 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:05.755755    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l" event={"ID":"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee","Type":"ContainerStarted","Data":"cc7bde6a4b075f49a8eb06d73f746fd3e698c9dc5e722cc06d594da70f49ca84"}
Jul 22 21:32:06.762758 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:06.762717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l" event={"ID":"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee","Type":"ContainerStarted","Data":"ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313"}
Jul 22 21:32:06.787541 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:06.787484    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l" podStartSLOduration=1.787465057 podStartE2EDuration="1.787465057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:32:06.785339897 +0000 UTC m=+1603.568241716" watchObservedRunningTime="2026-07-22 21:32:06.787465057 +0000 UTC m=+1603.570366875"
Jul 22 21:32:15.544943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:15.544853    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:15.544943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:15.544901    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:15.558095 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:15.558041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:15.821823 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:15.821799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:29.244943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:29.244909    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"]
Jul 22 21:32:44.268277 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.268204    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l" podUID="93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" containerName="main" containerID="cri-o://ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313" gracePeriod=45
Jul 22 21:32:44.519868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.519804    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:44.623961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.623927    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-model-cache\") pod \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") "
Jul 22 21:32:44.623961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.623965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46gpm\" (UniqueName: \"kubernetes.io/projected/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-kube-api-access-46gpm\") pod \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") "
Jul 22 21:32:44.624211 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.623997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tmp-dir\") pod \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") "
Jul 22 21:32:44.624211 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tls-certs\") pod \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") "
Jul 22 21:32:44.624211 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624201    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-home\") pod \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") "
Jul 22 21:32:44.624330 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624240    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-dshm\") pod \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\" (UID: \"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee\") "
Jul 22 21:32:44.624330 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624270    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" (UID: "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:32:44.624330 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624310    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" (UID: "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:32:44.624483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624431    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-home" (OuterVolumeSpecName: "home") pod "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" (UID: "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:32:44.624541 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624506    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-home\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:32:44.624541 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624518    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-model-cache\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:32:44.624541 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.624527    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tmp-dir\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:32:44.626488 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.626461    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-dshm" (OuterVolumeSpecName: "dshm") pod "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" (UID: "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:32:44.626608 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.626492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" (UID: "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:32:44.626667 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.626607    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-kube-api-access-46gpm" (OuterVolumeSpecName: "kube-api-access-46gpm") pod "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" (UID: "93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee"). InnerVolumeSpecName "kube-api-access-46gpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:32:44.725651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.725610    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-dshm\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:32:44.725651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.725649    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46gpm\" (UniqueName: \"kubernetes.io/projected/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-kube-api-access-46gpm\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:32:44.725846 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.725663    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee-tls-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:32:44.957518 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.957481    2576 generic.go:356] "Generic (PLEG): container finished" podID="93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" containerID="ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313" exitCode=0
Jul 22 21:32:44.957678 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.957525    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"
Jul 22 21:32:44.957678 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.957536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l" event={"ID":"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee","Type":"ContainerDied","Data":"ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313"}
Jul 22 21:32:44.957678 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.957569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l" event={"ID":"93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee","Type":"ContainerDied","Data":"cc7bde6a4b075f49a8eb06d73f746fd3e698c9dc5e722cc06d594da70f49ca84"}
Jul 22 21:32:44.957678 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.957585    2576 scope.go:117] "RemoveContainer" containerID="ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313"
Jul 22 21:32:44.966822 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.966805    2576 scope.go:117] "RemoveContainer" containerID="ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313"
Jul 22 21:32:44.967085 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:32:44.967053    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313\": container with ID starting with ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313 not found: ID does not exist" containerID="ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313"
Jul 22 21:32:44.967142 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.967099    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313"} err="failed to get container status \"ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313\": rpc error: code = NotFound desc = could not find container \"ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313\": container with ID starting with ca05b12f27f0612306c61d6ee02f39b60e6e55b7d3d1fcfb6eff583909ae5313 not found: ID does not exist"
Jul 22 21:32:44.979303 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.979280    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"]
Jul 22 21:32:44.983825 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:44.983799    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-71e1eaff-kserve-8684c55655-c5l7l"]
Jul 22 21:32:45.750740 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:32:45.750697    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" path="/var/lib/kubelet/pods/93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee/volumes"
Jul 22 21:35:23.800602 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:35:23.800576    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:35:23.804294 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:35:23.804272    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:35:23.807961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:35:23.807932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:35:23.811166 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:35:23.811149    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:36:11.024109 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.024049    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"]
Jul 22 21:36:11.025399 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.025356    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" containerName="main"
Jul 22 21:36:11.025399 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.025386    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" containerName="main"
Jul 22 21:36:11.025619 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.025526    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93dd7eee-cd7f-4bb6-b449-2ee8e3e256ee" containerName="main"
Jul 22 21:36:11.028553 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.028530    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.031636 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.031614    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-69774d8e-serving-cert\""
Jul 22 21:36:11.044466 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.044438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"]
Jul 22 21:36:11.110082 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.110032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh2w8\" (UniqueName: \"kubernetes.io/projected/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-kube-api-access-vh2w8\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.110291 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.110136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.110291 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.110162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-openshift-service-ca\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.210795 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.210760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh2w8\" (UniqueName: \"kubernetes.io/projected/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-kube-api-access-vh2w8\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.210975 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.210817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.210975 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.210835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-openshift-service-ca\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.211054 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:36:11.210972    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-serving-cert: secret "maas-api-e2e-ait-69774d8e-serving-cert" not found
Jul 22 21:36:11.211054 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:36:11.211039    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls podName:d28e9fcb-9522-4ca8-9a5a-6ab5f4441663 nodeName:}" failed. No retries permitted until 2026-07-22 21:36:11.711019975 +0000 UTC m=+1848.493921774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls") pod "maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" (UID: "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663") : secret "maas-api-e2e-ait-69774d8e-serving-cert" not found
Jul 22 21:36:11.211524 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.211506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-openshift-service-ca\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.220636 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.220603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh2w8\" (UniqueName: \"kubernetes.io/projected/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-kube-api-access-vh2w8\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.714548 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.714515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.717052 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.717024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls\") pod \"maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:11.940287 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:11.940210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:12.082816 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:12.082792    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"]
Jul 22 21:36:12.085257 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:36:12.085223    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28e9fcb_9522_4ca8_9a5a_6ab5f4441663.slice/crio-d4ff34a2fffdfa84be54dd19138052a98bb98c07530035d71f890cb8dabda242 WatchSource:0}: Error finding container d4ff34a2fffdfa84be54dd19138052a98bb98c07530035d71f890cb8dabda242: Status 404 returned error can't find the container with id d4ff34a2fffdfa84be54dd19138052a98bb98c07530035d71f890cb8dabda242
Jul 22 21:36:12.086732 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:12.086711    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:36:12.918135 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:12.918098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" event={"ID":"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663","Type":"ContainerStarted","Data":"e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b"}
Jul 22 21:36:12.918324 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:12.918151    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" event={"ID":"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663","Type":"ContainerStarted","Data":"d4ff34a2fffdfa84be54dd19138052a98bb98c07530035d71f890cb8dabda242"}
Jul 22 21:36:12.918324 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:12.918182    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:12.939972 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:12.939919    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" podStartSLOduration=1.481145856 podStartE2EDuration="1.939900433s" totalImagesPullingTime="458.754577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:36:12.937888322 +0000 UTC m=+1849.720790149" watchObservedRunningTime="2026-07-22 21:36:12.939900433 +0000 UTC m=+1849.722802251"
Jul 22 21:36:18.928778 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:18.928747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:46.730904 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:46.730866    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"]
Jul 22 21:36:46.731527 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:46.731165    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" podUID="d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" containerName="maas-api" containerID="cri-o://e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b" gracePeriod=30
Jul 22 21:36:46.980216 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:46.980181    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:47.089452 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.089425    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"
Jul 22 21:36:47.089452 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.089369    2576 generic.go:356] "Generic (PLEG): container finished" podID="d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" containerID="e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b" exitCode=0
Jul 22 21:36:47.089717 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.089477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" event={"ID":"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663","Type":"ContainerDied","Data":"e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b"}
Jul 22 21:36:47.089717 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.089542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr" event={"ID":"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663","Type":"ContainerDied","Data":"d4ff34a2fffdfa84be54dd19138052a98bb98c07530035d71f890cb8dabda242"}
Jul 22 21:36:47.089717 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.089577    2576 scope.go:117] "RemoveContainer" containerID="e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b"
Jul 22 21:36:47.098429 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.098409    2576 scope.go:117] "RemoveContainer" containerID="e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b"
Jul 22 21:36:47.098710 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:36:47.098692    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b\": container with ID starting with e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b not found: ID does not exist" containerID="e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b"
Jul 22 21:36:47.098777 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.098724    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b"} err="failed to get container status \"e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b\": rpc error: code = NotFound desc = could not find container \"e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b\": container with ID starting with e2513da705cff2af022bc77f40a0db1496ceb1bda9c23a0cfb224fdb2517980b not found: ID does not exist"
Jul 22 21:36:47.139791 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.139760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls\") pod \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") "
Jul 22 21:36:47.139993 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.139823    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-openshift-service-ca\") pod \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") "
Jul 22 21:36:47.139993 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.139865    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh2w8\" (UniqueName: \"kubernetes.io/projected/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-kube-api-access-vh2w8\") pod \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\" (UID: \"d28e9fcb-9522-4ca8-9a5a-6ab5f4441663\") "
Jul 22 21:36:47.140325 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.140294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" (UID: "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:36:47.142367 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.142343    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" (UID: "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:36:47.142482 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.142387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-kube-api-access-vh2w8" (OuterVolumeSpecName: "kube-api-access-vh2w8") pod "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" (UID: "d28e9fcb-9522-4ca8-9a5a-6ab5f4441663"). InnerVolumeSpecName "kube-api-access-vh2w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:36:47.240661 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.240619    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:36:47.240661 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.240653    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:36:47.240661 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.240664    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh2w8\" (UniqueName: \"kubernetes.io/projected/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663-kube-api-access-vh2w8\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:36:47.412727 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.412687    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"]
Jul 22 21:36:47.417532 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.417502    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-69774d8e-59d4ccd7db-gvqnr"]
Jul 22 21:36:47.756090 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:47.755995    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" path="/var/lib/kubelet/pods/d28e9fcb-9522-4ca8-9a5a-6ab5f4441663/volumes"
Jul 22 21:36:59.703384 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.703350    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"]
Jul 22 21:36:59.703936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.703921    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" containerName="maas-api"
Jul 22 21:36:59.703983 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.703940    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" containerName="maas-api"
Jul 22 21:36:59.704092 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.704060    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28e9fcb-9522-4ca8-9a5a-6ab5f4441663" containerName="maas-api"
Jul 22 21:36:59.707430 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.707410    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.710031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.710012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-13623ccb-serving-cert\""
Jul 22 21:36:59.717303 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.717279    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"]
Jul 22 21:36:59.747548 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.747511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztmrs\" (UniqueName: \"kubernetes.io/projected/1b516a88-f6fd-4d86-b84d-81e8237de2a2-kube-api-access-ztmrs\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.747548 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.747550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b516a88-f6fd-4d86-b84d-81e8237de2a2-openshift-service-ca\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.747751 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.747645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b516a88-f6fd-4d86-b84d-81e8237de2a2-maas-api-tls\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.848803 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.848765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b516a88-f6fd-4d86-b84d-81e8237de2a2-maas-api-tls\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.849033 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.848865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztmrs\" (UniqueName: \"kubernetes.io/projected/1b516a88-f6fd-4d86-b84d-81e8237de2a2-kube-api-access-ztmrs\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.849033 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.848899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b516a88-f6fd-4d86-b84d-81e8237de2a2-openshift-service-ca\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.849592 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.849565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b516a88-f6fd-4d86-b84d-81e8237de2a2-openshift-service-ca\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.851540 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.851516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b516a88-f6fd-4d86-b84d-81e8237de2a2-maas-api-tls\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:36:59.857642 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:36:59.857606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztmrs\" (UniqueName: \"kubernetes.io/projected/1b516a88-f6fd-4d86-b84d-81e8237de2a2-kube-api-access-ztmrs\") pod \"maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:37:00.020361 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:00.020249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:37:00.166909 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:00.166881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"]
Jul 22 21:37:00.169126 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:37:00.169096    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b516a88_f6fd_4d86_b84d_81e8237de2a2.slice/crio-6eee4dec36bed139521f890454cc9f53a113e072abfefbae6330006e20b5ff46 WatchSource:0}: Error finding container 6eee4dec36bed139521f890454cc9f53a113e072abfefbae6330006e20b5ff46: Status 404 returned error can't find the container with id 6eee4dec36bed139521f890454cc9f53a113e072abfefbae6330006e20b5ff46
Jul 22 21:37:01.159294 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:01.159209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh" event={"ID":"1b516a88-f6fd-4d86-b84d-81e8237de2a2","Type":"ContainerStarted","Data":"94c1989b8ef3172b3c3c747a81f5c2765a6d13959580dc840724850df0f8fbc4"}
Jul 22 21:37:01.159294 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:01.159262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh" event={"ID":"1b516a88-f6fd-4d86-b84d-81e8237de2a2","Type":"ContainerStarted","Data":"6eee4dec36bed139521f890454cc9f53a113e072abfefbae6330006e20b5ff46"}
Jul 22 21:37:01.159683 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:01.159318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:37:01.177559 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:01.177507    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh" podStartSLOduration=1.5250002230000002 podStartE2EDuration="2.177490136s" totalImagesPullingTime="652.489913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:37:01.175703124 +0000 UTC m=+1897.958604952" watchObservedRunningTime="2026-07-22 21:37:01.177490136 +0000 UTC m=+1897.960391952"
Jul 22 21:37:07.169306 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:07.169276    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:37:35.080668 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.080637    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"]
Jul 22 21:37:35.081132 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.080856    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh" podUID="1b516a88-f6fd-4d86-b84d-81e8237de2a2" containerName="maas-api" containerID="cri-o://94c1989b8ef3172b3c3c747a81f5c2765a6d13959580dc840724850df0f8fbc4" gracePeriod=30
Jul 22 21:37:35.326282 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.326253    2576 generic.go:356] "Generic (PLEG): container finished" podID="1b516a88-f6fd-4d86-b84d-81e8237de2a2" containerID="94c1989b8ef3172b3c3c747a81f5c2765a6d13959580dc840724850df0f8fbc4" exitCode=0
Jul 22 21:37:35.326420 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.326325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh" event={"ID":"1b516a88-f6fd-4d86-b84d-81e8237de2a2","Type":"ContainerDied","Data":"94c1989b8ef3172b3c3c747a81f5c2765a6d13959580dc840724850df0f8fbc4"}
Jul 22 21:37:35.326420 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.326386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh" event={"ID":"1b516a88-f6fd-4d86-b84d-81e8237de2a2","Type":"ContainerDied","Data":"6eee4dec36bed139521f890454cc9f53a113e072abfefbae6330006e20b5ff46"}
Jul 22 21:37:35.326420 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.326409    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6eee4dec36bed139521f890454cc9f53a113e072abfefbae6330006e20b5ff46"
Jul 22 21:37:35.332285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.332231    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:37:35.368990 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.368970    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztmrs\" (UniqueName: \"kubernetes.io/projected/1b516a88-f6fd-4d86-b84d-81e8237de2a2-kube-api-access-ztmrs\") pod \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") "
Jul 22 21:37:35.369118 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.369026    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b516a88-f6fd-4d86-b84d-81e8237de2a2-openshift-service-ca\") pod \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") "
Jul 22 21:37:35.369118 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.369056    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b516a88-f6fd-4d86-b84d-81e8237de2a2-maas-api-tls\") pod \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\" (UID: \"1b516a88-f6fd-4d86-b84d-81e8237de2a2\") "
Jul 22 21:37:35.369428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.369409    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b516a88-f6fd-4d86-b84d-81e8237de2a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b516a88-f6fd-4d86-b84d-81e8237de2a2" (UID: "1b516a88-f6fd-4d86-b84d-81e8237de2a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:37:35.371270 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.371241    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b516a88-f6fd-4d86-b84d-81e8237de2a2-kube-api-access-ztmrs" (OuterVolumeSpecName: "kube-api-access-ztmrs") pod "1b516a88-f6fd-4d86-b84d-81e8237de2a2" (UID: "1b516a88-f6fd-4d86-b84d-81e8237de2a2"). InnerVolumeSpecName "kube-api-access-ztmrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:37:35.371410 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.371390    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b516a88-f6fd-4d86-b84d-81e8237de2a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b516a88-f6fd-4d86-b84d-81e8237de2a2" (UID: "1b516a88-f6fd-4d86-b84d-81e8237de2a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:37:35.469933 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.469899    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b516a88-f6fd-4d86-b84d-81e8237de2a2-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:37:35.469933 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.469929    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b516a88-f6fd-4d86-b84d-81e8237de2a2-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:37:35.469933 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:35.469939    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztmrs\" (UniqueName: \"kubernetes.io/projected/1b516a88-f6fd-4d86-b84d-81e8237de2a2-kube-api-access-ztmrs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:37:36.331401 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:36.331370    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"
Jul 22 21:37:36.354648 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:36.354618    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"]
Jul 22 21:37:36.358929 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:36.358908    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13623ccb-64b65d87f4-z2sdh"]
Jul 22 21:37:37.751333 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:37.751303    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b516a88-f6fd-4d86-b84d-81e8237de2a2" path="/var/lib/kubelet/pods/1b516a88-f6fd-4d86-b84d-81e8237de2a2/volumes"
Jul 22 21:37:42.811787 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.811748    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"]
Jul 22 21:37:42.812349 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.812323    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b516a88-f6fd-4d86-b84d-81e8237de2a2" containerName="maas-api"
Jul 22 21:37:42.812349 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.812348    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b516a88-f6fd-4d86-b84d-81e8237de2a2" containerName="maas-api"
Jul 22 21:37:42.812506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.812480    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b516a88-f6fd-4d86-b84d-81e8237de2a2" containerName="maas-api"
Jul 22 21:37:42.816006 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.815986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.818903 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.818877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8712ba9a-serving-cert\""
Jul 22 21:37:42.829647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.829615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"]
Jul 22 21:37:42.839963 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.839930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.840220 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.840089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cd0d7d-6847-4224-b581-e9a4ff4a920b-openshift-service-ca\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.840220 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.840159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vcj\" (UniqueName: \"kubernetes.io/projected/34cd0d7d-6847-4224-b581-e9a4ff4a920b-kube-api-access-l8vcj\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.940839 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.940801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.941023 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.940864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cd0d7d-6847-4224-b581-e9a4ff4a920b-openshift-service-ca\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.941023 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.940889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vcj\" (UniqueName: \"kubernetes.io/projected/34cd0d7d-6847-4224-b581-e9a4ff4a920b-kube-api-access-l8vcj\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.941023 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:37:42.940953    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-serving-cert: secret "maas-api-e2e-ait-8712ba9a-serving-cert" not found
Jul 22 21:37:42.941154 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:37:42.941033    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls podName:34cd0d7d-6847-4224-b581-e9a4ff4a920b nodeName:}" failed. No retries permitted until 2026-07-22 21:37:43.44101226 +0000 UTC m=+1940.223914059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls") pod "maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" (UID: "34cd0d7d-6847-4224-b581-e9a4ff4a920b") : secret "maas-api-e2e-ait-8712ba9a-serving-cert" not found
Jul 22 21:37:42.941598 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.941579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cd0d7d-6847-4224-b581-e9a4ff4a920b-openshift-service-ca\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:42.955885 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:42.955856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vcj\" (UniqueName: \"kubernetes.io/projected/34cd0d7d-6847-4224-b581-e9a4ff4a920b-kube-api-access-l8vcj\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:43.446419 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:43.446381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:43.449211 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:43.449185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls\") pod \"maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:43.728091 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:43.728001    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:43.878394 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:43.878366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"]
Jul 22 21:37:43.880359 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:37:43.880331    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cd0d7d_6847_4224_b581_e9a4ff4a920b.slice/crio-7d7e338eac21a4d16b48d0cc2cc63e8fe4bf6e01933b2b5b98a155f674043fef WatchSource:0}: Error finding container 7d7e338eac21a4d16b48d0cc2cc63e8fe4bf6e01933b2b5b98a155f674043fef: Status 404 returned error can't find the container with id 7d7e338eac21a4d16b48d0cc2cc63e8fe4bf6e01933b2b5b98a155f674043fef
Jul 22 21:37:44.371882 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:44.371842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" event={"ID":"34cd0d7d-6847-4224-b581-e9a4ff4a920b","Type":"ContainerStarted","Data":"a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7"}
Jul 22 21:37:44.372034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:44.371905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" event={"ID":"34cd0d7d-6847-4224-b581-e9a4ff4a920b","Type":"ContainerStarted","Data":"7d7e338eac21a4d16b48d0cc2cc63e8fe4bf6e01933b2b5b98a155f674043fef"}
Jul 22 21:37:44.372034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:44.371943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:37:44.394014 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:44.393956    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" podStartSLOduration=2.009574699 podStartE2EDuration="2.393935211s" totalImagesPullingTime="384.360512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:37:44.393669388 +0000 UTC m=+1941.176571237" watchObservedRunningTime="2026-07-22 21:37:44.393935211 +0000 UTC m=+1941.176837041"
Jul 22 21:37:50.382627 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:37:50.382598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:38:19.097936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.097860    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"]
Jul 22 21:38:19.098344 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.098127    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" podUID="34cd0d7d-6847-4224-b581-e9a4ff4a920b" containerName="maas-api" containerID="cri-o://a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7" gracePeriod=30
Jul 22 21:38:19.341901 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.341879    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:38:19.366537 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.366486    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cd0d7d-6847-4224-b581-e9a4ff4a920b-openshift-service-ca\") pod \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") "
Jul 22 21:38:19.366632 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.366576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls\") pod \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") "
Jul 22 21:38:19.366684 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.366661    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8vcj\" (UniqueName: \"kubernetes.io/projected/34cd0d7d-6847-4224-b581-e9a4ff4a920b-kube-api-access-l8vcj\") pod \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\" (UID: \"34cd0d7d-6847-4224-b581-e9a4ff4a920b\") "
Jul 22 21:38:19.366889 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.366865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34cd0d7d-6847-4224-b581-e9a4ff4a920b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34cd0d7d-6847-4224-b581-e9a4ff4a920b" (UID: "34cd0d7d-6847-4224-b581-e9a4ff4a920b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:38:19.367003 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.366989    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34cd0d7d-6847-4224-b581-e9a4ff4a920b-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:38:19.368882 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.368855    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34cd0d7d-6847-4224-b581-e9a4ff4a920b-kube-api-access-l8vcj" (OuterVolumeSpecName: "kube-api-access-l8vcj") pod "34cd0d7d-6847-4224-b581-e9a4ff4a920b" (UID: "34cd0d7d-6847-4224-b581-e9a4ff4a920b"). InnerVolumeSpecName "kube-api-access-l8vcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:38:19.368982 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.368905    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34cd0d7d-6847-4224-b581-e9a4ff4a920b" (UID: "34cd0d7d-6847-4224-b581-e9a4ff4a920b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:38:19.467834 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.467808    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34cd0d7d-6847-4224-b581-e9a4ff4a920b-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:38:19.467834 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.467833    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8vcj\" (UniqueName: \"kubernetes.io/projected/34cd0d7d-6847-4224-b581-e9a4ff4a920b-kube-api-access-l8vcj\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:38:19.542597 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.542565    2576 generic.go:356] "Generic (PLEG): container finished" podID="34cd0d7d-6847-4224-b581-e9a4ff4a920b" containerID="a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7" exitCode=0
Jul 22 21:38:19.542725 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.542605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" event={"ID":"34cd0d7d-6847-4224-b581-e9a4ff4a920b","Type":"ContainerDied","Data":"a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7"}
Jul 22 21:38:19.542725 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.542617    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"
Jul 22 21:38:19.542725 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.542654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2" event={"ID":"34cd0d7d-6847-4224-b581-e9a4ff4a920b","Type":"ContainerDied","Data":"7d7e338eac21a4d16b48d0cc2cc63e8fe4bf6e01933b2b5b98a155f674043fef"}
Jul 22 21:38:19.542725 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.542682    2576 scope.go:117] "RemoveContainer" containerID="a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7"
Jul 22 21:38:19.552275 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.552258    2576 scope.go:117] "RemoveContainer" containerID="a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7"
Jul 22 21:38:19.552515 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:38:19.552498    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7\": container with ID starting with a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7 not found: ID does not exist" containerID="a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7"
Jul 22 21:38:19.552575 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.552522    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7"} err="failed to get container status \"a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7\": rpc error: code = NotFound desc = could not find container \"a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7\": container with ID starting with a05d158aa63e861352e384194d46daaa3c1f85841384757143593098865314f7 not found: ID does not exist"
Jul 22 21:38:19.564353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.564134    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"]
Jul 22 21:38:19.566345 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.566326    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8712ba9a-9fc49cf99-rzxz2"]
Jul 22 21:38:19.749931 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:19.749853    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34cd0d7d-6847-4224-b581-e9a4ff4a920b" path="/var/lib/kubelet/pods/34cd0d7d-6847-4224-b581-e9a4ff4a920b/volumes"
Jul 22 21:38:28.124248 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.124217    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"]
Jul 22 21:38:28.124775 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.124761    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34cd0d7d-6847-4224-b581-e9a4ff4a920b" containerName="maas-api"
Jul 22 21:38:28.124826 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.124778    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34cd0d7d-6847-4224-b581-e9a4ff4a920b" containerName="maas-api"
Jul 22 21:38:28.124884 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.124873    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34cd0d7d-6847-4224-b581-e9a4ff4a920b" containerName="maas-api"
Jul 22 21:38:28.128143 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.128120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.131153 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.131133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a2e03361-serving-cert\""
Jul 22 21:38:28.143122 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.143100    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"]
Jul 22 21:38:28.234254 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.234226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7n6k\" (UniqueName: \"kubernetes.io/projected/e27a951e-383d-4327-9195-688b1361276e-kube-api-access-f7n6k\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.234402 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.234285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e27a951e-383d-4327-9195-688b1361276e-openshift-service-ca\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.234402 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.234322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e27a951e-383d-4327-9195-688b1361276e-maas-api-tls\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.335383 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.335353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n6k\" (UniqueName: \"kubernetes.io/projected/e27a951e-383d-4327-9195-688b1361276e-kube-api-access-f7n6k\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.335516 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.335420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e27a951e-383d-4327-9195-688b1361276e-openshift-service-ca\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.335516 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.335459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e27a951e-383d-4327-9195-688b1361276e-maas-api-tls\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.336011 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.335992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e27a951e-383d-4327-9195-688b1361276e-openshift-service-ca\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.337886 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.337865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e27a951e-383d-4327-9195-688b1361276e-maas-api-tls\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.343989 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.343967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7n6k\" (UniqueName: \"kubernetes.io/projected/e27a951e-383d-4327-9195-688b1361276e-kube-api-access-f7n6k\") pod \"maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.437946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.437885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:28.570868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.570843    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"]
Jul 22 21:38:28.572671 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:38:28.572644    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27a951e_383d_4327_9195_688b1361276e.slice/crio-0facaa686f28bd5dbb7d4b9804c28a67c11a1f084991e86ba8514781f93ac0e9 WatchSource:0}: Error finding container 0facaa686f28bd5dbb7d4b9804c28a67c11a1f084991e86ba8514781f93ac0e9: Status 404 returned error can't find the container with id 0facaa686f28bd5dbb7d4b9804c28a67c11a1f084991e86ba8514781f93ac0e9
Jul 22 21:38:28.587024 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:28.586993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c" event={"ID":"e27a951e-383d-4327-9195-688b1361276e","Type":"ContainerStarted","Data":"0facaa686f28bd5dbb7d4b9804c28a67c11a1f084991e86ba8514781f93ac0e9"}
Jul 22 21:38:29.593021 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:29.592984    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c" event={"ID":"e27a951e-383d-4327-9195-688b1361276e","Type":"ContainerStarted","Data":"fba424c8a32be569df05b1dc8e1fe24cf5054edf5f8d20650ce82bc2eeff801e"}
Jul 22 21:38:29.593403 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:29.593112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:38:29.612134 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:29.612057    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c" podStartSLOduration=1.227728571 podStartE2EDuration="1.612038522s" totalImagesPullingTime="384.309951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:38:29.611188055 +0000 UTC m=+1986.394089873" watchObservedRunningTime="2026-07-22 21:38:29.612038522 +0000 UTC m=+1986.394940342"
Jul 22 21:38:35.603517 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:38:35.603489    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:39:03.607271 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:03.607239    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"]
Jul 22 21:39:03.607773 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:03.607433    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c" podUID="e27a951e-383d-4327-9195-688b1361276e" containerName="maas-api" containerID="cri-o://fba424c8a32be569df05b1dc8e1fe24cf5054edf5f8d20650ce82bc2eeff801e" gracePeriod=30
Jul 22 21:39:03.760723 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:03.760693    2576 generic.go:356] "Generic (PLEG): container finished" podID="e27a951e-383d-4327-9195-688b1361276e" containerID="fba424c8a32be569df05b1dc8e1fe24cf5054edf5f8d20650ce82bc2eeff801e" exitCode=0
Jul 22 21:39:03.760889 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:03.760774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c" event={"ID":"e27a951e-383d-4327-9195-688b1361276e","Type":"ContainerDied","Data":"fba424c8a32be569df05b1dc8e1fe24cf5054edf5f8d20650ce82bc2eeff801e"}
Jul 22 21:39:03.855041 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:03.855013    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:39:04.018269 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.018189    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e27a951e-383d-4327-9195-688b1361276e-openshift-service-ca\") pod \"e27a951e-383d-4327-9195-688b1361276e\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") "
Jul 22 21:39:04.018269 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.018244    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7n6k\" (UniqueName: \"kubernetes.io/projected/e27a951e-383d-4327-9195-688b1361276e-kube-api-access-f7n6k\") pod \"e27a951e-383d-4327-9195-688b1361276e\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") "
Jul 22 21:39:04.018472 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.018390    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e27a951e-383d-4327-9195-688b1361276e-maas-api-tls\") pod \"e27a951e-383d-4327-9195-688b1361276e\" (UID: \"e27a951e-383d-4327-9195-688b1361276e\") "
Jul 22 21:39:04.018579 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.018559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e27a951e-383d-4327-9195-688b1361276e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e27a951e-383d-4327-9195-688b1361276e" (UID: "e27a951e-383d-4327-9195-688b1361276e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:39:04.018664 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.018647    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e27a951e-383d-4327-9195-688b1361276e-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:39:04.020336 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.020311    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27a951e-383d-4327-9195-688b1361276e-kube-api-access-f7n6k" (OuterVolumeSpecName: "kube-api-access-f7n6k") pod "e27a951e-383d-4327-9195-688b1361276e" (UID: "e27a951e-383d-4327-9195-688b1361276e"). InnerVolumeSpecName "kube-api-access-f7n6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:39:04.020439 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.020396    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27a951e-383d-4327-9195-688b1361276e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e27a951e-383d-4327-9195-688b1361276e" (UID: "e27a951e-383d-4327-9195-688b1361276e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:39:04.119391 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.119367    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e27a951e-383d-4327-9195-688b1361276e-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:39:04.119391 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.119389    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7n6k\" (UniqueName: \"kubernetes.io/projected/e27a951e-383d-4327-9195-688b1361276e-kube-api-access-f7n6k\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:39:04.766815 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.766787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c" event={"ID":"e27a951e-383d-4327-9195-688b1361276e","Type":"ContainerDied","Data":"0facaa686f28bd5dbb7d4b9804c28a67c11a1f084991e86ba8514781f93ac0e9"}
Jul 22 21:39:04.766815 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.766807    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"
Jul 22 21:39:04.767263 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.766844    2576 scope.go:117] "RemoveContainer" containerID="fba424c8a32be569df05b1dc8e1fe24cf5054edf5f8d20650ce82bc2eeff801e"
Jul 22 21:39:04.788566 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.788539    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"]
Jul 22 21:39:04.794181 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:04.794162    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a2e03361-544bf6d9d-c9l7c"]
Jul 22 21:39:05.750957 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:39:05.750916    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27a951e-383d-4327-9195-688b1361276e" path="/var/lib/kubelet/pods/e27a951e-383d-4327-9195-688b1361276e/volumes"
Jul 22 21:40:23.830432 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:23.830403    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:40:23.833910 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:23.833890    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:40:23.839000 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:23.838983    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:40:23.842148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:23.842134    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:40:52.565033 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.564999    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"]
Jul 22 21:40:52.565516 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.565385    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27a951e-383d-4327-9195-688b1361276e" containerName="maas-api"
Jul 22 21:40:52.565516 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.565397    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27a951e-383d-4327-9195-688b1361276e" containerName="maas-api"
Jul 22 21:40:52.565516 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.565466    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e27a951e-383d-4327-9195-688b1361276e" containerName="maas-api"
Jul 22 21:40:52.568777 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.568756    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.578385 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.578365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-797b14ce-serving-cert\""
Jul 22 21:40:52.604048 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.604019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"]
Jul 22 21:40:52.710455 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.710424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-openshift-service-ca\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.710635 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.710470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-maas-api-tls\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.710635 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.710492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqf57\" (UniqueName: \"kubernetes.io/projected/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-kube-api-access-xqf57\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.811353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.811311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-openshift-service-ca\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.811533 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.811367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-maas-api-tls\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.811533 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.811386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf57\" (UniqueName: \"kubernetes.io/projected/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-kube-api-access-xqf57\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.811970 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.811949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-openshift-service-ca\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.813909 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.813886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-maas-api-tls\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.826215 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.826192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqf57\" (UniqueName: \"kubernetes.io/projected/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-kube-api-access-xqf57\") pod \"maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:52.879960 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:52.879929    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:53.234751 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:53.234725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"]
Jul 22 21:40:53.236803 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:40:53.236775    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7903de3e_f9d2_49b2_a41c_1c5a5ccd6997.slice/crio-555112df0d4dd980df68b98f0cf134a953964038e045ebe909aa6b0fff1766cf WatchSource:0}: Error finding container 555112df0d4dd980df68b98f0cf134a953964038e045ebe909aa6b0fff1766cf: Status 404 returned error can't find the container with id 555112df0d4dd980df68b98f0cf134a953964038e045ebe909aa6b0fff1766cf
Jul 22 21:40:53.274280 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:53.274253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx" event={"ID":"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997","Type":"ContainerStarted","Data":"555112df0d4dd980df68b98f0cf134a953964038e045ebe909aa6b0fff1766cf"}
Jul 22 21:40:54.281127 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:54.281051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx" event={"ID":"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997","Type":"ContainerStarted","Data":"807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3"}
Jul 22 21:40:54.281522 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:54.281219    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:40:54.321265 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:40:54.321213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx" podStartSLOduration=1.931352384 podStartE2EDuration="2.321196848s" totalImagesPullingTime="389.844464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:40:54.319515894 +0000 UTC m=+2131.102417704" watchObservedRunningTime="2026-07-22 21:40:54.321196848 +0000 UTC m=+2131.104098691"
Jul 22 21:41:00.291755 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:00.291724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:41:14.659334 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.659300    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"]
Jul 22 21:41:14.659755 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.659528    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx" podUID="7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" containerName="maas-api" containerID="cri-o://807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3" gracePeriod=30
Jul 22 21:41:14.897459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.897438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:41:14.906281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.906255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-openshift-service-ca\") pod \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") "
Jul 22 21:41:14.906408 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.906391    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-maas-api-tls\") pod \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") "
Jul 22 21:41:14.906475 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.906441    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqf57\" (UniqueName: \"kubernetes.io/projected/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-kube-api-access-xqf57\") pod \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\" (UID: \"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997\") "
Jul 22 21:41:14.906582 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.906560    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" (UID: "7903de3e-f9d2-49b2-a41c-1c5a5ccd6997"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:41:14.906706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.906695    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:41:14.908483 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.908458    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" (UID: "7903de3e-f9d2-49b2-a41c-1c5a5ccd6997"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:41:14.908584 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:14.908481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-kube-api-access-xqf57" (OuterVolumeSpecName: "kube-api-access-xqf57") pod "7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" (UID: "7903de3e-f9d2-49b2-a41c-1c5a5ccd6997"). InnerVolumeSpecName "kube-api-access-xqf57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:41:15.008030 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.007993    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:41:15.008030 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.008025    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqf57\" (UniqueName: \"kubernetes.io/projected/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997-kube-api-access-xqf57\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:41:15.385446 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.385417    2576 generic.go:356] "Generic (PLEG): container finished" podID="7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" containerID="807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3" exitCode=0
Jul 22 21:41:15.385630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.385458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx" event={"ID":"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997","Type":"ContainerDied","Data":"807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3"}
Jul 22 21:41:15.385630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.385465    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"
Jul 22 21:41:15.385630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.385514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx" event={"ID":"7903de3e-f9d2-49b2-a41c-1c5a5ccd6997","Type":"ContainerDied","Data":"555112df0d4dd980df68b98f0cf134a953964038e045ebe909aa6b0fff1766cf"}
Jul 22 21:41:15.385630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.385538    2576 scope.go:117] "RemoveContainer" containerID="807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3"
Jul 22 21:41:15.394839 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.394822    2576 scope.go:117] "RemoveContainer" containerID="807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3"
Jul 22 21:41:15.395134 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:41:15.395115    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3\": container with ID starting with 807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3 not found: ID does not exist" containerID="807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3"
Jul 22 21:41:15.395195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.395143    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3"} err="failed to get container status \"807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3\": rpc error: code = NotFound desc = could not find container \"807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3\": container with ID starting with 807b88a0ffb3a47cfdd7d6a16a950eba8540791c9c25ce47a597081f4dc93dd3 not found: ID does not exist"
Jul 22 21:41:15.412600 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.412578    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"]
Jul 22 21:41:15.416156 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.416135    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-797b14ce-6568dfdbcc-78hpx"]
Jul 22 21:41:15.750440 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:15.750361    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" path="/var/lib/kubelet/pods/7903de3e-f9d2-49b2-a41c-1c5a5ccd6997/volumes"
Jul 22 21:41:51.918645 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.918600    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"]
Jul 22 21:41:51.919034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.918971    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" containerName="maas-api"
Jul 22 21:41:51.919034 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.918981    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" containerName="maas-api"
Jul 22 21:41:51.919135 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.919059    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7903de3e-f9d2-49b2-a41c-1c5a5ccd6997" containerName="maas-api"
Jul 22 21:41:51.922389 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.922371    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:51.926462 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:41:51.926433    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-e2e-mt-b765b624-serving-cert\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b765b624-serving-cert\"" type="*v1.Secret"
Jul 22 21:41:51.926660 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:41:51.926633    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="b3dbbe3b-8369-4643-862b-675236cc01b0" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:51.947484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.947463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3dbbe3b-8369-4643-862b-675236cc01b0-openshift-service-ca\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:51.947579 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.947504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krz5j\" (UniqueName: \"kubernetes.io/projected/b3dbbe3b-8369-4643-862b-675236cc01b0-kube-api-access-krz5j\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:51.947579 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.947555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:51.982434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:51.982409    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"]
Jul 22 21:41:52.048700 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:52.048669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:52.048841 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:52.048743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3dbbe3b-8369-4643-862b-675236cc01b0-openshift-service-ca\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:52.048841 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:52.048791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krz5j\" (UniqueName: \"kubernetes.io/projected/b3dbbe3b-8369-4643-862b-675236cc01b0-kube-api-access-krz5j\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:52.049363 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:52.049342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3dbbe3b-8369-4643-862b-675236cc01b0-openshift-service-ca\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:52.090932 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:52.090904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krz5j\" (UniqueName: \"kubernetes.io/projected/b3dbbe3b-8369-4643-862b-675236cc01b0-kube-api-access-krz5j\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:53.049095 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:41:53.049050    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 22 21:41:53.049461 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:41:53.049149    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls podName:b3dbbe3b-8369-4643-862b-675236cc01b0 nodeName:}" failed. No retries permitted until 2026-07-22 21:41:53.549133194 +0000 UTC m=+2190.332034990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls") pod "maas-api-e2e-mt-b765b624-88d949f7-74jrd" (UID: "b3dbbe3b-8369-4643-862b-675236cc01b0") : failed to sync secret cache: timed out waiting for the condition
Jul 22 21:41:53.426863 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:53.426838    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b765b624-serving-cert\""
Jul 22 21:41:53.562807 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:53.562779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:53.565573 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:53.565546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls\") pod \"maas-api-e2e-mt-b765b624-88d949f7-74jrd\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:53.732533 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:53.732457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:53.866828 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:53.866806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"]
Jul 22 21:41:53.868532 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:41:53.868506    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3dbbe3b_8369_4643_862b_675236cc01b0.slice/crio-38a06fce916f9d578fb62b03b86b948e9dab384dc13c78e12ee44a559e563253 WatchSource:0}: Error finding container 38a06fce916f9d578fb62b03b86b948e9dab384dc13c78e12ee44a559e563253: Status 404 returned error can't find the container with id 38a06fce916f9d578fb62b03b86b948e9dab384dc13c78e12ee44a559e563253
Jul 22 21:41:53.869852 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:53.869831    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:41:54.572924 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:54.572896    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd" event={"ID":"b3dbbe3b-8369-4643-862b-675236cc01b0","Type":"ContainerStarted","Data":"b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4"}
Jul 22 21:41:54.573314 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:54.572943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd" event={"ID":"b3dbbe3b-8369-4643-862b-675236cc01b0","Type":"ContainerStarted","Data":"38a06fce916f9d578fb62b03b86b948e9dab384dc13c78e12ee44a559e563253"}
Jul 22 21:41:54.573314 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:54.572994    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:41:54.596683 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:41:54.596597    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd" podStartSLOduration=3.123142036 podStartE2EDuration="3.596583209s" totalImagesPullingTime="473.441173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:41:54.594516511 +0000 UTC m=+2191.377418325" watchObservedRunningTime="2026-07-22 21:41:54.596583209 +0000 UTC m=+2191.379485025"
Jul 22 21:42:00.583678 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:00.583648    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:42:45.064561 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.064489    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"]
Jul 22 21:42:45.065086 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.064691    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd" podUID="b3dbbe3b-8369-4643-862b-675236cc01b0" containerName="maas-api" containerID="cri-o://b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4" gracePeriod=30
Jul 22 21:42:45.306167 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.306145    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:42:45.416434 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.416406    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls\") pod \"b3dbbe3b-8369-4643-862b-675236cc01b0\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") "
Jul 22 21:42:45.416570 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.416448    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3dbbe3b-8369-4643-862b-675236cc01b0-openshift-service-ca\") pod \"b3dbbe3b-8369-4643-862b-675236cc01b0\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") "
Jul 22 21:42:45.416570 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.416504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krz5j\" (UniqueName: \"kubernetes.io/projected/b3dbbe3b-8369-4643-862b-675236cc01b0-kube-api-access-krz5j\") pod \"b3dbbe3b-8369-4643-862b-675236cc01b0\" (UID: \"b3dbbe3b-8369-4643-862b-675236cc01b0\") "
Jul 22 21:42:45.416842 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.416817    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3dbbe3b-8369-4643-862b-675236cc01b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3dbbe3b-8369-4643-862b-675236cc01b0" (UID: "b3dbbe3b-8369-4643-862b-675236cc01b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:42:45.418564 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.418538    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3dbbe3b-8369-4643-862b-675236cc01b0-kube-api-access-krz5j" (OuterVolumeSpecName: "kube-api-access-krz5j") pod "b3dbbe3b-8369-4643-862b-675236cc01b0" (UID: "b3dbbe3b-8369-4643-862b-675236cc01b0"). InnerVolumeSpecName "kube-api-access-krz5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:42:45.418656 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.418567    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3dbbe3b-8369-4643-862b-675236cc01b0" (UID: "b3dbbe3b-8369-4643-862b-675236cc01b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:42:45.517395 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.517370    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krz5j\" (UniqueName: \"kubernetes.io/projected/b3dbbe3b-8369-4643-862b-675236cc01b0-kube-api-access-krz5j\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:42:45.517395 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.517393    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3dbbe3b-8369-4643-862b-675236cc01b0-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:42:45.517513 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.517402    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3dbbe3b-8369-4643-862b-675236cc01b0-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:42:45.813352 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.813324    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3dbbe3b-8369-4643-862b-675236cc01b0" containerID="b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4" exitCode=0
Jul 22 21:42:45.813468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.813362    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"
Jul 22 21:42:45.813468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.813363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd" event={"ID":"b3dbbe3b-8369-4643-862b-675236cc01b0","Type":"ContainerDied","Data":"b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4"}
Jul 22 21:42:45.813547 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.813484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd" event={"ID":"b3dbbe3b-8369-4643-862b-675236cc01b0","Type":"ContainerDied","Data":"38a06fce916f9d578fb62b03b86b948e9dab384dc13c78e12ee44a559e563253"}
Jul 22 21:42:45.813547 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.813512    2576 scope.go:117] "RemoveContainer" containerID="b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4"
Jul 22 21:42:45.821650 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.821634    2576 scope.go:117] "RemoveContainer" containerID="b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4"
Jul 22 21:42:45.821904 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:42:45.821884    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4\": container with ID starting with b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4 not found: ID does not exist" containerID="b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4"
Jul 22 21:42:45.821966 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.821910    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4"} err="failed to get container status \"b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4\": rpc error: code = NotFound desc = could not find container \"b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4\": container with ID starting with b380a4e96d99338d2d90ec61cee38f1bef4afc8d0e7e8ec9db5d79a31720d5f4 not found: ID does not exist"
Jul 22 21:42:45.853359 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.853332    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"]
Jul 22 21:42:45.860234 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:45.860212    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b765b624-88d949f7-74jrd"]
Jul 22 21:42:47.750754 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:42:47.750720    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3dbbe3b-8369-4643-862b-675236cc01b0" path="/var/lib/kubelet/pods/b3dbbe3b-8369-4643-862b-675236cc01b0/volumes"
Jul 22 21:43:23.919975 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:43:23.919946    2576 scope.go:117] "RemoveContainer" containerID="94c1989b8ef3172b3c3c747a81f5c2765a6d13959580dc840724850df0f8fbc4"
Jul 22 21:44:41.519079 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.518983    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"]
Jul 22 21:44:41.519512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.519366    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dbbe3b-8369-4643-862b-675236cc01b0" containerName="maas-api"
Jul 22 21:44:41.519512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.519378    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dbbe3b-8369-4643-862b-675236cc01b0" containerName="maas-api"
Jul 22 21:44:41.519512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.519459    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3dbbe3b-8369-4643-862b-675236cc01b0" containerName="maas-api"
Jul 22 21:44:41.521867 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.521846    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.528081 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.528042    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-3fc251-serving-cert\""
Jul 22 21:44:41.556597 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.556572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"]
Jul 22 21:44:41.598576 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.598554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d69f19e4-eb0e-4228-9259-b615f3620dff-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.598681 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.598603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnrt7\" (UniqueName: \"kubernetes.io/projected/d69f19e4-eb0e-4228-9259-b615f3620dff-kube-api-access-qnrt7\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.598745 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.598724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d69f19e4-eb0e-4228-9259-b615f3620dff-maas-api-tls\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.699765 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.699730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d69f19e4-eb0e-4228-9259-b615f3620dff-maas-api-tls\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.699931 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.699773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d69f19e4-eb0e-4228-9259-b615f3620dff-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.699931 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.699811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrt7\" (UniqueName: \"kubernetes.io/projected/d69f19e4-eb0e-4228-9259-b615f3620dff-kube-api-access-qnrt7\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.700545 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.700517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d69f19e4-eb0e-4228-9259-b615f3620dff-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.702321 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.702300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d69f19e4-eb0e-4228-9259-b615f3620dff-maas-api-tls\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.717654 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.717635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnrt7\" (UniqueName: \"kubernetes.io/projected/d69f19e4-eb0e-4228-9259-b615f3620dff-kube-api-access-qnrt7\") pod \"maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:41.832670 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:41.832651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:42.025096 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:42.025043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"]
Jul 22 21:44:42.026019 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:44:42.025992    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69f19e4_eb0e_4228_9259_b615f3620dff.slice/crio-816cab21c0e381ed0800e0bd8005e06bd46395f5c85b568390a1cfd68d5c90d5 WatchSource:0}: Error finding container 816cab21c0e381ed0800e0bd8005e06bd46395f5c85b568390a1cfd68d5c90d5: Status 404 returned error can't find the container with id 816cab21c0e381ed0800e0bd8005e06bd46395f5c85b568390a1cfd68d5c90d5
Jul 22 21:44:42.348386 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:42.348355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6" event={"ID":"d69f19e4-eb0e-4228-9259-b615f3620dff","Type":"ContainerStarted","Data":"816cab21c0e381ed0800e0bd8005e06bd46395f5c85b568390a1cfd68d5c90d5"}
Jul 22 21:44:43.354448 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:43.354409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6" event={"ID":"d69f19e4-eb0e-4228-9259-b615f3620dff","Type":"ContainerStarted","Data":"68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93"}
Jul 22 21:44:43.354886 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:43.354585    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:43.407732 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:43.407679    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6" podStartSLOduration=1.980163315 podStartE2EDuration="2.407666118s" totalImagesPullingTime="427.502803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:44:43.404976822 +0000 UTC m=+2360.187878638" watchObservedRunningTime="2026-07-22 21:44:43.407666118 +0000 UTC m=+2360.190567976"
Jul 22 21:44:49.365491 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.365461    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:44:49.458115 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.458036    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"]
Jul 22 21:44:49.461788 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.461771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.467348 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.467330    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4a3a7e-serving-cert\""
Jul 22 21:44:49.483535 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.483512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"]
Jul 22 21:44:49.564936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.564910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcs28\" (UniqueName: \"kubernetes.io/projected/237571d4-de00-49ec-8816-ba79ca7a72bf-kube-api-access-dcs28\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.565044 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.564954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237571d4-de00-49ec-8816-ba79ca7a72bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.565044 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.565032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.666484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.666431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcs28\" (UniqueName: \"kubernetes.io/projected/237571d4-de00-49ec-8816-ba79ca7a72bf-kube-api-access-dcs28\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.666484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.666459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237571d4-de00-49ec-8816-ba79ca7a72bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.666484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.666484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.666695 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:44:49.666574    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-serving-cert: secret "maas-api-e2e-inf-b-4a3a7e-serving-cert" not found
Jul 22 21:44:49.666695 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:44:49.666629    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls podName:237571d4-de00-49ec-8816-ba79ca7a72bf nodeName:}" failed. No retries permitted until 2026-07-22 21:44:50.16661447 +0000 UTC m=+2366.949516268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls") pod "maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" (UID: "237571d4-de00-49ec-8816-ba79ca7a72bf") : secret "maas-api-e2e-inf-b-4a3a7e-serving-cert" not found
Jul 22 21:44:49.667033 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.667015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237571d4-de00-49ec-8816-ba79ca7a72bf-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:49.676651 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:49.676634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcs28\" (UniqueName: \"kubernetes.io/projected/237571d4-de00-49ec-8816-ba79ca7a72bf-kube-api-access-dcs28\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:50.171544 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:50.171516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:50.174140 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:50.174108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls\") pod \"maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:50.372452 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:50.372421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:50.530114 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:50.530087    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"]
Jul 22 21:44:50.530878 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:44:50.530853    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237571d4_de00_49ec_8816_ba79ca7a72bf.slice/crio-801212e56faa43afc43034d06c37956255ba8589ea1a2b21cfdbed92301ee651 WatchSource:0}: Error finding container 801212e56faa43afc43034d06c37956255ba8589ea1a2b21cfdbed92301ee651: Status 404 returned error can't find the container with id 801212e56faa43afc43034d06c37956255ba8589ea1a2b21cfdbed92301ee651
Jul 22 21:44:51.393093 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:51.393041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" event={"ID":"237571d4-de00-49ec-8816-ba79ca7a72bf","Type":"ContainerStarted","Data":"6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172"}
Jul 22 21:44:51.393515 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:51.393110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" event={"ID":"237571d4-de00-49ec-8816-ba79ca7a72bf","Type":"ContainerStarted","Data":"801212e56faa43afc43034d06c37956255ba8589ea1a2b21cfdbed92301ee651"}
Jul 22 21:44:51.393515 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:51.393134    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:44:51.412980 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:51.412936    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" podStartSLOduration=1.773242662 podStartE2EDuration="2.412924499s" totalImagesPullingTime="639.681837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:44:51.410457348 +0000 UTC m=+2368.193359164" watchObservedRunningTime="2026-07-22 21:44:51.412924499 +0000 UTC m=+2368.195826315"
Jul 22 21:44:57.403435 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:44:57.403404    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:45:00.140565 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.140530    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"]
Jul 22 21:45:00.144115 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.144094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"
Jul 22 21:45:00.147805 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.147785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:45:00.153322 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.153305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"
Jul 22 21:45:00.159921 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.159896    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"]
Jul 22 21:45:00.286179 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.286158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"]
Jul 22 21:45:00.289105 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:45:00.289057    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3aa995_631a_4bf0_9daf_342dc12f08a5.slice/crio-ca2a8a837a18e2426eadc2418da30b53280a88509e304c72cd00a3b41c890aed WatchSource:0}: Error finding container ca2a8a837a18e2426eadc2418da30b53280a88509e304c72cd00a3b41c890aed: Status 404 returned error can't find the container with id ca2a8a837a18e2426eadc2418da30b53280a88509e304c72cd00a3b41c890aed
Jul 22 21:45:00.436456 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:00.436365    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh" event={"ID":"2d3aa995-631a-4bf0-9daf-342dc12f08a5","Type":"ContainerStarted","Data":"ca2a8a837a18e2426eadc2418da30b53280a88509e304c72cd00a3b41c890aed"}
Jul 22 21:45:03.453537 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:03.453505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh" event={"ID":"2d3aa995-631a-4bf0-9daf-342dc12f08a5","Type":"ContainerStarted","Data":"38b7812bdefdf209bc405526d65504aab9f5bd5ded8b80901cf776bec3aa5997"}
Jul 22 21:45:03.487427 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:03.487370    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh" podStartSLOduration=1.06587433 podStartE2EDuration="3.487353696s" totalImagesPullingTime="2.421479366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:45:03.4846475 +0000 UTC m=+2380.267549317" watchObservedRunningTime="2026-07-22 21:45:03.487353696 +0000 UTC m=+2380.270255513"
Jul 22 21:45:04.459353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:04.459316    2576 generic.go:356] "Generic (PLEG): container finished" podID="2d3aa995-631a-4bf0-9daf-342dc12f08a5" containerID="38b7812bdefdf209bc405526d65504aab9f5bd5ded8b80901cf776bec3aa5997" exitCode=0
Jul 22 21:45:04.459738 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:04.459375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh" event={"ID":"2d3aa995-631a-4bf0-9daf-342dc12f08a5","Type":"ContainerDied","Data":"38b7812bdefdf209bc405526d65504aab9f5bd5ded8b80901cf776bec3aa5997"}
Jul 22 21:45:05.594563 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:05.594539    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"
Jul 22 21:45:06.469887 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:06.469862    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"
Jul 22 21:45:06.470043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:06.469894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh" event={"ID":"2d3aa995-631a-4bf0-9daf-342dc12f08a5","Type":"ContainerDied","Data":"ca2a8a837a18e2426eadc2418da30b53280a88509e304c72cd00a3b41c890aed"}
Jul 22 21:45:06.470043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:06.469936    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca2a8a837a18e2426eadc2418da30b53280a88509e304c72cd00a3b41c890aed"
Jul 22 21:45:23.859876 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:23.859785    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:45:23.863234 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:23.863210    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:45:23.868748 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:23.868732    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:45:23.872107 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:23.872092    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:45:27.372232 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.372199    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"]
Jul 22 21:45:27.372630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.372616    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3aa995-631a-4bf0-9daf-342dc12f08a5" containerName="cleanup"
Jul 22 21:45:27.372679 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.372632    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3aa995-631a-4bf0-9daf-342dc12f08a5" containerName="cleanup"
Jul 22 21:45:27.372713 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.372704    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3aa995-631a-4bf0-9daf-342dc12f08a5" containerName="cleanup"
Jul 22 21:45:27.375719 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.375703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.378473 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.378451    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4a3a7e\"/\"default-dockercfg-h9nsl\""
Jul 22 21:45:27.378597 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.378479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4a3a7e\"/\"kube-root-ca.crt\""
Jul 22 21:45:27.379512 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.379495    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4a3a7e\"/\"openshift-service-ca.crt\""
Jul 22 21:45:27.379566 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.379532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4a3a7e\"/\"test-model-4a3a7e-kserve-self-signed-certs\""
Jul 22 21:45:27.396372 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.396350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"]
Jul 22 21:45:27.496657 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.496627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-home\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.496800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.496671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxfk\" (UniqueName: \"kubernetes.io/projected/5ee64503-1627-4799-b800-49cc3078d0a8-kube-api-access-4zxfk\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.496800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.496692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-dshm\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.496800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.496753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ee64503-1627-4799-b800-49cc3078d0a8-tls-certs\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.496800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.496783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-model-cache\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.496800 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.496799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-tmp-dir\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.597941 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.597913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-home\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598102 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.597959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxfk\" (UniqueName: \"kubernetes.io/projected/5ee64503-1627-4799-b800-49cc3078d0a8-kube-api-access-4zxfk\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598102 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.597978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-dshm\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598244 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.598113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ee64503-1627-4799-b800-49cc3078d0a8-tls-certs\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598244 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.598146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-model-cache\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598244 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.598169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-tmp-dir\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598410 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.598389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-home\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598505 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.598487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-model-cache\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.598571 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.598532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-tmp-dir\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.600225 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.600203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-dshm\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.600536 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.600519    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ee64503-1627-4799-b800-49cc3078d0a8-tls-certs\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.620187 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.620155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxfk\" (UniqueName: \"kubernetes.io/projected/5ee64503-1627-4799-b800-49cc3078d0a8-kube-api-access-4zxfk\") pod \"test-model-4a3a7e-kserve-c765bd95-mrsjg\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") " pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.684706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.684647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:27.833476 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:27.833444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"]
Jul 22 21:45:27.836245 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:45:27.836216    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ee64503_1627_4799_b800_49cc3078d0a8.slice/crio-8684f56ec1194a9d775f9c2ca129aeeb6fb72c4f9a2fd72a5e107c6cc90e8b6b WatchSource:0}: Error finding container 8684f56ec1194a9d775f9c2ca129aeeb6fb72c4f9a2fd72a5e107c6cc90e8b6b: Status 404 returned error can't find the container with id 8684f56ec1194a9d775f9c2ca129aeeb6fb72c4f9a2fd72a5e107c6cc90e8b6b
Jul 22 21:45:28.574639 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:28.574606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg" event={"ID":"5ee64503-1627-4799-b800-49cc3078d0a8","Type":"ContainerStarted","Data":"6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2"}
Jul 22 21:45:28.575088 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:28.574646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg" event={"ID":"5ee64503-1627-4799-b800-49cc3078d0a8","Type":"ContainerStarted","Data":"8684f56ec1194a9d775f9c2ca129aeeb6fb72c4f9a2fd72a5e107c6cc90e8b6b"}
Jul 22 21:45:28.603465 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:28.603412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg" podStartSLOduration=1.603393136 podStartE2EDuration="1.603393136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:45:28.601396013 +0000 UTC m=+2405.384297855" watchObservedRunningTime="2026-07-22 21:45:28.603393136 +0000 UTC m=+2405.386294966"
Jul 22 21:45:37.685774 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:37.685741    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:37.686265 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:37.685794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:37.698031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:37.698012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:45:38.634018 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:45:38.633988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:46:09.993836 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:09.993799    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"]
Jul 22 21:46:21.088791 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.088753    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"]
Jul 22 21:46:21.089297 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.088956    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6" podUID="d69f19e4-eb0e-4228-9259-b615f3620dff" containerName="maas-api" containerID="cri-o://68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93" gracePeriod=30
Jul 22 21:46:21.159124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.159089    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"]
Jul 22 21:46:21.166868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.166848    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3fc251-29745945-vtzvh"]
Jul 22 21:46:21.332761 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.332734    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:46:21.462561 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.462479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d69f19e4-eb0e-4228-9259-b615f3620dff-openshift-service-ca\") pod \"d69f19e4-eb0e-4228-9259-b615f3620dff\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") "
Jul 22 21:46:21.462723 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.462604    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d69f19e4-eb0e-4228-9259-b615f3620dff-maas-api-tls\") pod \"d69f19e4-eb0e-4228-9259-b615f3620dff\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") "
Jul 22 21:46:21.462723 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.462659    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnrt7\" (UniqueName: \"kubernetes.io/projected/d69f19e4-eb0e-4228-9259-b615f3620dff-kube-api-access-qnrt7\") pod \"d69f19e4-eb0e-4228-9259-b615f3620dff\" (UID: \"d69f19e4-eb0e-4228-9259-b615f3620dff\") "
Jul 22 21:46:21.462829 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.462795    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69f19e4-eb0e-4228-9259-b615f3620dff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d69f19e4-eb0e-4228-9259-b615f3620dff" (UID: "d69f19e4-eb0e-4228-9259-b615f3620dff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:21.462946 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.462933    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d69f19e4-eb0e-4228-9259-b615f3620dff-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:21.464638 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.464616    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d69f19e4-eb0e-4228-9259-b615f3620dff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d69f19e4-eb0e-4228-9259-b615f3620dff" (UID: "d69f19e4-eb0e-4228-9259-b615f3620dff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:46:21.464734 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.464645    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69f19e4-eb0e-4228-9259-b615f3620dff-kube-api-access-qnrt7" (OuterVolumeSpecName: "kube-api-access-qnrt7") pod "d69f19e4-eb0e-4228-9259-b615f3620dff" (UID: "d69f19e4-eb0e-4228-9259-b615f3620dff"). InnerVolumeSpecName "kube-api-access-qnrt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:21.563844 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.563810    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d69f19e4-eb0e-4228-9259-b615f3620dff-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:21.563844 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.563838    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnrt7\" (UniqueName: \"kubernetes.io/projected/d69f19e4-eb0e-4228-9259-b615f3620dff-kube-api-access-qnrt7\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:21.751078 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.750981    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3aa995-631a-4bf0-9daf-342dc12f08a5" path="/var/lib/kubelet/pods/2d3aa995-631a-4bf0-9daf-342dc12f08a5/volumes"
Jul 22 21:46:21.834926 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.834893    2576 generic.go:356] "Generic (PLEG): container finished" podID="d69f19e4-eb0e-4228-9259-b615f3620dff" containerID="68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93" exitCode=0
Jul 22 21:46:21.835124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.834938    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"
Jul 22 21:46:21.835124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.834960    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6" event={"ID":"d69f19e4-eb0e-4228-9259-b615f3620dff","Type":"ContainerDied","Data":"68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93"}
Jul 22 21:46:21.835124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.835001    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6" event={"ID":"d69f19e4-eb0e-4228-9259-b615f3620dff","Type":"ContainerDied","Data":"816cab21c0e381ed0800e0bd8005e06bd46395f5c85b568390a1cfd68d5c90d5"}
Jul 22 21:46:21.835124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.835021    2576 scope.go:117] "RemoveContainer" containerID="68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93"
Jul 22 21:46:21.843751 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.843730    2576 scope.go:117] "RemoveContainer" containerID="68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93"
Jul 22 21:46:21.844036 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:46:21.844009    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93\": container with ID starting with 68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93 not found: ID does not exist" containerID="68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93"
Jul 22 21:46:21.844118 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.844051    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93"} err="failed to get container status \"68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93\": rpc error: code = NotFound desc = could not find container \"68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93\": container with ID starting with 68043508dfd0e9a94423d69d35168a326f59dbe60e45fc7968d980e5bb7a7a93 not found: ID does not exist"
Jul 22 21:46:21.865859 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.865827    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"]
Jul 22 21:46:21.881488 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:21.881466    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-3fc251-7b895bc497-mhqx6"]
Jul 22 21:46:23.751173 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:23.751137    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d69f19e4-eb0e-4228-9259-b615f3620dff" path="/var/lib/kubelet/pods/d69f19e4-eb0e-4228-9259-b615f3620dff/volumes"
Jul 22 21:46:25.014333 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.014295    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg" podUID="5ee64503-1627-4799-b800-49cc3078d0a8" containerName="main" containerID="cri-o://6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2" gracePeriod=45
Jul 22 21:46:25.269802 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.269749    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:46:25.397646 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397614    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-dshm\") pod \"5ee64503-1627-4799-b800-49cc3078d0a8\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") "
Jul 22 21:46:25.397646 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-tmp-dir\") pod \"5ee64503-1627-4799-b800-49cc3078d0a8\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") "
Jul 22 21:46:25.397888 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ee64503-1627-4799-b800-49cc3078d0a8-tls-certs\") pod \"5ee64503-1627-4799-b800-49cc3078d0a8\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") "
Jul 22 21:46:25.397888 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-home\") pod \"5ee64503-1627-4799-b800-49cc3078d0a8\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") "
Jul 22 21:46:25.397888 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397743    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-model-cache\") pod \"5ee64503-1627-4799-b800-49cc3078d0a8\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") "
Jul 22 21:46:25.397888 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397763    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zxfk\" (UniqueName: \"kubernetes.io/projected/5ee64503-1627-4799-b800-49cc3078d0a8-kube-api-access-4zxfk\") pod \"5ee64503-1627-4799-b800-49cc3078d0a8\" (UID: \"5ee64503-1627-4799-b800-49cc3078d0a8\") "
Jul 22 21:46:25.398107 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397919    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ee64503-1627-4799-b800-49cc3078d0a8" (UID: "5ee64503-1627-4799-b800-49cc3078d0a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:25.398107 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.397962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-home" (OuterVolumeSpecName: "home") pod "5ee64503-1627-4799-b800-49cc3078d0a8" (UID: "5ee64503-1627-4799-b800-49cc3078d0a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:25.398107 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.398003    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ee64503-1627-4799-b800-49cc3078d0a8" (UID: "5ee64503-1627-4799-b800-49cc3078d0a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:25.398248 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.398130    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-tmp-dir\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:25.398248 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.398147    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-home\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:25.398248 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.398156    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-model-cache\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:25.399966 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.399933    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-dshm" (OuterVolumeSpecName: "dshm") pod "5ee64503-1627-4799-b800-49cc3078d0a8" (UID: "5ee64503-1627-4799-b800-49cc3078d0a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:46:25.399966 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.399958    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee64503-1627-4799-b800-49cc3078d0a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ee64503-1627-4799-b800-49cc3078d0a8" (UID: "5ee64503-1627-4799-b800-49cc3078d0a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:46:25.400136 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.400007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee64503-1627-4799-b800-49cc3078d0a8-kube-api-access-4zxfk" (OuterVolumeSpecName: "kube-api-access-4zxfk") pod "5ee64503-1627-4799-b800-49cc3078d0a8" (UID: "5ee64503-1627-4799-b800-49cc3078d0a8"). InnerVolumeSpecName "kube-api-access-4zxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:25.499578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.499544    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ee64503-1627-4799-b800-49cc3078d0a8-tls-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:25.499578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.499573    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zxfk\" (UniqueName: \"kubernetes.io/projected/5ee64503-1627-4799-b800-49cc3078d0a8-kube-api-access-4zxfk\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:25.499762 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.499587    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ee64503-1627-4799-b800-49cc3078d0a8-dshm\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:25.856570 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.856541    2576 generic.go:356] "Generic (PLEG): container finished" podID="5ee64503-1627-4799-b800-49cc3078d0a8" containerID="6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2" exitCode=0
Jul 22 21:46:25.856731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.856588    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"
Jul 22 21:46:25.856731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.856601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg" event={"ID":"5ee64503-1627-4799-b800-49cc3078d0a8","Type":"ContainerDied","Data":"6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2"}
Jul 22 21:46:25.856731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.856632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg" event={"ID":"5ee64503-1627-4799-b800-49cc3078d0a8","Type":"ContainerDied","Data":"8684f56ec1194a9d775f9c2ca129aeeb6fb72c4f9a2fd72a5e107c6cc90e8b6b"}
Jul 22 21:46:25.856731 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.856650    2576 scope.go:117] "RemoveContainer" containerID="6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2"
Jul 22 21:46:25.865011 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.864992    2576 scope.go:117] "RemoveContainer" containerID="6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2"
Jul 22 21:46:25.865266 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:46:25.865249    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2\": container with ID starting with 6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2 not found: ID does not exist" containerID="6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2"
Jul 22 21:46:25.865316 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.865273    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2"} err="failed to get container status \"6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2\": rpc error: code = NotFound desc = could not find container \"6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2\": container with ID starting with 6a6e4875afd44eab332341c78b6bb3dcb43809d027f241b2dd19ada61114baf2 not found: ID does not exist"
Jul 22 21:46:25.910395 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.910371    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"]
Jul 22 21:46:25.915456 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:25.915435    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4a3a7e/test-model-4a3a7e-kserve-c765bd95-mrsjg"]
Jul 22 21:46:27.750737 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:27.750704    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee64503-1627-4799-b800-49cc3078d0a8" path="/var/lib/kubelet/pods/5ee64503-1627-4799-b800-49cc3078d0a8/volumes"
Jul 22 21:46:43.535448 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.535403    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"]
Jul 22 21:46:43.535969 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.535734    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" podUID="237571d4-de00-49ec-8816-ba79ca7a72bf" containerName="maas-api" containerID="cri-o://6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172" gracePeriod=30
Jul 22 21:46:43.784100 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.784057    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:46:43.944565 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.944530    2576 generic.go:356] "Generic (PLEG): container finished" podID="237571d4-de00-49ec-8816-ba79ca7a72bf" containerID="6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172" exitCode=0
Jul 22 21:46:43.944739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.944578    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"
Jul 22 21:46:43.944739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.944615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" event={"ID":"237571d4-de00-49ec-8816-ba79ca7a72bf","Type":"ContainerDied","Data":"6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172"}
Jul 22 21:46:43.944739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.944676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv" event={"ID":"237571d4-de00-49ec-8816-ba79ca7a72bf","Type":"ContainerDied","Data":"801212e56faa43afc43034d06c37956255ba8589ea1a2b21cfdbed92301ee651"}
Jul 22 21:46:43.944739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.944698    2576 scope.go:117] "RemoveContainer" containerID="6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172"
Jul 22 21:46:43.953260 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.953229    2576 scope.go:117] "RemoveContainer" containerID="6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172"
Jul 22 21:46:43.953511 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:46:43.953489    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172\": container with ID starting with 6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172 not found: ID does not exist" containerID="6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172"
Jul 22 21:46:43.953574 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.953525    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172"} err="failed to get container status \"6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172\": rpc error: code = NotFound desc = could not find container \"6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172\": container with ID starting with 6f1a02a2f20b2ab9c4f2366972d8307ea1f3e044ac5ec63ed87618f7b2696172 not found: ID does not exist"
Jul 22 21:46:43.969960 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.969927    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237571d4-de00-49ec-8816-ba79ca7a72bf-openshift-service-ca\") pod \"237571d4-de00-49ec-8816-ba79ca7a72bf\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") "
Jul 22 21:46:43.970141 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.969968    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcs28\" (UniqueName: \"kubernetes.io/projected/237571d4-de00-49ec-8816-ba79ca7a72bf-kube-api-access-dcs28\") pod \"237571d4-de00-49ec-8816-ba79ca7a72bf\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") "
Jul 22 21:46:43.970141 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.970021    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls\") pod \"237571d4-de00-49ec-8816-ba79ca7a72bf\" (UID: \"237571d4-de00-49ec-8816-ba79ca7a72bf\") "
Jul 22 21:46:43.970348 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.970323    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/237571d4-de00-49ec-8816-ba79ca7a72bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "237571d4-de00-49ec-8816-ba79ca7a72bf" (UID: "237571d4-de00-49ec-8816-ba79ca7a72bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:46:43.970429 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.970409    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/237571d4-de00-49ec-8816-ba79ca7a72bf-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:43.972331 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.972302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237571d4-de00-49ec-8816-ba79ca7a72bf-kube-api-access-dcs28" (OuterVolumeSpecName: "kube-api-access-dcs28") pod "237571d4-de00-49ec-8816-ba79ca7a72bf" (UID: "237571d4-de00-49ec-8816-ba79ca7a72bf"). InnerVolumeSpecName "kube-api-access-dcs28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:46:43.972435 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:43.972330    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "237571d4-de00-49ec-8816-ba79ca7a72bf" (UID: "237571d4-de00-49ec-8816-ba79ca7a72bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:46:44.071233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:44.071195    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcs28\" (UniqueName: \"kubernetes.io/projected/237571d4-de00-49ec-8816-ba79ca7a72bf-kube-api-access-dcs28\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:44.071233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:44.071226    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/237571d4-de00-49ec-8816-ba79ca7a72bf-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:46:44.267726 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:44.267651    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"]
Jul 22 21:46:44.269751 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:44.269722    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4a3a7e-bc94d78cf-crxcv"]
Jul 22 21:46:45.750277 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:45.750242    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="237571d4-de00-49ec-8816-ba79ca7a72bf" path="/var/lib/kubelet/pods/237571d4-de00-49ec-8816-ba79ca7a72bf/volumes"
Jul 22 21:46:59.194213 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194179    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"]
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194549    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69f19e4-eb0e-4228-9259-b615f3620dff" containerName="maas-api"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194560    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69f19e4-eb0e-4228-9259-b615f3620dff" containerName="maas-api"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194578    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee64503-1627-4799-b800-49cc3078d0a8" containerName="main"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194584    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee64503-1627-4799-b800-49cc3078d0a8" containerName="main"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194597    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="237571d4-de00-49ec-8816-ba79ca7a72bf" containerName="maas-api"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194602    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="237571d4-de00-49ec-8816-ba79ca7a72bf" containerName="maas-api"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194660    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69f19e4-eb0e-4228-9259-b615f3620dff" containerName="maas-api"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194668    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee64503-1627-4799-b800-49cc3078d0a8" containerName="main"
Jul 22 21:46:59.194680 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.194678    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="237571d4-de00-49ec-8816-ba79ca7a72bf" containerName="maas-api"
Jul 22 21:46:59.199104 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.199060    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.201919 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.201895    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-dc356c-serving-cert\""
Jul 22 21:46:59.208366 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.208339    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"]
Jul 22 21:46:59.287589 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.287552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zv5c\" (UniqueName: \"kubernetes.io/projected/7da7d7d8-9eb0-4778-b401-932784a3fd43-kube-api-access-9zv5c\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.287770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.287600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.287770 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.287716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da7d7d8-9eb0-4778-b401-932784a3fd43-openshift-service-ca\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.388279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.388242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da7d7d8-9eb0-4778-b401-932784a3fd43-openshift-service-ca\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.388459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.388336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zv5c\" (UniqueName: \"kubernetes.io/projected/7da7d7d8-9eb0-4778-b401-932784a3fd43-kube-api-access-9zv5c\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.388459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.388372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.388547 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:46:59.388530    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-serving-cert: secret "maas-api-e2e-api-a-dc356c-serving-cert" not found
Jul 22 21:46:59.388612 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:46:59.388602    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls podName:7da7d7d8-9eb0-4778-b401-932784a3fd43 nodeName:}" failed. No retries permitted until 2026-07-22 21:46:59.888581246 +0000 UTC m=+2496.671483055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls") pod "maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" (UID: "7da7d7d8-9eb0-4778-b401-932784a3fd43") : secret "maas-api-e2e-api-a-dc356c-serving-cert" not found
Jul 22 21:46:59.388989 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.388971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da7d7d8-9eb0-4778-b401-932784a3fd43-openshift-service-ca\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.398990 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.398955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zv5c\" (UniqueName: \"kubernetes.io/projected/7da7d7d8-9eb0-4778-b401-932784a3fd43-kube-api-access-9zv5c\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.892501 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.892460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:46:59.895036 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:46:59.895014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls\") pod \"maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:47:00.110219 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:00.110186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:47:00.252703 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:00.252676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"]
Jul 22 21:47:00.254876 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:47:00.254849    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da7d7d8_9eb0_4778_b401_932784a3fd43.slice/crio-da805aa5ead3075bad18dbfa01ee0af13b5df7f45c47be8f38bff09610a678dd WatchSource:0}: Error finding container da805aa5ead3075bad18dbfa01ee0af13b5df7f45c47be8f38bff09610a678dd: Status 404 returned error can't find the container with id da805aa5ead3075bad18dbfa01ee0af13b5df7f45c47be8f38bff09610a678dd
Jul 22 21:47:00.256578 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:00.256561    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:47:01.030514 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:01.030418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" event={"ID":"7da7d7d8-9eb0-4778-b401-932784a3fd43","Type":"ContainerStarted","Data":"e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d"}
Jul 22 21:47:01.030514 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:01.030469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" event={"ID":"7da7d7d8-9eb0-4778-b401-932784a3fd43","Type":"ContainerStarted","Data":"da805aa5ead3075bad18dbfa01ee0af13b5df7f45c47be8f38bff09610a678dd"}
Jul 22 21:47:01.030710 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:01.030526    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:47:01.068031 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:01.067982    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" podStartSLOduration=1.589229456 podStartE2EDuration="2.067966412s" totalImagesPullingTime="478.736956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:46:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:47:01.066404108 +0000 UTC m=+2497.849305924" watchObservedRunningTime="2026-07-22 21:47:01.067966412 +0000 UTC m=+2497.850868228"
Jul 22 21:47:07.040900 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.040871    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:47:07.315748 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.315661    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"]
Jul 22 21:47:07.320121 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.320095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.323143 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.323117    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-05d119-serving-cert\""
Jul 22 21:47:07.331693 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.331664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"]
Jul 22 21:47:07.357572 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.357531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8nb\" (UniqueName: \"kubernetes.io/projected/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-kube-api-access-cl8nb\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.357781 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.357584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.357781 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.357684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-openshift-service-ca\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.458190 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.458145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-openshift-service-ca\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.458398 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.458237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8nb\" (UniqueName: \"kubernetes.io/projected/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-kube-api-access-cl8nb\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.458398 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.458284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.458398 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:47:07.458379    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-serving-cert: secret "maas-api-e2e-api-b-05d119-serving-cert" not found
Jul 22 21:47:07.458570 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:47:07.458437    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls podName:f430fd2f-1973-4d54-93aa-d9c5b4ffb89c nodeName:}" failed. No retries permitted until 2026-07-22 21:47:07.958421786 +0000 UTC m=+2504.741323581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls") pod "maas-api-e2e-api-b-05d119-78b9576475-f9s5v" (UID: "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c") : secret "maas-api-e2e-api-b-05d119-serving-cert" not found
Jul 22 21:47:07.458798 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.458776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-openshift-service-ca\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.469884 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.469856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8nb\" (UniqueName: \"kubernetes.io/projected/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-kube-api-access-cl8nb\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.962564 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.962533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:07.965106 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:07.965054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls\") pod \"maas-api-e2e-api-b-05d119-78b9576475-f9s5v\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:08.232340 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:08.232252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:08.384729 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:08.384699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"]
Jul 22 21:47:08.387085 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:47:08.387035    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf430fd2f_1973_4d54_93aa_d9c5b4ffb89c.slice/crio-bcb8f15fb599769654c847a0083245ccc9dd8f0297de78db4aa614c18db1c151 WatchSource:0}: Error finding container bcb8f15fb599769654c847a0083245ccc9dd8f0297de78db4aa614c18db1c151: Status 404 returned error can't find the container with id bcb8f15fb599769654c847a0083245ccc9dd8f0297de78db4aa614c18db1c151
Jul 22 21:47:09.077561 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:09.077524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v" event={"ID":"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c","Type":"ContainerStarted","Data":"e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42"}
Jul 22 21:47:09.077750 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:09.077589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v" event={"ID":"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c","Type":"ContainerStarted","Data":"bcb8f15fb599769654c847a0083245ccc9dd8f0297de78db4aa614c18db1c151"}
Jul 22 21:47:09.077750 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:09.077614    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:09.121425 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:09.121369    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v" podStartSLOduration=1.7348008190000002 podStartE2EDuration="2.121352442s" totalImagesPullingTime="386.551623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:47:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:47:09.119985649 +0000 UTC m=+2505.902887467" watchObservedRunningTime="2026-07-22 21:47:09.121352442 +0000 UTC m=+2505.904254258"
Jul 22 21:47:15.087488 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:15.087412    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:47:35.532701 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.532666    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"]
Jul 22 21:47:35.533501 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.533462    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" podUID="7da7d7d8-9eb0-4778-b401-932784a3fd43" containerName="maas-api" containerID="cri-o://e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d" gracePeriod=30
Jul 22 21:47:35.786510 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.786442    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:47:35.926796 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.926757    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zv5c\" (UniqueName: \"kubernetes.io/projected/7da7d7d8-9eb0-4778-b401-932784a3fd43-kube-api-access-9zv5c\") pod \"7da7d7d8-9eb0-4778-b401-932784a3fd43\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") "
Jul 22 21:47:35.926796 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.926796    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da7d7d8-9eb0-4778-b401-932784a3fd43-openshift-service-ca\") pod \"7da7d7d8-9eb0-4778-b401-932784a3fd43\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") "
Jul 22 21:47:35.927025 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.926932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls\") pod \"7da7d7d8-9eb0-4778-b401-932784a3fd43\" (UID: \"7da7d7d8-9eb0-4778-b401-932784a3fd43\") "
Jul 22 21:47:35.927229 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.927205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da7d7d8-9eb0-4778-b401-932784a3fd43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7da7d7d8-9eb0-4778-b401-932784a3fd43" (UID: "7da7d7d8-9eb0-4778-b401-932784a3fd43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:47:35.929046 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.929024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7da7d7d8-9eb0-4778-b401-932784a3fd43" (UID: "7da7d7d8-9eb0-4778-b401-932784a3fd43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:47:35.929285 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:35.929257    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da7d7d8-9eb0-4778-b401-932784a3fd43-kube-api-access-9zv5c" (OuterVolumeSpecName: "kube-api-access-9zv5c") pod "7da7d7d8-9eb0-4778-b401-932784a3fd43" (UID: "7da7d7d8-9eb0-4778-b401-932784a3fd43"). InnerVolumeSpecName "kube-api-access-9zv5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:47:36.027980 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.027949    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zv5c\" (UniqueName: \"kubernetes.io/projected/7da7d7d8-9eb0-4778-b401-932784a3fd43-kube-api-access-9zv5c\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:47:36.027980 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.027976    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da7d7d8-9eb0-4778-b401-932784a3fd43-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:47:36.027980 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.027986    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da7d7d8-9eb0-4778-b401-932784a3fd43-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:47:36.207459 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.207425    2576 generic.go:356] "Generic (PLEG): container finished" podID="7da7d7d8-9eb0-4778-b401-932784a3fd43" containerID="e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d" exitCode=0
Jul 22 21:47:36.207647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.207474    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"
Jul 22 21:47:36.207647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.207512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" event={"ID":"7da7d7d8-9eb0-4778-b401-932784a3fd43","Type":"ContainerDied","Data":"e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d"}
Jul 22 21:47:36.207647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.207569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d" event={"ID":"7da7d7d8-9eb0-4778-b401-932784a3fd43","Type":"ContainerDied","Data":"da805aa5ead3075bad18dbfa01ee0af13b5df7f45c47be8f38bff09610a678dd"}
Jul 22 21:47:36.207647 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.207591    2576 scope.go:117] "RemoveContainer" containerID="e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d"
Jul 22 21:47:36.223492 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.223470    2576 scope.go:117] "RemoveContainer" containerID="e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d"
Jul 22 21:47:36.223793 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:47:36.223771    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d\": container with ID starting with e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d not found: ID does not exist" containerID="e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d"
Jul 22 21:47:36.223846 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.223802    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d"} err="failed to get container status \"e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d\": rpc error: code = NotFound desc = could not find container \"e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d\": container with ID starting with e93d86d00fc8f060d97088d1bb2132086f697ffe3c03fcf7467f28fd247f3b2d not found: ID does not exist"
Jul 22 21:47:36.252456 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.252417    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"]
Jul 22 21:47:36.258971 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:36.258940    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dc356c-6d8cb889c6-r4d9d"]
Jul 22 21:47:37.750969 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:37.750934    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da7d7d8-9eb0-4778-b401-932784a3fd43" path="/var/lib/kubelet/pods/7da7d7d8-9eb0-4778-b401-932784a3fd43/volumes"
Jul 22 21:47:46.831195 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.831161    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"]
Jul 22 21:47:46.831652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.831547    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da7d7d8-9eb0-4778-b401-932784a3fd43" containerName="maas-api"
Jul 22 21:47:46.831652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.831558    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da7d7d8-9eb0-4778-b401-932784a3fd43" containerName="maas-api"
Jul 22 21:47:46.831652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.831622    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da7d7d8-9eb0-4778-b401-932784a3fd43" containerName="maas-api"
Jul 22 21:47:46.834610 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.834592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:46.837939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.837921    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4sfq\""
Jul 22 21:47:46.846588 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.846526    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"]
Jul 22 21:47:46.930049 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:46.930019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-05d119-25xht\" (UID: \"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:47.031199 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:47.031162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-05d119-25xht\" (UID: \"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:47.031782 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:47.031763    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-05d119-25xht\" (UID: \"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:47.144536 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:47.144452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:47.291929 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:47.291749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"]
Jul 22 21:47:47.294257 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:47:47.294232    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f0ecd6_0e63_4bfb_8e4c_5a889163d72e.slice/crio-c32e16327985fd303a27af9b7e9e7b845d3be53927da8a288d94dc7a5ecd06db WatchSource:0}: Error finding container c32e16327985fd303a27af9b7e9e7b845d3be53927da8a288d94dc7a5ecd06db: Status 404 returned error can't find the container with id c32e16327985fd303a27af9b7e9e7b845d3be53927da8a288d94dc7a5ecd06db
Jul 22 21:47:48.271624 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:48.271541    2576 generic.go:356] "Generic (PLEG): container finished" podID="19f0ecd6-0e63-4bfb-8e4c-5a889163d72e" containerID="5eef3c31086d32c14a33e93218b129019967eee99ceab043d701ce09f59395dd" exitCode=0
Jul 22 21:47:48.271970 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:48.271615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht" event={"ID":"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e","Type":"ContainerDied","Data":"5eef3c31086d32c14a33e93218b129019967eee99ceab043d701ce09f59395dd"}
Jul 22 21:47:48.271970 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:48.271664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht" event={"ID":"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e","Type":"ContainerStarted","Data":"c32e16327985fd303a27af9b7e9e7b845d3be53927da8a288d94dc7a5ecd06db"}
Jul 22 21:47:49.409729 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:49.409704    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:49.455715 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:49.455681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e-maas-api-service-ca\") pod \"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e\" (UID: \"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e\") "
Jul 22 21:47:49.456049 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:49.456024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19f0ecd6-0e63-4bfb-8e4c-5a889163d72e" (UID: "19f0ecd6-0e63-4bfb-8e4c-5a889163d72e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:47:49.556918 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:49.556831    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e-maas-api-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:47:50.282381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:50.282353    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"
Jul 22 21:47:50.282381 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:50.282370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht" event={"ID":"19f0ecd6-0e63-4bfb-8e4c-5a889163d72e","Type":"ContainerDied","Data":"c32e16327985fd303a27af9b7e9e7b845d3be53927da8a288d94dc7a5ecd06db"}
Jul 22 21:47:50.282595 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:47:50.282415    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c32e16327985fd303a27af9b7e9e7b845d3be53927da8a288d94dc7a5ecd06db"
Jul 22 21:48:02.647173 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.647135    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"]
Jul 22 21:48:02.647645 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.647421    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v" podUID="f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" containerName="maas-api" containerID="cri-o://e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42" gracePeriod=30
Jul 22 21:48:02.895424 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.895398    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:48:02.985630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.985540    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls\") pod \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") "
Jul 22 21:48:02.985630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.985574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-openshift-service-ca\") pod \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") "
Jul 22 21:48:02.985832 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.985642    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl8nb\" (UniqueName: \"kubernetes.io/projected/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-kube-api-access-cl8nb\") pod \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\" (UID: \"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c\") "
Jul 22 21:48:02.986009 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.985986    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" (UID: "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:48:02.987875 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.987847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" (UID: "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:48:02.987875 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:02.987854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-kube-api-access-cl8nb" (OuterVolumeSpecName: "kube-api-access-cl8nb") pod "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" (UID: "f430fd2f-1973-4d54-93aa-d9c5b4ffb89c"). InnerVolumeSpecName "kube-api-access-cl8nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:48:03.086583 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.086540    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:48:03.086583 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.086577    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:48:03.086583 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.086587    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl8nb\" (UniqueName: \"kubernetes.io/projected/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c-kube-api-access-cl8nb\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:48:03.346910 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.346873    2576 generic.go:356] "Generic (PLEG): container finished" podID="f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" containerID="e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42" exitCode=0
Jul 22 21:48:03.347125 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.346925    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"
Jul 22 21:48:03.347125 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.346925    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v" event={"ID":"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c","Type":"ContainerDied","Data":"e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42"}
Jul 22 21:48:03.347125 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.347035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v" event={"ID":"f430fd2f-1973-4d54-93aa-d9c5b4ffb89c","Type":"ContainerDied","Data":"bcb8f15fb599769654c847a0083245ccc9dd8f0297de78db4aa614c18db1c151"}
Jul 22 21:48:03.347125 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.347063    2576 scope.go:117] "RemoveContainer" containerID="e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42"
Jul 22 21:48:03.359142 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.359120    2576 scope.go:117] "RemoveContainer" containerID="e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42"
Jul 22 21:48:03.359425 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:48:03.359409    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42\": container with ID starting with e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42 not found: ID does not exist" containerID="e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42"
Jul 22 21:48:03.359486 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.359434    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42"} err="failed to get container status \"e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42\": rpc error: code = NotFound desc = could not find container \"e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42\": container with ID starting with e517cc00099b05f1a8d813231cb9c8539ad182921be422cd59cddf6c6d451f42 not found: ID does not exist"
Jul 22 21:48:03.368779 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.368752    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"]
Jul 22 21:48:03.372965 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.372939    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-05d119-78b9576475-f9s5v"]
Jul 22 21:48:03.751435 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:03.751359    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" path="/var/lib/kubelet/pods/f430fd2f-1973-4d54-93aa-d9c5b4ffb89c/volumes"
Jul 22 21:48:06.944508 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:06.944471    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"]
Jul 22 21:48:06.946618 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:06.946592    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-05d119-25xht"]
Jul 22 21:48:07.751221 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:07.751179    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f0ecd6-0e63-4bfb-8e4c-5a889163d72e" path="/var/lib/kubelet/pods/19f0ecd6-0e63-4bfb-8e4c-5a889163d72e/volumes"
Jul 22 21:48:17.625550 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.625515    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"]
Jul 22 21:48:17.626168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.626103    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f0ecd6-0e63-4bfb-8e4c-5a889163d72e" containerName="revoke-keys"
Jul 22 21:48:17.626168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.626120    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f0ecd6-0e63-4bfb-8e4c-5a889163d72e" containerName="revoke-keys"
Jul 22 21:48:17.626168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.626135    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" containerName="maas-api"
Jul 22 21:48:17.626168 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.626144    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" containerName="maas-api"
Jul 22 21:48:17.626360 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.626241    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f430fd2f-1973-4d54-93aa-d9c5b4ffb89c" containerName="maas-api"
Jul 22 21:48:17.626360 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.626253    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f0ecd6-0e63-4bfb-8e4c-5a889163d72e" containerName="revoke-keys"
Jul 22 21:48:17.631023 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.630996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.633937 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.633912    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-bddd55-serving-cert\""
Jul 22 21:48:17.651721 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.651693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"]
Jul 22 21:48:17.819899 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.819855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbzmw\" (UniqueName: \"kubernetes.io/projected/4c996ca2-fe52-4e40-a988-4b79ca79b020-kube-api-access-bbzmw\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.820117 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.819945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.820117 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.820013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c996ca2-fe52-4e40-a988-4b79ca79b020-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.921509 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.921411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c996ca2-fe52-4e40-a988-4b79ca79b020-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.921509 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.921470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbzmw\" (UniqueName: \"kubernetes.io/projected/4c996ca2-fe52-4e40-a988-4b79ca79b020-kube-api-access-bbzmw\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.921742 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.921512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.921742 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:48:17.921626    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-serving-cert: secret "maas-api-e2e-shared-a-bddd55-serving-cert" not found
Jul 22 21:48:17.921742 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:48:17.921691    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls podName:4c996ca2-fe52-4e40-a988-4b79ca79b020 nodeName:}" failed. No retries permitted until 2026-07-22 21:48:18.421673825 +0000 UTC m=+2575.204575620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls") pod "maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" (UID: "4c996ca2-fe52-4e40-a988-4b79ca79b020") : secret "maas-api-e2e-shared-a-bddd55-serving-cert" not found
Jul 22 21:48:17.922043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.922025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c996ca2-fe52-4e40-a988-4b79ca79b020-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:17.935825 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:17.935796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbzmw\" (UniqueName: \"kubernetes.io/projected/4c996ca2-fe52-4e40-a988-4b79ca79b020-kube-api-access-bbzmw\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:18.425847 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:18.425810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:18.428400 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:18.428371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls\") pod \"maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:18.542947 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:18.542911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:18.694155 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:18.694126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"]
Jul 22 21:48:18.696279 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:48:18.696253    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c996ca2_fe52_4e40_a988_4b79ca79b020.slice/crio-0213dc609dfe621514a4af7fc0a074a8e860795b9e36df1f769d0b3693a90252 WatchSource:0}: Error finding container 0213dc609dfe621514a4af7fc0a074a8e860795b9e36df1f769d0b3693a90252: Status 404 returned error can't find the container with id 0213dc609dfe621514a4af7fc0a074a8e860795b9e36df1f769d0b3693a90252
Jul 22 21:48:19.428608 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:19.428516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" event={"ID":"4c996ca2-fe52-4e40-a988-4b79ca79b020","Type":"ContainerStarted","Data":"5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109"}
Jul 22 21:48:19.428608 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:19.428569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" event={"ID":"4c996ca2-fe52-4e40-a988-4b79ca79b020","Type":"ContainerStarted","Data":"0213dc609dfe621514a4af7fc0a074a8e860795b9e36df1f769d0b3693a90252"}
Jul 22 21:48:19.428793 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:19.428615    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:19.457868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:19.457815    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" podStartSLOduration=2.029485558 podStartE2EDuration="2.45779971s" totalImagesPullingTime="428.314152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:48:19.455316248 +0000 UTC m=+2576.238218063" watchObservedRunningTime="2026-07-22 21:48:19.45779971 +0000 UTC m=+2576.240701550"
Jul 22 21:48:25.439837 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.439810    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:48:25.771343 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.771263    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"]
Jul 22 21:48:25.776220 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.776198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.782008 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.781988    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e44515-serving-cert\""
Jul 22 21:48:25.792671 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.792644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4c3585-6721-4616-b028-6ff58c6d4c2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.792790 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.792760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fktzd\" (UniqueName: \"kubernetes.io/projected/6f4c3585-6721-4616-b028-6ff58c6d4c2d-kube-api-access-fktzd\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.792834 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.792804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c3585-6721-4616-b028-6ff58c6d4c2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.846281 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.846239    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"]
Jul 22 21:48:25.894180 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.894142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4c3585-6721-4616-b028-6ff58c6d4c2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.894370 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.894238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fktzd\" (UniqueName: \"kubernetes.io/projected/6f4c3585-6721-4616-b028-6ff58c6d4c2d-kube-api-access-fktzd\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.894370 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.894284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c3585-6721-4616-b028-6ff58c6d4c2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.894976 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.894955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c3585-6721-4616-b028-6ff58c6d4c2d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.896866 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.896846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4c3585-6721-4616-b028-6ff58c6d4c2d-maas-api-tls\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:25.937749 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:25.937717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fktzd\" (UniqueName: \"kubernetes.io/projected/6f4c3585-6721-4616-b028-6ff58c6d4c2d-kube-api-access-fktzd\") pod \"maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:26.087553 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:26.087518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:26.246780 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:26.246747    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"]
Jul 22 21:48:26.248209 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:48:26.248184    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4c3585_6721_4616_b028_6ff58c6d4c2d.slice/crio-8dfff3c49139b2f12a499d45baf08bef10162f4323e5fceb3dd5b3ef475cdf52 WatchSource:0}: Error finding container 8dfff3c49139b2f12a499d45baf08bef10162f4323e5fceb3dd5b3ef475cdf52: Status 404 returned error can't find the container with id 8dfff3c49139b2f12a499d45baf08bef10162f4323e5fceb3dd5b3ef475cdf52
Jul 22 21:48:26.462919 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:26.462842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv" event={"ID":"6f4c3585-6721-4616-b028-6ff58c6d4c2d","Type":"ContainerStarted","Data":"8dfff3c49139b2f12a499d45baf08bef10162f4323e5fceb3dd5b3ef475cdf52"}
Jul 22 21:48:27.468465 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:27.468432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv" event={"ID":"6f4c3585-6721-4616-b028-6ff58c6d4c2d","Type":"ContainerStarted","Data":"25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595"}
Jul 22 21:48:27.468862 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:27.468524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:48:27.502482 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:27.502434    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv" podStartSLOduration=2.149254887 podStartE2EDuration="2.502419222s" totalImagesPullingTime="353.164335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:48:27.500543916 +0000 UTC m=+2584.283445733" watchObservedRunningTime="2026-07-22 21:48:27.502419222 +0000 UTC m=+2584.285321038"
Jul 22 21:48:33.479455 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:48:33.479421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:50:23.890417 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:50:23.890299    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:50:23.894148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:50:23.894132    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:50:23.902145 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:50:23.902127    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:50:23.905414 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:50:23.905395    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:51:24.017482 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:24.017453    2576 scope.go:117] "RemoveContainer" containerID="38b7812bdefdf209bc405526d65504aab9f5bd5ded8b80901cf776bec3aa5997"
Jul 22 21:51:51.574936 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.574898    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"]
Jul 22 21:51:51.578356 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.578340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.582241 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.582219    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"kube-root-ca.crt\""
Jul 22 21:51:51.583444 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.583427    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"sub-test-model-bddd55-kserve-self-signed-certs\""
Jul 22 21:51:51.583444 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.583437    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"openshift-service-ca.crt\""
Jul 22 21:51:51.594414 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.594394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bddd55\"/\"default-dockercfg-sjlcf\""
Jul 22 21:51:51.615715 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-home\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.615715 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"]
Jul 22 21:51:51.615883 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tls-certs\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.615883 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tmp-dir\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.615952 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gdv\" (UniqueName: \"kubernetes.io/projected/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-kube-api-access-26gdv\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.615952 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-dshm\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.616015 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.615952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-model-cache\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.716551 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.716518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-dshm\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.716753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.716557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-model-cache\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.716753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.716602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-home\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.716753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.716642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tls-certs\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.716753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.716672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tmp-dir\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.716753 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.716730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gdv\" (UniqueName: \"kubernetes.io/projected/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-kube-api-access-26gdv\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.717043 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.717019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-home\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.717113 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.717058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-model-cache\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.717243 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.717222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tmp-dir\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.719740 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.719716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-dshm\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.719868 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.719853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tls-certs\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.741734 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.741705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gdv\" (UniqueName: \"kubernetes.io/projected/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-kube-api-access-26gdv\") pod \"sub-test-model-bddd55-kserve-859d496747-7npr6\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") " pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:51.887295 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:51.887216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:51:52.021153 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:52.021129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"]
Jul 22 21:51:52.023357 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:51:52.023327    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f515402_6c28_4a92_9c0a_e1d9c8acfd28.slice/crio-18113f8624385cac87f603385c0f33ca5dfd785d6cdc5d5e169d189d1261c618 WatchSource:0}: Error finding container 18113f8624385cac87f603385c0f33ca5dfd785d6cdc5d5e169d189d1261c618: Status 404 returned error can't find the container with id 18113f8624385cac87f603385c0f33ca5dfd785d6cdc5d5e169d189d1261c618
Jul 22 21:51:52.463765 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:52.463727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6" event={"ID":"5f515402-6c28-4a92-9c0a-e1d9c8acfd28","Type":"ContainerStarted","Data":"1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8"}
Jul 22 21:51:52.463952 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:52.463775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6" event={"ID":"5f515402-6c28-4a92-9c0a-e1d9c8acfd28","Type":"ContainerStarted","Data":"18113f8624385cac87f603385c0f33ca5dfd785d6cdc5d5e169d189d1261c618"}
Jul 22 21:51:52.484404 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:51:52.484358    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6" podStartSLOduration=1.484344315 podStartE2EDuration="1.484344315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:51:52.483401982 +0000 UTC m=+2789.266303810" watchObservedRunningTime="2026-07-22 21:51:52.484344315 +0000 UTC m=+2789.267246131"
Jul 22 21:52:01.887760 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:52:01.887727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:52:01.888372 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:52:01.887777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:52:01.899644 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:52:01.899623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:52:02.526184 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:52:02.526157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:53:01.393233 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:01.393197    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"]
Jul 22 21:53:16.413242 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.413135    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6" podUID="5f515402-6c28-4a92-9c0a-e1d9c8acfd28" containerName="main" containerID="cri-o://1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8" gracePeriod=45
Jul 22 21:53:16.658344 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.658322    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:53:16.682981 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.682909    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-home\") pod \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") "
Jul 22 21:53:16.683124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683007    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tmp-dir\") pod \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") "
Jul 22 21:53:16.683124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tls-certs\") pod \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") "
Jul 22 21:53:16.683249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26gdv\" (UniqueName: \"kubernetes.io/projected/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-kube-api-access-26gdv\") pod \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") "
Jul 22 21:53:16.683249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683161    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-dshm\") pod \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") "
Jul 22 21:53:16.683249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-model-cache\") pod \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\" (UID: \"5f515402-6c28-4a92-9c0a-e1d9c8acfd28\") "
Jul 22 21:53:16.684358 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683244    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-home" (OuterVolumeSpecName: "home") pod "5f515402-6c28-4a92-9c0a-e1d9c8acfd28" (UID: "5f515402-6c28-4a92-9c0a-e1d9c8acfd28"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:53:16.684358 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.683487    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-home\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:53:16.684675 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.684639    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f515402-6c28-4a92-9c0a-e1d9c8acfd28" (UID: "5f515402-6c28-4a92-9c0a-e1d9c8acfd28"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:53:16.685006 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.684983    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f515402-6c28-4a92-9c0a-e1d9c8acfd28" (UID: "5f515402-6c28-4a92-9c0a-e1d9c8acfd28"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:53:16.686934 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.686913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f515402-6c28-4a92-9c0a-e1d9c8acfd28" (UID: "5f515402-6c28-4a92-9c0a-e1d9c8acfd28"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:53:16.687251 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.687232    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-dshm" (OuterVolumeSpecName: "dshm") pod "5f515402-6c28-4a92-9c0a-e1d9c8acfd28" (UID: "5f515402-6c28-4a92-9c0a-e1d9c8acfd28"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 21:53:16.687310 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.687244    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-kube-api-access-26gdv" (OuterVolumeSpecName: "kube-api-access-26gdv") pod "5f515402-6c28-4a92-9c0a-e1d9c8acfd28" (UID: "5f515402-6c28-4a92-9c0a-e1d9c8acfd28"). InnerVolumeSpecName "kube-api-access-26gdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:53:16.784122 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.784097    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-dshm\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:53:16.784122 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.784121    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-model-cache\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:53:16.784279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.784132    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tmp-dir\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:53:16.784279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.784140    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-tls-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:53:16.784279 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.784148    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26gdv\" (UniqueName: \"kubernetes.io/projected/5f515402-6c28-4a92-9c0a-e1d9c8acfd28-kube-api-access-26gdv\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:53:16.874334 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.874300    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f515402-6c28-4a92-9c0a-e1d9c8acfd28" containerID="1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8" exitCode=0
Jul 22 21:53:16.874468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.874346    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"
Jul 22 21:53:16.874468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.874387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6" event={"ID":"5f515402-6c28-4a92-9c0a-e1d9c8acfd28","Type":"ContainerDied","Data":"1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8"}
Jul 22 21:53:16.874468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.874436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6" event={"ID":"5f515402-6c28-4a92-9c0a-e1d9c8acfd28","Type":"ContainerDied","Data":"18113f8624385cac87f603385c0f33ca5dfd785d6cdc5d5e169d189d1261c618"}
Jul 22 21:53:16.874468 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.874454    2576 scope.go:117] "RemoveContainer" containerID="1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8"
Jul 22 21:53:16.883517 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.883499    2576 scope.go:117] "RemoveContainer" containerID="1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8"
Jul 22 21:53:16.883753 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:53:16.883737    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8\": container with ID starting with 1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8 not found: ID does not exist" containerID="1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8"
Jul 22 21:53:16.883812 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.883762    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8"} err="failed to get container status \"1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8\": rpc error: code = NotFound desc = could not find container \"1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8\": container with ID starting with 1191b60de8769d340547640a9701f314db006ae56ea8cbd217505bcbf04d75d8 not found: ID does not exist"
Jul 22 21:53:16.903930 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.903900    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"]
Jul 22 21:53:16.910873 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:16.910852    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bddd55/sub-test-model-bddd55-kserve-859d496747-7npr6"]
Jul 22 21:53:17.750893 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:53:17.750866    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f515402-6c28-4a92-9c0a-e1d9c8acfd28" path="/var/lib/kubelet/pods/5f515402-6c28-4a92-9c0a-e1d9c8acfd28/volumes"
Jul 22 21:54:24.054412 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:24.054381    2576 scope.go:117] "RemoveContainer" containerID="5eef3c31086d32c14a33e93218b129019967eee99ceab043d701ce09f59395dd"
Jul 22 21:54:28.535580 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.535552    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7587-139623100306480"]
Jul 22 21:54:28.535954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.535912    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f515402-6c28-4a92-9c0a-e1d9c8acfd28" containerName="main"
Jul 22 21:54:28.535954 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.535925    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f515402-6c28-4a92-9c0a-e1d9c8acfd28" containerName="main"
Jul 22 21:54:28.536040 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.536000    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f515402-6c28-4a92-9c0a-e1d9c8acfd28" containerName="main"
Jul 22 21:54:28.540606 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.540588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:28.544729 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.544710    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pvl5g\""
Jul 22 21:54:28.569481 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.569456    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7587-139623100306480"]
Jul 22 21:54:28.684506 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.684478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9t6r\" (UniqueName: \"kubernetes.io/projected/54db1f25-6540-42fc-8ddc-e06199a55f5a-kube-api-access-c9t6r\") pod \"test-curl-7587-139623100306480\" (UID: \"54db1f25-6540-42fc-8ddc-e06199a55f5a\") " pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:28.785552 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.785526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9t6r\" (UniqueName: \"kubernetes.io/projected/54db1f25-6540-42fc-8ddc-e06199a55f5a-kube-api-access-c9t6r\") pod \"test-curl-7587-139623100306480\" (UID: \"54db1f25-6540-42fc-8ddc-e06199a55f5a\") " pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:28.794371 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.794317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9t6r\" (UniqueName: \"kubernetes.io/projected/54db1f25-6540-42fc-8ddc-e06199a55f5a-kube-api-access-c9t6r\") pod \"test-curl-7587-139623100306480\" (UID: \"54db1f25-6540-42fc-8ddc-e06199a55f5a\") " pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:28.849228 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.849196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:28.975440 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.975418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7587-139623100306480"]
Jul 22 21:54:28.977508 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:54:28.977483    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54db1f25_6540_42fc_8ddc_e06199a55f5a.slice/crio-c0e70e4d2de4e38fc0b930319d897c8fce4f5981dda3a96f41821b9d44b6bd9a WatchSource:0}: Error finding container c0e70e4d2de4e38fc0b930319d897c8fce4f5981dda3a96f41821b9d44b6bd9a: Status 404 returned error can't find the container with id c0e70e4d2de4e38fc0b930319d897c8fce4f5981dda3a96f41821b9d44b6bd9a
Jul 22 21:54:28.978799 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:28.978774    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 21:54:29.213446 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:29.213421    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7587-139623100306480" event={"ID":"54db1f25-6540-42fc-8ddc-e06199a55f5a","Type":"ContainerStarted","Data":"c0e70e4d2de4e38fc0b930319d897c8fce4f5981dda3a96f41821b9d44b6bd9a"}
Jul 22 21:54:30.219283 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:30.219245    2576 generic.go:356] "Generic (PLEG): container finished" podID="54db1f25-6540-42fc-8ddc-e06199a55f5a" containerID="1c7e7b047d7cb89e21d8cf4a928d4883133bcfda8d4d4775442c1fb3c9554a95" exitCode=0
Jul 22 21:54:30.219664 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:30.219330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7587-139623100306480" event={"ID":"54db1f25-6540-42fc-8ddc-e06199a55f5a","Type":"ContainerDied","Data":"1c7e7b047d7cb89e21d8cf4a928d4883133bcfda8d4d4775442c1fb3c9554a95"}
Jul 22 21:54:31.357376 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.357355    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:31.396148 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.396127    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7587-139623100306480_54db1f25-6540-42fc-8ddc-e06199a55f5a/test-curl-7587-139623100306480/0.log"
Jul 22 21:54:31.419032 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.419005    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7587-139623100306480"]
Jul 22 21:54:31.423339 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.423319    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7587-139623100306480"]
Jul 22 21:54:31.508630 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.508561    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9t6r\" (UniqueName: \"kubernetes.io/projected/54db1f25-6540-42fc-8ddc-e06199a55f5a-kube-api-access-c9t6r\") pod \"54db1f25-6540-42fc-8ddc-e06199a55f5a\" (UID: \"54db1f25-6540-42fc-8ddc-e06199a55f5a\") "
Jul 22 21:54:31.510494 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.510464    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54db1f25-6540-42fc-8ddc-e06199a55f5a-kube-api-access-c9t6r" (OuterVolumeSpecName: "kube-api-access-c9t6r") pod "54db1f25-6540-42fc-8ddc-e06199a55f5a" (UID: "54db1f25-6540-42fc-8ddc-e06199a55f5a"). InnerVolumeSpecName "kube-api-access-c9t6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:54:31.609781 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.609763    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9t6r\" (UniqueName: \"kubernetes.io/projected/54db1f25-6540-42fc-8ddc-e06199a55f5a-kube-api-access-c9t6r\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:54:31.750792 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:31.750769    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54db1f25-6540-42fc-8ddc-e06199a55f5a" path="/var/lib/kubelet/pods/54db1f25-6540-42fc-8ddc-e06199a55f5a/volumes"
Jul 22 21:54:32.231181 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:32.231146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100306480"
Jul 22 21:54:32.231181 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:32.231148    2576 scope.go:117] "RemoveContainer" containerID="1c7e7b047d7cb89e21d8cf4a928d4883133bcfda8d4d4775442c1fb3c9554a95"
Jul 22 21:54:37.473478 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.473444    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7587-139623100401680"]
Jul 22 21:54:37.473837 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.473800    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54db1f25-6540-42fc-8ddc-e06199a55f5a" containerName="test-curl-7587-139623100306480"
Jul 22 21:54:37.473837 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.473811    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="54db1f25-6540-42fc-8ddc-e06199a55f5a" containerName="test-curl-7587-139623100306480"
Jul 22 21:54:37.473908 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.473883    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="54db1f25-6540-42fc-8ddc-e06199a55f5a" containerName="test-curl-7587-139623100306480"
Jul 22 21:54:37.476911 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.476895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:37.479596 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.479569    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pvl5g\""
Jul 22 21:54:37.484554 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.484531    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7587-139623100401680"]
Jul 22 21:54:37.558390 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.558359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk8sg\" (UniqueName: \"kubernetes.io/projected/4bb22387-f923-476f-ad41-76f042435926-kube-api-access-qk8sg\") pod \"test-curl-7587-139623100401680\" (UID: \"4bb22387-f923-476f-ad41-76f042435926\") " pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:37.659326 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.659298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk8sg\" (UniqueName: \"kubernetes.io/projected/4bb22387-f923-476f-ad41-76f042435926-kube-api-access-qk8sg\") pod \"test-curl-7587-139623100401680\" (UID: \"4bb22387-f923-476f-ad41-76f042435926\") " pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:37.668966 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.668940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk8sg\" (UniqueName: \"kubernetes.io/projected/4bb22387-f923-476f-ad41-76f042435926-kube-api-access-qk8sg\") pod \"test-curl-7587-139623100401680\" (UID: \"4bb22387-f923-476f-ad41-76f042435926\") " pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:37.786652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.786582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:37.918943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:37.918922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7587-139623100401680"]
Jul 22 21:54:37.920707 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:54:37.920674    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bb22387_f923_476f_ad41_76f042435926.slice/crio-e0eedad9feede715929782e7b22e9e780d9b8a994d71f21268c4d8cd655a100c WatchSource:0}: Error finding container e0eedad9feede715929782e7b22e9e780d9b8a994d71f21268c4d8cd655a100c: Status 404 returned error can't find the container with id e0eedad9feede715929782e7b22e9e780d9b8a994d71f21268c4d8cd655a100c
Jul 22 21:54:38.261124 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:38.261099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7587-139623100401680" event={"ID":"4bb22387-f923-476f-ad41-76f042435926","Type":"ContainerStarted","Data":"e0eedad9feede715929782e7b22e9e780d9b8a994d71f21268c4d8cd655a100c"}
Jul 22 21:54:39.267209 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:39.267178    2576 generic.go:356] "Generic (PLEG): container finished" podID="4bb22387-f923-476f-ad41-76f042435926" containerID="bc80d7835f1ac8ffd508e58d994e282ad378b83a82da18c1bd491b06640d4c1d" exitCode=0
Jul 22 21:54:39.267575 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:39.267265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7587-139623100401680" event={"ID":"4bb22387-f923-476f-ad41-76f042435926","Type":"ContainerDied","Data":"bc80d7835f1ac8ffd508e58d994e282ad378b83a82da18c1bd491b06640d4c1d"}
Jul 22 21:54:40.396057 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.396036    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:40.419061 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.419041    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7587-139623100401680_4bb22387-f923-476f-ad41-76f042435926/test-curl-7587-139623100401680/0.log"
Jul 22 21:54:40.444782 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.444759    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7587-139623100401680"]
Jul 22 21:54:40.449575 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.449557    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7587-139623100401680"]
Jul 22 21:54:40.485922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.485901    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk8sg\" (UniqueName: \"kubernetes.io/projected/4bb22387-f923-476f-ad41-76f042435926-kube-api-access-qk8sg\") pod \"4bb22387-f923-476f-ad41-76f042435926\" (UID: \"4bb22387-f923-476f-ad41-76f042435926\") "
Jul 22 21:54:40.487943 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.487922    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb22387-f923-476f-ad41-76f042435926-kube-api-access-qk8sg" (OuterVolumeSpecName: "kube-api-access-qk8sg") pod "4bb22387-f923-476f-ad41-76f042435926" (UID: "4bb22387-f923-476f-ad41-76f042435926"). InnerVolumeSpecName "kube-api-access-qk8sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:54:40.586749 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:40.586727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk8sg\" (UniqueName: \"kubernetes.io/projected/4bb22387-f923-476f-ad41-76f042435926-kube-api-access-qk8sg\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:54:41.278652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:41.278624    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0eedad9feede715929782e7b22e9e780d9b8a994d71f21268c4d8cd655a100c"
Jul 22 21:54:41.278652 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:41.278638    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:41.290680 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:54:41.290651    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7587-139623100401680\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="4bb22387-f923-476f-ad41-76f042435926" pod="opendatahub/test-curl-7587-139623100401680"
Jul 22 21:54:41.749939 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:41.749896    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bb22387-f923-476f-ad41-76f042435926" path="/var/lib/kubelet/pods/4bb22387-f923-476f-ad41-76f042435926/volumes"
Jul 22 21:54:54.070922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.070893    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"]
Jul 22 21:54:54.071357 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.071131    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" podUID="4c996ca2-fe52-4e40-a988-4b79ca79b020" containerName="maas-api" containerID="cri-o://5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109" gracePeriod=30
Jul 22 21:54:54.320865 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.320836    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:54:54.342085 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.342012    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c996ca2-fe52-4e40-a988-4b79ca79b020" containerID="5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109" exitCode=0
Jul 22 21:54:54.342085 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.342056    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"
Jul 22 21:54:54.342238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.342096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" event={"ID":"4c996ca2-fe52-4e40-a988-4b79ca79b020","Type":"ContainerDied","Data":"5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109"}
Jul 22 21:54:54.342238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.342136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb" event={"ID":"4c996ca2-fe52-4e40-a988-4b79ca79b020","Type":"ContainerDied","Data":"0213dc609dfe621514a4af7fc0a074a8e860795b9e36df1f769d0b3693a90252"}
Jul 22 21:54:54.342238 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.342158    2576 scope.go:117] "RemoveContainer" containerID="5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109"
Jul 22 21:54:54.351323 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.351305    2576 scope.go:117] "RemoveContainer" containerID="5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109"
Jul 22 21:54:54.351586 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:54:54.351563    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109\": container with ID starting with 5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109 not found: ID does not exist" containerID="5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109"
Jul 22 21:54:54.351694 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.351592    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109"} err="failed to get container status \"5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109\": rpc error: code = NotFound desc = could not find container \"5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109\": container with ID starting with 5fae50c2559519371ffcdfe6b0655ae1963d4ec693f503bc5a7f5811fe342109 not found: ID does not exist"
Jul 22 21:54:54.495312 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.495289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c996ca2-fe52-4e40-a988-4b79ca79b020-openshift-service-ca\") pod \"4c996ca2-fe52-4e40-a988-4b79ca79b020\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") "
Jul 22 21:54:54.495439 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.495360    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls\") pod \"4c996ca2-fe52-4e40-a988-4b79ca79b020\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") "
Jul 22 21:54:54.495439 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.495389    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbzmw\" (UniqueName: \"kubernetes.io/projected/4c996ca2-fe52-4e40-a988-4b79ca79b020-kube-api-access-bbzmw\") pod \"4c996ca2-fe52-4e40-a988-4b79ca79b020\" (UID: \"4c996ca2-fe52-4e40-a988-4b79ca79b020\") "
Jul 22 21:54:54.495696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.495673    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c996ca2-fe52-4e40-a988-4b79ca79b020-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c996ca2-fe52-4e40-a988-4b79ca79b020" (UID: "4c996ca2-fe52-4e40-a988-4b79ca79b020"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:54:54.497529 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.497501    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c996ca2-fe52-4e40-a988-4b79ca79b020" (UID: "4c996ca2-fe52-4e40-a988-4b79ca79b020"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:54:54.497641 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.497571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c996ca2-fe52-4e40-a988-4b79ca79b020-kube-api-access-bbzmw" (OuterVolumeSpecName: "kube-api-access-bbzmw") pod "4c996ca2-fe52-4e40-a988-4b79ca79b020" (UID: "4c996ca2-fe52-4e40-a988-4b79ca79b020"). InnerVolumeSpecName "kube-api-access-bbzmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:54:54.596569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.596515    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c996ca2-fe52-4e40-a988-4b79ca79b020-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:54:54.596569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.596535    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c996ca2-fe52-4e40-a988-4b79ca79b020-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:54:54.596569 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.596544    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbzmw\" (UniqueName: \"kubernetes.io/projected/4c996ca2-fe52-4e40-a988-4b79ca79b020-kube-api-access-bbzmw\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:54:54.665057 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.665034    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"]
Jul 22 21:54:54.668356 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:54.668336    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bddd55-59d9b474b7-cw7mb"]
Jul 22 21:54:55.750271 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:54:55.750239    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c996ca2-fe52-4e40-a988-4b79ca79b020" path="/var/lib/kubelet/pods/4c996ca2-fe52-4e40-a988-4b79ca79b020/volumes"
Jul 22 21:55:16.689060 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.689028    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"]
Jul 22 21:55:16.689436 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.689226    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv" podUID="6f4c3585-6721-4616-b028-6ff58c6d4c2d" containerName="maas-api" containerID="cri-o://25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595" gracePeriod=30
Jul 22 21:55:16.939476 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.939420    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:55:16.962698 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.962673    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c3585-6721-4616-b028-6ff58c6d4c2d-openshift-service-ca\") pod \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") "
Jul 22 21:55:16.962825 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.962726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4c3585-6721-4616-b028-6ff58c6d4c2d-maas-api-tls\") pod \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") "
Jul 22 21:55:16.962885 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.962839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fktzd\" (UniqueName: \"kubernetes.io/projected/6f4c3585-6721-4616-b028-6ff58c6d4c2d-kube-api-access-fktzd\") pod \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\" (UID: \"6f4c3585-6721-4616-b028-6ff58c6d4c2d\") "
Jul 22 21:55:16.963025 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.963004    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4c3585-6721-4616-b028-6ff58c6d4c2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f4c3585-6721-4616-b028-6ff58c6d4c2d" (UID: "6f4c3585-6721-4616-b028-6ff58c6d4c2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 21:55:16.963404 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.963160    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f4c3585-6721-4616-b028-6ff58c6d4c2d-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:55:16.966096 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.966049    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f4c3585-6721-4616-b028-6ff58c6d4c2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f4c3585-6721-4616-b028-6ff58c6d4c2d" (UID: "6f4c3585-6721-4616-b028-6ff58c6d4c2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 21:55:16.966691 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:16.966667    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4c3585-6721-4616-b028-6ff58c6d4c2d-kube-api-access-fktzd" (OuterVolumeSpecName: "kube-api-access-fktzd") pod "6f4c3585-6721-4616-b028-6ff58c6d4c2d" (UID: "6f4c3585-6721-4616-b028-6ff58c6d4c2d"). InnerVolumeSpecName "kube-api-access-fktzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 21:55:17.064244 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.064221    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fktzd\" (UniqueName: \"kubernetes.io/projected/6f4c3585-6721-4616-b028-6ff58c6d4c2d-kube-api-access-fktzd\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:55:17.064332 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.064244    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f4c3585-6721-4616-b028-6ff58c6d4c2d-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 22 21:55:17.455741 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.455708    2576 generic.go:356] "Generic (PLEG): container finished" podID="6f4c3585-6721-4616-b028-6ff58c6d4c2d" containerID="25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595" exitCode=0
Jul 22 21:55:17.455903 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.455760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv" event={"ID":"6f4c3585-6721-4616-b028-6ff58c6d4c2d","Type":"ContainerDied","Data":"25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595"}
Jul 22 21:55:17.455903 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.455798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv" event={"ID":"6f4c3585-6721-4616-b028-6ff58c6d4c2d","Type":"ContainerDied","Data":"8dfff3c49139b2f12a499d45baf08bef10162f4323e5fceb3dd5b3ef475cdf52"}
Jul 22 21:55:17.455903 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.455818    2576 scope.go:117] "RemoveContainer" containerID="25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595"
Jul 22 21:55:17.455903 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.455760    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"
Jul 22 21:55:17.465016 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.464997    2576 scope.go:117] "RemoveContainer" containerID="25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595"
Jul 22 21:55:17.465302 ip-10-0-137-63 kubenswrapper[2576]: E0722 21:55:17.465282    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595\": container with ID starting with 25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595 not found: ID does not exist" containerID="25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595"
Jul 22 21:55:17.465393 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.465314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595"} err="failed to get container status \"25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595\": rpc error: code = NotFound desc = could not find container \"25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595\": container with ID starting with 25cfc979f09500358f18801c8b8b75981b6f0f692e4b42aa9a1c19aa0748b595 not found: ID does not exist"
Jul 22 21:55:17.477473 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.477449    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"]
Jul 22 21:55:17.483685 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.483663    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e44515-7f8d6f956d-cnmkv"]
Jul 22 21:55:17.756519 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:17.756434    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4c3585-6721-4616-b028-6ff58c6d4c2d" path="/var/lib/kubelet/pods/6f4c3585-6721-4616-b028-6ff58c6d4c2d/volumes"
Jul 22 21:55:23.921548 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:23.921457    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:55:23.939432 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:23.925324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:55:23.943178 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:23.943157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:55:23.946626 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:23.946611    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27pfm_f29dd71b-4548-4c9b-a4d5-af413dfcf903/ovn-acl-logging/0.log"
Jul 22 21:55:34.129963 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:34.129934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c96bf86bd-484b5_80713ab6-fc62-46d5-8a5b-05c0ef856108/manager/0.log"
Jul 22 21:55:34.468173 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:34.468055    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-264jv_1aa37c21-d63e-4ecf-a926-382b2073304e/copy-manifests/0.log"
Jul 22 21:55:34.477464 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:34.477435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-264jv_1aa37c21-d63e-4ecf-a926-382b2073304e/manager/0.log"
Jul 22 21:55:35.057496 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:35.057465    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-68c4b7f449-6sb6s_4b51f374-e906-4c59-b0ee-b93e24f66f4c/maas-api/0.log"
Jul 22 21:55:35.382136 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:35.382094    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-2d9mx_f7d97f03-246e-4a22-8372-b0c21b15fa4a/postgres/0.log"
Jul 22 21:55:36.996951 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:36.996926    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lrplg_9378b223-5299-453d-8b09-f4985f68cd80/kuadrant-console-plugin/0.log"
Jul 22 21:55:38.148284 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:38.148236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-dw2fg_4004b070-de6b-4d38-ba4c-e0b2787c6847/kube-auth-proxy/0.log"
Jul 22 21:55:38.381944 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:38.381911    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4k7bp_fd05bdfd-2265-4df1-8181-66192112c289/payload-pre-processing/0.log"
Jul 22 21:55:39.057301 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:39.057264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gqzws_254dc73d-3828-4496-bfb8-e225f817b633/main/0.log"
Jul 22 21:55:39.386918 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:39.386892    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dt85l_52a139bb-3e27-43d0-9147-6a02a85d9940/main/0.log"
Jul 22 21:55:44.471985 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.471955    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sw9zx/must-gather-jmcbg"]
Jul 22 21:55:44.472428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472337    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c996ca2-fe52-4e40-a988-4b79ca79b020" containerName="maas-api"
Jul 22 21:55:44.472428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472348    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c996ca2-fe52-4e40-a988-4b79ca79b020" containerName="maas-api"
Jul 22 21:55:44.472428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472369    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4c3585-6721-4616-b028-6ff58c6d4c2d" containerName="maas-api"
Jul 22 21:55:44.472428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472374    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4c3585-6721-4616-b028-6ff58c6d4c2d" containerName="maas-api"
Jul 22 21:55:44.472428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472385    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bb22387-f923-476f-ad41-76f042435926" containerName="test-curl-7587-139623100401680"
Jul 22 21:55:44.472428 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472391    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bb22387-f923-476f-ad41-76f042435926" containerName="test-curl-7587-139623100401680"
Jul 22 21:55:44.472706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472452    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bb22387-f923-476f-ad41-76f042435926" containerName="test-curl-7587-139623100401680"
Jul 22 21:55:44.472706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472464    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4c3585-6721-4616-b028-6ff58c6d4c2d" containerName="maas-api"
Jul 22 21:55:44.472706 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.472473    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c996ca2-fe52-4e40-a988-4b79ca79b020" containerName="maas-api"
Jul 22 21:55:44.475739 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.475715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.478290 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.478267    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sw9zx\"/\"default-dockercfg-pcvcv\""
Jul 22 21:55:44.478422 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.478400    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sw9zx\"/\"kube-root-ca.crt\""
Jul 22 21:55:44.478539 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.478522    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sw9zx\"/\"openshift-service-ca.crt\""
Jul 22 21:55:44.493088 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.489264    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9zx/must-gather-jmcbg"]
Jul 22 21:55:44.599929 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.599900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfx9\" (UniqueName: \"kubernetes.io/projected/5b7f86eb-46d6-450d-99e7-731f80ec88cf-kube-api-access-twfx9\") pod \"must-gather-jmcbg\" (UID: \"5b7f86eb-46d6-450d-99e7-731f80ec88cf\") " pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.600144 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.599959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5b7f86eb-46d6-450d-99e7-731f80ec88cf-must-gather-output\") pod \"must-gather-jmcbg\" (UID: \"5b7f86eb-46d6-450d-99e7-731f80ec88cf\") " pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.700903 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.700846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfx9\" (UniqueName: \"kubernetes.io/projected/5b7f86eb-46d6-450d-99e7-731f80ec88cf-kube-api-access-twfx9\") pod \"must-gather-jmcbg\" (UID: \"5b7f86eb-46d6-450d-99e7-731f80ec88cf\") " pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.701058 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.700939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5b7f86eb-46d6-450d-99e7-731f80ec88cf-must-gather-output\") pod \"must-gather-jmcbg\" (UID: \"5b7f86eb-46d6-450d-99e7-731f80ec88cf\") " pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.701293 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.701274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5b7f86eb-46d6-450d-99e7-731f80ec88cf-must-gather-output\") pod \"must-gather-jmcbg\" (UID: \"5b7f86eb-46d6-450d-99e7-731f80ec88cf\") " pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.721470 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.721439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfx9\" (UniqueName: \"kubernetes.io/projected/5b7f86eb-46d6-450d-99e7-731f80ec88cf-kube-api-access-twfx9\") pod \"must-gather-jmcbg\" (UID: \"5b7f86eb-46d6-450d-99e7-731f80ec88cf\") " pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.786898 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.786828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9zx/must-gather-jmcbg"
Jul 22 21:55:44.921371 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:44.921345    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9zx/must-gather-jmcbg"]
Jul 22 21:55:44.923359 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:55:44.923329    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b7f86eb_46d6_450d_99e7_731f80ec88cf.slice/crio-6fca91259813dabafc3fff87010fb781e3a6b300092975cb2472e950317657fb WatchSource:0}: Error finding container 6fca91259813dabafc3fff87010fb781e3a6b300092975cb2472e950317657fb: Status 404 returned error can't find the container with id 6fca91259813dabafc3fff87010fb781e3a6b300092975cb2472e950317657fb
Jul 22 21:55:45.584353 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:45.584320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/must-gather-jmcbg" event={"ID":"5b7f86eb-46d6-450d-99e7-731f80ec88cf","Type":"ContainerStarted","Data":"6fca91259813dabafc3fff87010fb781e3a6b300092975cb2472e950317657fb"}
Jul 22 21:55:46.591624 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:46.591583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/must-gather-jmcbg" event={"ID":"5b7f86eb-46d6-450d-99e7-731f80ec88cf","Type":"ContainerStarted","Data":"bec2997cea5a6358b15799c1884debed4faa4721066e9fb1613b839324283999"}
Jul 22 21:55:46.592134 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:46.591639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/must-gather-jmcbg" event={"ID":"5b7f86eb-46d6-450d-99e7-731f80ec88cf","Type":"ContainerStarted","Data":"3ffe1d6267cde030688e6e6a0f8246bcca312827a5d1a7022e7cfca1dbea0d5d"}
Jul 22 21:55:46.614140 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:46.614041    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sw9zx/must-gather-jmcbg" podStartSLOduration=1.7139791519999998 podStartE2EDuration="2.614025506s" totalImagesPullingTime="900.046354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 21:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:55:46.610995936 +0000 UTC m=+3023.393897753" watchObservedRunningTime="2026-07-22 21:55:46.614025506 +0000 UTC m=+3023.396927321"
Jul 22 21:55:47.358261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:47.358225    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vqjdz_dd82aa96-ead0-4184-a4fd-016a555d2d87/global-pull-secret-syncer/0.log"
Jul 22 21:55:47.520484 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:47.520411    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7lzrc_52ae3d51-1c70-4159-a81f-278945a2cfc5/konnectivity-agent/0.log"
Jul 22 21:55:47.606988 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:47.606929    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-63.ec2.internal_5e1e12e96403c8859930639c889248d4/haproxy/0.log"
Jul 22 21:55:52.850922 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:52.850881    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lrplg_9378b223-5299-453d-8b09-f4985f68cd80/kuadrant-console-plugin/0.log"
Jul 22 21:55:55.161730 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.161697    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-w6hn9_ec012bd2-8df6-486f-b14e-390c00c80238/kube-state-metrics/0.log"
Jul 22 21:55:55.207994 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.207951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-w6hn9_ec012bd2-8df6-486f-b14e-390c00c80238/kube-rbac-proxy-main/0.log"
Jul 22 21:55:55.256797 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.256768    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-w6hn9_ec012bd2-8df6-486f-b14e-390c00c80238/kube-rbac-proxy-self/0.log"
Jul 22 21:55:55.427860 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.427771    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwzpt_73f503ea-1b45-4d3c-8548-68888c54b2b5/node-exporter/0.log"
Jul 22 21:55:55.450729 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.450699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwzpt_73f503ea-1b45-4d3c-8548-68888c54b2b5/kube-rbac-proxy/0.log"
Jul 22 21:55:55.473956 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.473932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwzpt_73f503ea-1b45-4d3c-8548-68888c54b2b5/init-textfile/0.log"
Jul 22 21:55:55.685728 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.685622    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/prometheus/0.log"
Jul 22 21:55:55.713901 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.713869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/config-reloader/0.log"
Jul 22 21:55:55.746966 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.746926    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/thanos-sidecar/0.log"
Jul 22 21:55:55.781405 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.781380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/kube-rbac-proxy-web/0.log"
Jul 22 21:55:55.804547 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.804521    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/kube-rbac-proxy/0.log"
Jul 22 21:55:55.827894 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.827868    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/kube-rbac-proxy-thanos/0.log"
Jul 22 21:55:55.849249 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.849225    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08e3f7a5-4c5d-4410-a2ec-85509667fba7/init-config-reloader/0.log"
Jul 22 21:55:55.878023 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.877994    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-clw5b_b90f9bec-ef27-4846-851d-aa396e4605aa/prometheus-operator/0.log"
Jul 22 21:55:55.902948 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.902921    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-clw5b_b90f9bec-ef27-4846-851d-aa396e4605aa/kube-rbac-proxy/0.log"
Jul 22 21:55:55.956961 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.956869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78df9b994c-9rxz9_3f77f16f-b171-47c9-ac24-a7c09029e354/telemeter-client/0.log"
Jul 22 21:55:55.980440 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:55.980413    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78df9b994c-9rxz9_3f77f16f-b171-47c9-ac24-a7c09029e354/reload/0.log"
Jul 22 21:55:56.001009 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:56.000976    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78df9b994c-9rxz9_3f77f16f-b171-47c9-ac24-a7c09029e354/kube-rbac-proxy/0.log"
Jul 22 21:55:57.012942 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.012901    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"]
Jul 22 21:55:57.018698 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.018676    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.025802 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.025774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"]
Jul 22 21:55:57.038260 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.038238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-lib-modules\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.038486 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.038469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-podres\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.038639 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.038626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-proc\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.038778 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.038763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/4ebb2bd1-5c94-4269-ad51-990dace34331-kube-api-access-mlxsr\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.038938 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.038925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-sys\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.139821 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.139782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-sys\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140013 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.139910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-lib-modules\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140013 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.139942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-podres\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140013 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.139972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-proc\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140013 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.139994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/4ebb2bd1-5c94-4269-ad51-990dace34331-kube-api-access-mlxsr\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140256 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.140089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-lib-modules\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140256 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.140199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-podres\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140372 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.140258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-proc\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.140372 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.139949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ebb2bd1-5c94-4269-ad51-990dace34331-sys\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.149627 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.149583    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/4ebb2bd1-5c94-4269-ad51-990dace34331-kube-api-access-mlxsr\") pod \"perf-node-gather-daemonset-qc7ng\" (UID: \"4ebb2bd1-5c94-4269-ad51-990dace34331\") " pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.269696 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.269627    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dtwlx_1730023d-9ded-4304-94fd-3d08ea7314be/networking-console-plugin/0.log"
Jul 22 21:55:57.338796 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.338758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.526842 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.525519    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"]
Jul 22 21:55:57.527354 ip-10-0-137-63 kubenswrapper[2576]: W0722 21:55:57.527314    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4ebb2bd1_5c94_4269_ad51_990dace34331.slice/crio-ac33ac965457476eba76588c0715bd331c68a921aaf5d698bbab9204bdec2e21 WatchSource:0}: Error finding container ac33ac965457476eba76588c0715bd331c68a921aaf5d698bbab9204bdec2e21: Status 404 returned error can't find the container with id ac33ac965457476eba76588c0715bd331c68a921aaf5d698bbab9204bdec2e21
Jul 22 21:55:57.673645 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.673602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng" event={"ID":"4ebb2bd1-5c94-4269-ad51-990dace34331","Type":"ContainerStarted","Data":"12949b6c09bf164914e79559ef2d59f2c5e461d462bbc0b1f7a51ffbb557872b"}
Jul 22 21:55:57.673823 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.673678    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng" event={"ID":"4ebb2bd1-5c94-4269-ad51-990dace34331","Type":"ContainerStarted","Data":"ac33ac965457476eba76588c0715bd331c68a921aaf5d698bbab9204bdec2e21"}
Jul 22 21:55:57.674491 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.674464    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:55:57.694551 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.694490    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng" podStartSLOduration=1.69446759 podStartE2EDuration="1.69446759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 21:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 21:55:57.692343258 +0000 UTC m=+3034.475245102" watchObservedRunningTime="2026-07-22 21:55:57.69446759 +0000 UTC m=+3034.477369409"
Jul 22 21:55:57.843887 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.843856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/1.log"
Jul 22 21:55:57.851132 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:55:57.851102    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-ttdhl_442d3f1c-3031-4bfe-a8eb-fbf20f5fda39/console-operator/2.log"
Jul 22 21:56:00.009163 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:00.009046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2dhw2_744b520d-1f70-4927-93c4-c739d227a58b/dns/0.log"
Jul 22 21:56:00.029216 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:00.029188    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2dhw2_744b520d-1f70-4927-93c4-c739d227a58b/kube-rbac-proxy/0.log"
Jul 22 21:56:00.144565 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:00.144538    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rk8w2_6369a9b6-f821-4279-b5cb-6e705932b299/dns-node-resolver/0.log"
Jul 22 21:56:00.802371 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:00.802340    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wng62_33091d94-1a6c-49c3-aeac-b99407eaf5ff/node-ca/0.log"
Jul 22 21:56:01.900519 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:01.900491    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-dw2fg_4004b070-de6b-4d38-ba4c-e0b2787c6847/kube-auth-proxy/0.log"
Jul 22 21:56:02.020587 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:02.020560    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4k7bp_fd05bdfd-2265-4df1-8181-66192112c289/payload-pre-processing/0.log"
Jul 22 21:56:02.804532 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:02.804510    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l7s4j_ee137d5e-68e7-46aa-868b-fb8a28affe40/serve-healthcheck-canary/0.log"
Jul 22 21:56:03.280814 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:03.280783    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-lb2vp_5324b774-3afc-450b-81ab-a7f00bbdfbf9/insights-operator/0.log"
Jul 22 21:56:03.281500 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:03.281472    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-lb2vp_5324b774-3afc-450b-81ab-a7f00bbdfbf9/insights-operator/1.log"
Jul 22 21:56:03.390219 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:03.390193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cqxcr_2cd2b52b-469d-4bcd-9b35-5fc39b14228a/kube-rbac-proxy/0.log"
Jul 22 21:56:03.425919 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:03.425898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cqxcr_2cd2b52b-469d-4bcd-9b35-5fc39b14228a/exporter/0.log"
Jul 22 21:56:03.478937 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:03.478912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cqxcr_2cd2b52b-469d-4bcd-9b35-5fc39b14228a/extractor/0.log"
Jul 22 21:56:04.698362 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:04.698336    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sw9zx/perf-node-gather-daemonset-qc7ng"
Jul 22 21:56:06.310021 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:06.309935    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6c96bf86bd-484b5_80713ab6-fc62-46d5-8a5b-05c0ef856108/manager/0.log"
Jul 22 21:56:06.465718 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:06.465687    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-264jv_1aa37c21-d63e-4ecf-a926-382b2073304e/manager/0.log"
Jul 22 21:56:06.489448 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:06.489414    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b88fc4594-264jv_1aa37c21-d63e-4ecf-a926-382b2073304e/copy-manifests/0.log"
Jul 22 21:56:07.848003 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:07.847976    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-dw2fg_4004b070-de6b-4d38-ba4c-e0b2787c6847/kube-auth-proxy/0.log"
Jul 22 21:56:07.922155 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:07.922094    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-795d667875-dvzbb_976d3ff8-dc19-48bd-bb38-ef0c373ddbe3/manager/0.log"
Jul 22 21:56:07.940261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:07.940231    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4k7bp_fd05bdfd-2265-4df1-8181-66192112c289/payload-pre-processing/0.log"
Jul 22 21:56:07.951038 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:07.951007    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-87q77_53bd93aa-e2a2-4a43-a7ea-0f6d7810ec44/openshift-lws-operator/0.log"
Jul 22 21:56:09.485297 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:09.485250    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f89f554cd-dw2fg_4004b070-de6b-4d38-ba4c-e0b2787c6847/kube-auth-proxy/0.log"
Jul 22 21:56:09.583397 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:09.583362    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-4k7bp_fd05bdfd-2265-4df1-8181-66192112c289/payload-pre-processing/0.log"
Jul 22 21:56:13.122384 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:13.122352    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-756kn_9ccbbe69-f3d7-4dfb-8bdf-b7a174981027/migrator/0.log"
Jul 22 21:56:13.173700 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:13.173675    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-756kn_9ccbbe69-f3d7-4dfb-8bdf-b7a174981027/graceful-termination/0.log"
Jul 22 21:56:13.583432 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:13.583403    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-b8c6l_49f296b7-68b2-4dc9-8581-b7045123b76d/kube-storage-version-migrator-operator/1.log"
Jul 22 21:56:13.584261 ip-10-0-137-63 kubenswrapper[2576]: I0722 21:56:13.584247    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-b8c6l_49f296b7-68b2-4dc9-8581-b7045123b76d/kube-storage-version-migrator-operator/0.log"