Jul 21 15:00:35.435904 ip-10-0-128-244 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 15:00:35.858137 ip-10-0-128-244 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 15:00:35.858137 ip-10-0-128-244 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 15:00:35.858137 ip-10-0-128-244 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 15:00:35.858137 ip-10-0-128-244 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 15:00:35.858137 ip-10-0-128-244 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 15:00:35.858902 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.858186    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 15:00:35.863901 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863886    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 15:00:35.863901 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863900    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 15:00:35.863901 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863904    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863907    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863911    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863914    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863917    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863919    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863924    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863928    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863931    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863934    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863936    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863939    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863941    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863944    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863947    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863949    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863952    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863955    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863957    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863960    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 15:00:35.863990 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863963    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863965    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863967    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863970    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863973    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863975    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863978    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863980    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863983    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863985    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863988    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863990    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863993    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863995    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.863998    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864001    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864005    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864007    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864010    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 15:00:35.864468 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864012    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864014    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864017    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864019    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864022    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864024    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864029    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864032    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864035    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864038    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864040    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864043    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864045    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864048    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864050    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864053    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864056    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864059    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864062    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864064    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 15:00:35.864973 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864067    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864069    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864071    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864074    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864076    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864079    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864081    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864083    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864086    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864089    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864092    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864095    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864097    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864100    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864102    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864104    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864107    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864109    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864112    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864114    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 15:00:35.865457 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864116    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864119    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864121    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864123    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864128    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864132    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864135    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864138    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864140    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864143    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864145    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864148    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864150    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864153    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864155    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864157    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864160    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864163    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864856    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 15:00:35.865946 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864863    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864866    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864869    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864871    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864874    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864877    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864882    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864886    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864889    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864892    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864894    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864897    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864901    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864904    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864906    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864909    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864912    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864915    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864918    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 15:00:35.866417 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864921    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864924    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864926    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864929    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864932    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864934    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864937    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864940    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864942    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864944    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864947    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864950    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864952    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864955    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864957    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864960    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864962    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864965    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864968    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864970    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 15:00:35.866904 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864972    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864975    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864977    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864980    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864983    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864985    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864988    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864991    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864993    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864996    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.864999    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865001    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865005    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865007    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865010    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865013    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865016    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865018    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865021    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865023    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 15:00:35.867392 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865026    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865028    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865031    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865033    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865035    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865038    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865040    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865043    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865045    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865048    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865050    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865053    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865055    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865058    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865060    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865063    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865065    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865068    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865070    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865073    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 15:00:35.867909 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865075    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865077    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865080    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865083    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865086    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865088    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865093    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865096    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865098    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865101    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865103    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865106    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865108    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865111    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865113    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865116    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865118    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865121    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865123    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 15:00:35.868397 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865476    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865481    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865483    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865486    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865490    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865492    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865495    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865497    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865500    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865502    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865505    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865507    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865510    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865512    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865515    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865517    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865520    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865523    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865526    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 15:00:35.868867 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865529    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865531    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865534    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865537    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865539    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865541    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865544    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865546    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865549    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865551    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865554    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865556    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865559    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865561    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865564    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865566    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865569    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865571    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865574    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865576    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 15:00:35.869343 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865581    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865598    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865601    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865618    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865621    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865623    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865626    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865629    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865631    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865634    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865637    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865640    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865642    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865645    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865647    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865650    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865653    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865655    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865658    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865660    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 15:00:35.869831 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865662    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865665    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865667    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865670    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865672    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865675    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865677    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865679    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865681    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865684    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865686    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865689    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865693    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865696    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865699    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865701    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865704    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865707    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865709    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 15:00:35.870357 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865711    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865714    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865716    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865722    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865724    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865728    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865731    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865733    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865736    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865738    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865740    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865743    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865745    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865748    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865750    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865753    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865756    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865759    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865761    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865764    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 15:00:35.870834 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.865766    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865838    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865849    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865878    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865883    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865888    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865891    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865895    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865899    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865902    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865905    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865908    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865912    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865915    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865919    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865923    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865926    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865929    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865932    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865936    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865939    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865942    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865945    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865949    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 15:00:35.871313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865953    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865956    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865959    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865962    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865966    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865969    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865972    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865975    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865978    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865982    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865985    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865988    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865991    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865994    2562 flags.go:64] FLAG: --enable-server="true"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.865997    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866001    2562 flags.go:64] FLAG: --event-burst="100"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866004    2562 flags.go:64] FLAG: --event-qps="50"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866007    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866010    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866013    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866016    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866019    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866022    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866027    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866029    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 15:00:35.871959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866032    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866035    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866038    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866041    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866044    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866047    2562 flags.go:64] FLAG: --feature-gates=""
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866050    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866053    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866056    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866059    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866062    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866065    2562 flags.go:64] FLAG: --help="false"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866067    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-244.ec2.internal"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866070    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866073    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866076    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866079    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866082    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866085    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866087    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866090    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866093    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866096    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866099    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 15:00:35.872632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866102    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866104    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866107    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866110    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866112    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866125    2562 flags.go:64] FLAG: --lock-file=""
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866129    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866132    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866135    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866140    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866143    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866146    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866149    2562 flags.go:64] FLAG: --logging-format="text"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866152    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866155    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866158    2562 flags.go:64] FLAG: --manifest-url=""
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866161    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866165    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866168    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866172    2562 flags.go:64] FLAG: --max-pods="110"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866175    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866178    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866181    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866184    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866186    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 15:00:35.873216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866189    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866192    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866198    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866201    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866204    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866207    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866211    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866217    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866219    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866222    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866225    2562 flags.go:64] FLAG: --port="10250"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866228    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866231    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3a64d54e071d3e8"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866238    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866241    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866244    2562 flags.go:64] FLAG: --register-node="true"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866246    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866250    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866253    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866256    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866258    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866262    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866265    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866268    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866271    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 15:00:35.873835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866273    2562 flags.go:64] FLAG: --runonce="false"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866276    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866279    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866282    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866285    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866287    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866290    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866293    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866296    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866299    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866301    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866304    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866307    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866309    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866313    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866315    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866320    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866323    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866325    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866329    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866335    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866337    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866340    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866343    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866346    2562 flags.go:64] FLAG: --v="2"
Jul 21 15:00:35.874447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866349    2562 flags.go:64] FLAG: --version="false"
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866353    2562 flags.go:64] FLAG: --vmodule=""
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866357    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866360    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866473    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866477    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866480    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866483    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866485    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866488    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866490    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866493    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866495    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866498    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866500    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866503    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866507    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866510    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866513    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866516    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 15:00:35.875072 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866518    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866521    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866524    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866527    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866529    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866532    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866535    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866539    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866542    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866545    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866547    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866550    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866553    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866555    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866557    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866560    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866563    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866565    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866568    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 15:00:35.875581 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866570    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866573    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866576    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866578    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866582    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866585    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866588    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866590    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866593    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866596    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866598    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866601    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866619    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866623    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866626    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866628    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866631    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866634    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866636    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866639    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 15:00:35.876141 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866643    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866646    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866648    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866651    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866653    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866656    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866658    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866662    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866664    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866667    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866669    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866672    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866674    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866677    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866679    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866682    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866684    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866687    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866689    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866692    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 15:00:35.876641 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866694    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866696    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866699    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866702    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866704    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866707    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866709    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866712    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866714    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866718    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866722    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866724    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866728    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866731    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866734    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866736    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866739    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866741    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866744    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866746    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 15:00:35.877187 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866749    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866751    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866754    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.866756    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.866762    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.873542    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.873556    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.873572    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.873579    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873652    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873658    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873661    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873664    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873667    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 15:00:35.877707 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873670    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873672    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873675    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873678    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873680    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873683    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873685    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873688    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873691    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873694    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873696    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873699    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873701    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873704    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873706    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873709    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873711    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873715    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873719    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873722    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 15:00:35.878161 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873725    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873729    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873732    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873735    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873738    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873741    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873745    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873748    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873751    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873754    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873757    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873759    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873762    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873764    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873767    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873770    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873772    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873775    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873778    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 15:00:35.878664 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873781    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873784    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873786    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873789    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873791    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873794    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873796    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873798    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873801    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873803    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873806    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873808    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873810    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873813    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873816    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873819    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873823    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873826    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873828    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873831    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 15:00:35.879135 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873833    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873836    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873838    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873841    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873844    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873846    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873849    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873851    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873854    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873857    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873859    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873862    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873864    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873867    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873870    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873872    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873875    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873877    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873880    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873882    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 15:00:35.879656 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873885    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873887    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873890    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873892    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873895    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873897    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873900    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873903    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873905    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873908    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873910    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873913    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873915    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873917    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 15:00:35.880361 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.873920    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.873925    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874035    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874039    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874042    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874045    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874047    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874049    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874052    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874055    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874057    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874060    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874064    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874068    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 15:00:35.881001 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874070    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874074    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874077    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874080    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874083    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874085    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874088    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874090    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874092    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874095    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874097    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874100    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874102    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874105    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874108    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874110    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874112    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874123    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874126    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 15:00:35.881574 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874129    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874131    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874134    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874136    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874139    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874141    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874143    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874146    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874149    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874151    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874153    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874156    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874158    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874162    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874164    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874167    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874169    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874172    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874174    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874176    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 15:00:35.882256 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874179    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874181    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874183    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874187    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874189    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874192    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874195    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874197    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874199    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874202    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874204    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874207    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874209    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874212    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874214    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874217    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874219    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874222    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874224    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874227    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 15:00:35.882951 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874229    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874232    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874234    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874236    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874239    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874241    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874244    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874246    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874249    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874251    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874253    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874256    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874258    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874260    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874263    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874265    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874268    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874270    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874274    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874277    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 15:00:35.883517 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874279    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874282    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874284    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874287    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874290    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874292    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874295    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:35.874297    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.874302    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.874407    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.876528    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.877825    2562 server.go:1019] "Starting client certificate rotation"
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.877935    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 15:00:35.884022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.877977    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 15:00:35.884342 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.880551    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 15:00:35.884342 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.883320    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 15:00:35.890782 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.890764    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 21 15:00:35.892769 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.892753    2562 log.go:25] "Validated CRI v1 image API"
Jul 21 15:00:35.893592 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.893569    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 15:00:35.896598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.896572    2562 fs.go:135] Filesystem UUIDs: map[096dff11-01fc-4935-9808-da7709e1de6f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9cb81c87-6c38-438b-bbb2-a60aa7829151:/dev/nvme0n1p3]
Jul 21 15:00:35.896678 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.896598    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 15:00:35.902344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.902237    2562 manager.go:216] Machine: {Timestamp:2026-07-21 15:00:35.900877949 +0000 UTC m=+0.335665742 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100854 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f9ff81b49679939b9ab64f0da289d SystemUUID:ec2f9ff8-1b49-6799-39b9-ab64f0da289d BootID:ada11410-46e2-4fed-917c-24ebd2070f02 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bf:a3:30:e8:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bf:a3:30:e8:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:15:3e:9d:b2:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 15:00:35.902344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.902342    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 15:00:35.902447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.902415    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 15:00:35.905799 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.905776    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 15:00:35.905931 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.905803    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 15:00:35.906510 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.906497    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 15:00:35.906510 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.906510    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 15:00:35.906584 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.906517    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 15:00:35.907422 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.907412    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 15:00:35.908090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.908069    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 15:00:35.908887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.908877    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 15:00:35.911880 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.911868    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 15:00:35.911978 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.911969    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 15:00:35.912016 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.911997    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 15:00:35.912016 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.912008    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 15:00:35.912072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.912021    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 15:00:35.912072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.912031    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 21 15:00:35.912072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.912039    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 15:00:35.912384 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.912369    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 15:00:35.912490 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.912387    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 15:00:35.915028 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.915004    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 15:00:35.916910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.916893    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 15:00:35.916982 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.916925    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 15:00:35.917580 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917564    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917585    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917594    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917602    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917634    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917643    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917654    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917662    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 15:00:35.917675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917673    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 15:00:35.917924 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917681    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 15:00:35.917924 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917693    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 15:00:35.917924 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.917702    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 15:00:35.918538 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.918527    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 15:00:35.918586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.918541    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 15:00:35.921716 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.921696    2562 server.go:1268] "Started kubelet"
Jul 21 15:00:35.921814 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.921786    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 15:00:35.921900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.921788    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 15:00:35.921900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.921860    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 15:00:35.922703 ip-10-0-128-244 systemd[1]: Started Kubernetes Kubelet.
Jul 21 15:00:35.923286 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.923256    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 15:00:35.923342 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.923300    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 15:00:35.923455 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.923433    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 15:00:35.923504 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.923435    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 15:00:35.924933 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.924919    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 15:00:35.927306 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.927285    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 15:00:35.931031 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.930868    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 15:00:35.931031 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.930898    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 15:00:35.931130 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.931041    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:35.931677 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931658    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 15:00:35.931677 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931679    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 15:00:35.931799 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931769    2562 factory.go:55] Registering systemd factory
Jul 21 15:00:35.931799 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931785    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 21 15:00:35.931799 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931793    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 15:00:35.931937 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931857    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 15:00:35.931937 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.931863    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 15:00:35.932023 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.932002    2562 factory.go:153] Registering CRI-O factory
Jul 21 15:00:35.932023 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.932015    2562 factory.go:223] Registration of the crio container factory successfully
Jul 21 15:00:35.932105 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.932066    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 15:00:35.932259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.932205    2562 factory.go:103] Registering Raw factory
Jul 21 15:00:35.932309 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.932266    2562 manager.go:1196] Started watching for new ooms in manager
Jul 21 15:00:35.932701 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.932682    2562 manager.go:349] Starting recovery of all containers
Jul 21 15:00:35.933903 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.933867    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 15:00:35.933993 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.933966    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 15:00:35.934548 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.933536    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-244.ec2.internal.18c4561d3ceb96b0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-244.ec2.internal,UID:ip-10-0-128-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-244.ec2.internal,},FirstTimestamp:2026-07-21 15:00:35.921671856 +0000 UTC m=+0.356459642,LastTimestamp:2026-07-21 15:00:35.921671856 +0000 UTC m=+0.356459642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-244.ec2.internal,}"
Jul 21 15:00:35.945304 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.945193    2562 manager.go:354] Recovery completed
Jul 21 15:00:35.949574 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.949561    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:35.951329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951308    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:35.951404 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951347    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:35.951404 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951364    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:35.951897 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951883    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 15:00:35.951897 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951895    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 15:00:35.952007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951902    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:35.952007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.951909    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 15:00:35.952481 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.952465    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:35.952528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.952492    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:35.952528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.952502    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:35.953070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.953058    2562 policy_none.go:49] "None policy: Start"
Jul 21 15:00:35.953113 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.953075    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 15:00:35.953113 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.953085    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 15:00:35.954111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.954101    2562 policy_none.go:47] "Start"
Jul 21 15:00:35.962239 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.962223    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4vvmq"
Jul 21 15:00:35.964198 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.964126    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-244.ec2.internal.18c4561d3eb01fd8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-244.ec2.internal,UID:ip-10-0-128-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-244.ec2.internal,},FirstTimestamp:2026-07-21 15:00:35.95132924 +0000 UTC m=+0.386117033,LastTimestamp:2026-07-21 15:00:35.95132924 +0000 UTC m=+0.386117033,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-244.ec2.internal,}"
Jul 21 15:00:35.966673 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.966597    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-244.ec2.internal.18c4561d3eb086e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-244.ec2.internal,UID:ip-10-0-128-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-244.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-244.ec2.internal,},FirstTimestamp:2026-07-21 15:00:35.951355619 +0000 UTC m=+0.386143411,LastTimestamp:2026-07-21 15:00:35.951355619 +0000 UTC m=+0.386143411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-244.ec2.internal,}"
Jul 21 15:00:35.973682 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.973664    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4vvmq"
Jul 21 15:00:35.977419 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.975481    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-244.ec2.internal.18c4561d3eb0c283  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-244.ec2.internal,UID:ip-10-0-128-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-244.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-244.ec2.internal,},FirstTimestamp:2026-07-21 15:00:35.951370883 +0000 UTC m=+0.386158672,LastTimestamp:2026-07-21 15:00:35.951370883 +0000 UTC m=+0.386158672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-244.ec2.internal,}"
Jul 21 15:00:35.979836 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.979763    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-244.ec2.internal.18c4561d3eb01fd8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-244.ec2.internal.18c4561d3eb01fd8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-244.ec2.internal,UID:ip-10-0-128-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-244.ec2.internal,},FirstTimestamp:2026-07-21 15:00:35.95132924 +0000 UTC m=+0.386117033,LastTimestamp:2026-07-21 15:00:35.952481094 +0000 UTC m=+0.387268878,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-244.ec2.internal,}"
Jul 21 15:00:35.983730 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.983718    2562 manager.go:337] "Starting Device Plugin manager"
Jul 21 15:00:35.983785 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.983746    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 15:00:35.983785 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.983759    2562 server.go:87] "Starting device plugin registration server"
Jul 21 15:00:35.984042 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.984029    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 15:00:35.984091 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.984044    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 15:00:35.984225 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.984203    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 15:00:35.984310 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.984275    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 15:00:35.984310 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:35.984283    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 15:00:35.984927 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.984909    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 15:00:35.985008 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:35.984953    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.035012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.034973    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 15:00:36.036307 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.036288    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 15:00:36.036363 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.036337    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 15:00:36.036363 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.036361    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 15:00:36.036445 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.036405    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 15:00:36.039183 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.039161    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 15:00:36.084145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.084113    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:36.084968 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.084950    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:36.085056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.084981    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:36.085056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.084992    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:36.085056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.085015    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.092774 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.092755    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.092774 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.092775    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-244.ec2.internal\": node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.127707 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.127639    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.137116 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.137095    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"]
Jul 21 15:00:36.137211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.137159    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:36.138477 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.138448    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:36.138556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.138489    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:36.138556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.138504    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:36.139892 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.139880    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:36.140025 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.140061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140042    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:36.140645 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140628    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:36.140645 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140641    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:36.140788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140657    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:36.140788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140663    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:36.140788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140667    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:36.140788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.140673    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:36.141822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.141806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.141882 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.141840    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:36.142528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.142504    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:36.142528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.142530    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:36.142644 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.142539    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:36.175293 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.175263    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-244.ec2.internal\" not found" node="ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.179680 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.179665    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-244.ec2.internal\" not found" node="ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.228547 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.228524    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.234888 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.234858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d26b371a22af354442f70c9ec094aa91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"d26b371a22af354442f70c9ec094aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.234953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.234901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d26b371a22af354442f70c9ec094aa91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"d26b371a22af354442f70c9ec094aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.234953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.234923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b3614c0559335b078ab25aae1c59cdc-config\") pod \"kube-apiserver-proxy-ip-10-0-128-244.ec2.internal\" (UID: \"2b3614c0559335b078ab25aae1c59cdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.329048 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.329020    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.335344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.335323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d26b371a22af354442f70c9ec094aa91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"d26b371a22af354442f70c9ec094aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.335398 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.335348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d26b371a22af354442f70c9ec094aa91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"d26b371a22af354442f70c9ec094aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.335398 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.335365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b3614c0559335b078ab25aae1c59cdc-config\") pod \"kube-apiserver-proxy-ip-10-0-128-244.ec2.internal\" (UID: \"2b3614c0559335b078ab25aae1c59cdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.335461 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.335403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b3614c0559335b078ab25aae1c59cdc-config\") pod \"kube-apiserver-proxy-ip-10-0-128-244.ec2.internal\" (UID: \"2b3614c0559335b078ab25aae1c59cdc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.335461 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.335426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d26b371a22af354442f70c9ec094aa91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"d26b371a22af354442f70c9ec094aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.335461 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.335427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d26b371a22af354442f70c9ec094aa91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"d26b371a22af354442f70c9ec094aa91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.429847 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.429779    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.477230 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.477192    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.483540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.483505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:36.530509 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.530480    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.631021 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.630986    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.731529 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.731451    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.831936 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.831906    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.877528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.877505    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 15:00:36.878034 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.877722    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 15:00:36.932410 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:36.932377    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:36.979509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.979478    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 14:55:36 +0000 UTC" deadline="2027-12-19 14:42:33.240766095 +0000 UTC"
Jul 21 15:00:36.979509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:36.979509    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12383h41m56.261260733s"
Jul 21 15:00:37.033519 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.033487    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:37.073884 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:37.073850    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3614c0559335b078ab25aae1c59cdc.slice/crio-4bb986f86ed34eca57178bea0beb133ed618c32948275fbf917ae4a3d174eb9a WatchSource:0}: Error finding container 4bb986f86ed34eca57178bea0beb133ed618c32948275fbf917ae4a3d174eb9a: Status 404 returned error can't find the container with id 4bb986f86ed34eca57178bea0beb133ed618c32948275fbf917ae4a3d174eb9a
Jul 21 15:00:37.077884 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.077864    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:00:37.126457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.126433    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 15:00:37.128571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.128558    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 15:00:37.129924 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.129909    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 15:00:37.129996 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.129941    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 15:00:37.129996 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.129952    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID"
Jul 21 15:00:37.134451 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.134431    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:37.238461 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.238408    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:37.338703 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.338624    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found"
Jul 21 15:00:37.426831 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.426802    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 15:00:37.432567 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.432547    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:37.451297 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.451266    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 15:00:37.453082 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.453064    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"
Jul 21 15:00:37.462578 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.462557    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 15:00:37.518476 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.518450    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 15:00:37.915125 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.915090    2562 apiserver.go:52] "Watching apiserver"
Jul 21 15:00:37.919691 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:37.919658    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26b371a22af354442f70c9ec094aa91.slice/crio-aa8c04a514a01f905e8cdfe99227583dd9442d8a7f936b4cd4c4f52531b2f988 WatchSource:0}: Error finding container aa8c04a514a01f905e8cdfe99227583dd9442d8a7f936b4cd4c4f52531b2f988: Status 404 returned error can't find the container with id aa8c04a514a01f905e8cdfe99227583dd9442d8a7f936b4cd4c4f52531b2f988
Jul 21 15:00:37.922287 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.922267    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 15:00:37.923672 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.923646    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-5wf7j","kube-system/global-pull-secret-syncer-2dggs","kube-system/konnectivity-agent-pthnf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw","openshift-multus/multus-additional-cni-plugins-jq75n","openshift-multus/multus-rlxv7","openshift-multus/network-metrics-daemon-s667c","openshift-network-diagnostics/network-check-target-krjpq","kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal","openshift-cluster-node-tuning-operator/tuned-g5574","openshift-dns/node-resolver-ktv79","openshift-image-registry/node-ca-z9d8d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal","openshift-network-operator/iptables-alerter-gr8hz"]
Jul 21 15:00:37.925340 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.925324    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.927155 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.927134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:37.927983 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.927966    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.928129 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.928112    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gm5zf\""
Jul 21 15:00:37.928293 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.928276    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.928655 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.928622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:37.930586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.930371    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.930842 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.930821    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f52qs\""
Jul 21 15:00:37.931208 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931188    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.931294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931219    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 15:00:37.931350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931321    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p8v9g\""
Jul 21 15:00:37.931350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931341    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 15:00:37.931557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931537    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.931623 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931586    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.932003 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.931978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:37.932105 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.932064    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:37.933419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.932799    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.933419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.932885    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.933419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.933134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 15:00:37.933419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.933253    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xzs6t\""
Jul 21 15:00:37.934440 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.933972    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.934440 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.934297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:37.935520 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.935501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:37.936849 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.936831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:37.937294 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.936948    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:37.937294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937035    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.937294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937058    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 15:00:37.937294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937060    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 15:00:37.937545 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bmdkv\""
Jul 21 15:00:37.937785 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937767    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.937910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937892    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 15:00:37.938012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.937994    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 15:00:37.938090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.938065    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lhpl8\""
Jul 21 15:00:37.938397 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.938382    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:37.939588 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.939571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:37.941194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.941177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:37.941270 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:37.941249    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:37.942421 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.942406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:37.943236 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-tmp\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f792d08d-7534-4a5b-bebf-af847eff1efb-host-slash\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:37.943329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-sys-fs\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.943329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943282    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llljl\" (UniqueName: \"kubernetes.io/projected/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-kube-api-access-llljl\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.943467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysconfig\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysctl-d\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysctl-conf\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-tuned\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52cj4\" (UniqueName: \"kubernetes.io/projected/f792d08d-7534-4a5b-bebf-af847eff1efb-kube-api-access-52cj4\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:37.943632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.943632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-modprobe-d\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-sys\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-hosts-file\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85cvn\" (UniqueName: \"kubernetes.io/projected/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-kube-api-access-85cvn\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-device-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-host\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-socket-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djvbl\" (UniqueName: \"kubernetes.io/projected/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-kube-api-access-djvbl\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.943887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-kubernetes\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-lib-modules\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-var-lib-kubelet\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-systemd\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-run\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-tmp-dir\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.943989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f792d08d-7534-4a5b-bebf-af847eff1efb-iptables-alerter-script\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:37.944216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.944005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-registration-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:37.945380 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.945364    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 15:00:37.945906 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.945890    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zp99c\""
Jul 21 15:00:37.946332 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.946316    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.954328 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.954289    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 15:00:37.954419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.954347    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 15:00:37.954419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.954379    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 15:00:37.954419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.954398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.954419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.954289    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 15:00:37.955440 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.955421    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 15:00:37.955440 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.955441    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wqkqt\""
Jul 21 15:00:37.955585 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.955423    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 15:00:37.955585 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.955426    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m8m2l\""
Jul 21 15:00:37.955585 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.955466    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 15:00:37.968891 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.968873    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 15:00:37.971025 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:37.971006    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 15:00:38.014373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.014348    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pwk77"
Jul 21 15:00:38.029992 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.029970    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pwk77"
Jul 21 15:00:38.035103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.034020    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 15:00:38.040825 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.040775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"d26b371a22af354442f70c9ec094aa91","Type":"ContainerStarted","Data":"aa8c04a514a01f905e8cdfe99227583dd9442d8a7f936b4cd4c4f52531b2f988"}
Jul 21 15:00:38.041884 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.041860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" event={"ID":"2b3614c0559335b078ab25aae1c59cdc","Type":"ContainerStarted","Data":"4bb986f86ed34eca57178bea0beb133ed618c32948275fbf917ae4a3d174eb9a"}
Jul 21 15:00:38.044247 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-run\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.044329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-tmp-dir\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.044329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-registration-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.044430 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-run\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.044430 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-registration-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.044430 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-cni-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.044430 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-hostroot\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ctr\" (UniqueName: \"kubernetes.io/projected/744993f6-9a37-41ff-bbd0-3b617cc71bd1-kube-api-access-z5ctr\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-os-release\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-tmp\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f792d08d-7534-4a5b-bebf-af847eff1efb-host-slash\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-sys-fs\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llljl\" (UniqueName: \"kubernetes.io/projected/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-kube-api-access-llljl\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-cni-multus\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.044600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-tmp-dir\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-ovn\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-sys-fs\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f792d08d-7534-4a5b-bebf-af847eff1efb-host-slash\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysconfig\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysctl-d\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysctl-conf\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52cj4\" (UniqueName: \"kubernetes.io/projected/f792d08d-7534-4a5b-bebf-af847eff1efb-kube-api-access-52cj4\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysconfig\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044787    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-socket-dir-parent\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-node-log\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-sys\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-hosts-file\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysctl-d\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-sysctl-conf\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b0c880c-0774-45a5-bc7c-9332c58c0600-kubelet-config\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cnibin\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.044995    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-sys\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-hosts-file\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-host\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzpd8\" (UniqueName: \"kubernetes.io/projected/e9923942-bfbc-4a3c-82b0-20d1513f4f93-kube-api-access-tzpd8\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-etc-selinux\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-host\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/744993f6-9a37-41ff-bbd0-3b617cc71bd1-cni-binary-copy\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-log-socket\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-env-overrides\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9923942-bfbc-4a3c-82b0-20d1513f4f93-serviceca\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.045860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a735d0c1-4141-4836-b532-1589d973eee1-agent-certs\") pod \"konnectivity-agent-pthnf\" (UID: \"a735d0c1-4141-4836-b532-1589d973eee1\") " pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-conf-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5776c\" (UniqueName: \"kubernetes.io/projected/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-kube-api-access-5776c\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djvbl\" (UniqueName: \"kubernetes.io/projected/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-kube-api-access-djvbl\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-etc-kubernetes\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-kubernetes\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-lib-modules\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9923942-bfbc-4a3c-82b0-20d1513f4f93-host\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-cnibin\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovnkube-script-lib\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-kubernetes\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f792d08d-7534-4a5b-bebf-af847eff1efb-iptables-alerter-script\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-cni-bin\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045660    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-lib-modules\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cni-binary-copy\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf2x8\" (UniqueName: \"kubernetes.io/projected/fc346e1d-61bf-4f69-bfbc-cdec43de8993-kube-api-access-hf2x8\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.046575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovnkube-config\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovn-node-metrics-cert\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-multus-certs\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-tuned\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-k8s-cni-cncf-io\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-systemd\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-modprobe-d\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.045984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85cvn\" (UniqueName: \"kubernetes.io/projected/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-kube-api-access-85cvn\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-modprobe-d\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046021    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-device-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-kubelet\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f792d08d-7534-4a5b-bebf-af847eff1efb-iptables-alerter-script\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-systemd-units\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-cni-netd\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-device-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-socket-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-system-cni-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-run-netns\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-var-lib-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-etc-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-cni-bin\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046321    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-socket-dir\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a735d0c1-4141-4836-b532-1589d973eee1-konnectivity-ca\") pod \"konnectivity-agent-pthnf\" (UID: \"a735d0c1-4141-4836-b532-1589d973eee1\") " pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-kubelet\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-slash\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-daemon-config\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-var-lib-kubelet\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b0c880c-0774-45a5-bc7c-9332c58c0600-dbus\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-var-lib-kubelet\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg4fd\" (UniqueName: \"kubernetes.io/projected/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-kube-api-access-dg4fd\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-os-release\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.047610 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-netns\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.048211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-system-cni-dir\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.048211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-systemd\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.048211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.046898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-systemd\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.048398 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.048379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-tmp\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.048467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.048424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-etc-tuned\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.052466 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.052446    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:00:38.052466 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.052466    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:00:38.052645 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.052476    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:38.052645 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.052530    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:38.552513833 +0000 UTC m=+2.987301607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:38.055167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.055137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djvbl\" (UniqueName: \"kubernetes.io/projected/ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8-kube-api-access-djvbl\") pod \"tuned-g5574\" (UID: \"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8\") " pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.055167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.055150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llljl\" (UniqueName: \"kubernetes.io/projected/07d4448c-bc8f-42b7-b74b-46d5b43d7f96-kube-api-access-llljl\") pod \"aws-ebs-csi-driver-node-b5wxw\" (UID: \"07d4448c-bc8f-42b7-b74b-46d5b43d7f96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.056133 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.056112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85cvn\" (UniqueName: \"kubernetes.io/projected/3a04a2cf-0be8-43a0-86a5-8943d0d692c4-kube-api-access-85cvn\") pod \"node-resolver-ktv79\" (UID: \"3a04a2cf-0be8-43a0-86a5-8943d0d692c4\") " pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.056339 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.056322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52cj4\" (UniqueName: \"kubernetes.io/projected/f792d08d-7534-4a5b-bebf-af847eff1efb-kube-api-access-52cj4\") pod \"iptables-alerter-gr8hz\" (UID: \"f792d08d-7534-4a5b-bebf-af847eff1efb\") " pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.147585 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-cni-multus\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.147585 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-ovn\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-cni-multus\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-socket-dir-parent\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147701    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-ovn\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-node-log\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b0c880c-0774-45a5-bc7c-9332c58c0600-kubelet-config\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147745    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-socket-dir-parent\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.147795    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:38.147822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cnibin\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-node-log\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b0c880c-0774-45a5-bc7c-9332c58c0600-kubelet-config\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cnibin\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.147903    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:38.647859627 +0000 UTC m=+3.082647432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.147979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzpd8\" (UniqueName: \"kubernetes.io/projected/e9923942-bfbc-4a3c-82b0-20d1513f4f93-kube-api-access-tzpd8\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/744993f6-9a37-41ff-bbd0-3b617cc71bd1-cni-binary-copy\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-log-socket\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-env-overrides\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9923942-bfbc-4a3c-82b0-20d1513f4f93-serviceca\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a735d0c1-4141-4836-b532-1589d973eee1-agent-certs\") pod \"konnectivity-agent-pthnf\" (UID: \"a735d0c1-4141-4836-b532-1589d973eee1\") " pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148175    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-log-socket\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-conf-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5776c\" (UniqueName: \"kubernetes.io/projected/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-kube-api-access-5776c\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-conf-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-etc-kubernetes\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9923942-bfbc-4a3c-82b0-20d1513f4f93-host\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-cnibin\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovnkube-script-lib\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-cni-bin\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cni-binary-copy\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf2x8\" (UniqueName: \"kubernetes.io/projected/fc346e1d-61bf-4f69-bfbc-cdec43de8993-kube-api-access-hf2x8\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovnkube-config\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovn-node-metrics-cert\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-multus-certs\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148640    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9923942-bfbc-4a3c-82b0-20d1513f4f93-serviceca\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148639    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-etc-kubernetes\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.148949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-k8s-cni-cncf-io\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-k8s-cni-cncf-io\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9923942-bfbc-4a3c-82b0-20d1513f4f93-host\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148733    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-env-overrides\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/744993f6-9a37-41ff-bbd0-3b617cc71bd1-cni-binary-copy\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-cnibin\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-systemd\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-cni-bin\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-run-systemd\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148846    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-multus-certs\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-kubelet\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-systemd-units\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.148983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-cni-netd\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-system-cni-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-run-netns\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-var-lib-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.149857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-etc-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-cni-bin\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a735d0c1-4141-4836-b532-1589d973eee1-konnectivity-ca\") pod \"konnectivity-agent-pthnf\" (UID: \"a735d0c1-4141-4836-b532-1589d973eee1\") " pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-kubelet\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-slash\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-daemon-config\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149234    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovnkube-config\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b0c880c-0774-45a5-bc7c-9332c58c0600-dbus\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg4fd\" (UniqueName: \"kubernetes.io/projected/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-kube-api-access-dg4fd\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-os-release\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovnkube-script-lib\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-var-lib-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-netns\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-system-cni-dir\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-cni-netd\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-cni-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-kubelet\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-systemd-units\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.150633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-hostroot\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-hostroot\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ctr\" (UniqueName: \"kubernetes.io/projected/744993f6-9a37-41ff-bbd0-3b617cc71bd1-kube-api-access-z5ctr\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-system-cni-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-os-release\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-run-netns\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cni-binary-copy\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc346e1d-61bf-4f69-bfbc-cdec43de8993-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.149635    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.149706    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:38.649688565 +0000 UTC m=+3.084476355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149714    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-run-netns\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b0c880c-0774-45a5-bc7c-9332c58c0600-dbus\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-system-cni-dir\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149800    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-slash\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-cni-dir\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-host-var-lib-kubelet\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149877    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc346e1d-61bf-4f69-bfbc-cdec43de8993-os-release\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.149887    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-etc-openvswitch\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.150039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-host-cni-bin\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.150050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/744993f6-9a37-41ff-bbd0-3b617cc71bd1-os-release\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.150271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a735d0c1-4141-4836-b532-1589d973eee1-konnectivity-ca\") pod \"konnectivity-agent-pthnf\" (UID: \"a735d0c1-4141-4836-b532-1589d973eee1\") " pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.150368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/744993f6-9a37-41ff-bbd0-3b617cc71bd1-multus-daemon-config\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.151336    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a735d0c1-4141-4836-b532-1589d973eee1-agent-certs\") pod \"konnectivity-agent-pthnf\" (UID: \"a735d0c1-4141-4836-b532-1589d973eee1\") " pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.151873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.151485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-ovn-node-metrics-cert\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.162711 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.162664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ctr\" (UniqueName: \"kubernetes.io/projected/744993f6-9a37-41ff-bbd0-3b617cc71bd1-kube-api-access-z5ctr\") pod \"multus-rlxv7\" (UID: \"744993f6-9a37-41ff-bbd0-3b617cc71bd1\") " pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.162969 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.162946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf2x8\" (UniqueName: \"kubernetes.io/projected/fc346e1d-61bf-4f69-bfbc-cdec43de8993-kube-api-access-hf2x8\") pod \"multus-additional-cni-plugins-jq75n\" (UID: \"fc346e1d-61bf-4f69-bfbc-cdec43de8993\") " pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.163046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.162967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5776c\" (UniqueName: \"kubernetes.io/projected/6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4-kube-api-access-5776c\") pod \"ovnkube-node-5wf7j\" (UID: \"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.163561 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.163544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg4fd\" (UniqueName: \"kubernetes.io/projected/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-kube-api-access-dg4fd\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:38.163623 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.163598    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzpd8\" (UniqueName: \"kubernetes.io/projected/e9923942-bfbc-4a3c-82b0-20d1513f4f93-kube-api-access-tzpd8\") pod \"node-ca-z9d8d\" (UID: \"e9923942-bfbc-4a3c-82b0-20d1513f4f93\") " pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.238151 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.238075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g5574"
Jul 21 15:00:38.244280 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.244187    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ktv79"
Jul 21 15:00:38.248554 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.248529    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9a43fc_dac3_4823_a1ee_2c7961c9a7c8.slice/crio-d3fd50259d4fd69415e38eefa7d6445069dbd501c952a9e4047ce02461cd199a WatchSource:0}: Error finding container d3fd50259d4fd69415e38eefa7d6445069dbd501c952a9e4047ce02461cd199a: Status 404 returned error can't find the container with id d3fd50259d4fd69415e38eefa7d6445069dbd501c952a9e4047ce02461cd199a
Jul 21 15:00:38.252870 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.252851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gr8hz"
Jul 21 15:00:38.254043 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.254023    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a04a2cf_0be8_43a0_86a5_8943d0d692c4.slice/crio-56a34d9f399ddc66af82c67bfecb53349a0c71e469216a6f1bf758c56b5c6158 WatchSource:0}: Error finding container 56a34d9f399ddc66af82c67bfecb53349a0c71e469216a6f1bf758c56b5c6158: Status 404 returned error can't find the container with id 56a34d9f399ddc66af82c67bfecb53349a0c71e469216a6f1bf758c56b5c6158
Jul 21 15:00:38.257329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.257310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw"
Jul 21 15:00:38.263392 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.263376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rlxv7"
Jul 21 15:00:38.267201 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.267176    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d4448c_bc8f_42b7_b74b_46d5b43d7f96.slice/crio-ea955d7e9b340a7f5e91ae59add8987401b8f0b627d504834e6a8ec10ceb7a0d WatchSource:0}: Error finding container ea955d7e9b340a7f5e91ae59add8987401b8f0b627d504834e6a8ec10ceb7a0d: Status 404 returned error can't find the container with id ea955d7e9b340a7f5e91ae59add8987401b8f0b627d504834e6a8ec10ceb7a0d
Jul 21 15:00:38.270988 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.270967    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744993f6_9a37_41ff_bbd0_3b617cc71bd1.slice/crio-c1bc7e87f822999ee8d11b2004dd29b4cf034a973373a3974279ff6588531b27 WatchSource:0}: Error finding container c1bc7e87f822999ee8d11b2004dd29b4cf034a973373a3974279ff6588531b27: Status 404 returned error can't find the container with id c1bc7e87f822999ee8d11b2004dd29b4cf034a973373a3974279ff6588531b27
Jul 21 15:00:38.272660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.272637    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jq75n"
Jul 21 15:00:38.279095 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.279068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:00:38.280178 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.280159    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc346e1d_61bf_4f69_bfbc_cdec43de8993.slice/crio-cdb85d05459fc977ffe17fca90f2df1402c40893481afca64ab66e3746812ee8 WatchSource:0}: Error finding container cdb85d05459fc977ffe17fca90f2df1402c40893481afca64ab66e3746812ee8: Status 404 returned error can't find the container with id cdb85d05459fc977ffe17fca90f2df1402c40893481afca64ab66e3746812ee8
Jul 21 15:00:38.284929 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.284909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z9d8d"
Jul 21 15:00:38.286897 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.286876    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aec8cd7_2ed7_4ba5_93a5_4889be3eb2c4.slice/crio-27857f08cdaebcef0a4fa282c9aeb5aca172bfbac1ffc4fe5f786df7d3433b25 WatchSource:0}: Error finding container 27857f08cdaebcef0a4fa282c9aeb5aca172bfbac1ffc4fe5f786df7d3433b25: Status 404 returned error can't find the container with id 27857f08cdaebcef0a4fa282c9aeb5aca172bfbac1ffc4fe5f786df7d3433b25
Jul 21 15:00:38.288123 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.288097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:00:38.293369 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.293346    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9923942_bfbc_4a3c_82b0_20d1513f4f93.slice/crio-49483e9aa8a93d13c3b80b9564fbe507be5d85ab6a3cd4bde95282d90c7a7791 WatchSource:0}: Error finding container 49483e9aa8a93d13c3b80b9564fbe507be5d85ab6a3cd4bde95282d90c7a7791: Status 404 returned error can't find the container with id 49483e9aa8a93d13c3b80b9564fbe507be5d85ab6a3cd4bde95282d90c7a7791
Jul 21 15:00:38.296529 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:00:38.296496    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda735d0c1_4141_4836_b532_1589d973eee1.slice/crio-712af33b80f386f9b49d09ced17b6266fdf017ad7238b5696230126b8fefcbd1 WatchSource:0}: Error finding container 712af33b80f386f9b49d09ced17b6266fdf017ad7238b5696230126b8fefcbd1: Status 404 returned error can't find the container with id 712af33b80f386f9b49d09ced17b6266fdf017ad7238b5696230126b8fefcbd1
Jul 21 15:00:38.347953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.347933    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 15:00:38.653224 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.653158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:38.653224 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.653219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:38.653258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653335    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653372    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653388    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653390    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653397    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653402    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:39.653385648 +0000 UTC m=+4.088173424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653453    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:39.653441821 +0000 UTC m=+4.088229596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:38.653469 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:38.653465    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:39.653458799 +0000 UTC m=+4.088246573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:39.032495 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.032423    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:55:38 +0000 UTC" deadline="2028-04-02 06:18:13.495574958 +0000 UTC"
Jul 21 15:00:39.032495 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.032495    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14895h17m34.463085089s"
Jul 21 15:00:39.047792 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.047755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rlxv7" event={"ID":"744993f6-9a37-41ff-bbd0-3b617cc71bd1","Type":"ContainerStarted","Data":"c1bc7e87f822999ee8d11b2004dd29b4cf034a973373a3974279ff6588531b27"}
Jul 21 15:00:39.057177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.057139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw" event={"ID":"07d4448c-bc8f-42b7-b74b-46d5b43d7f96","Type":"ContainerStarted","Data":"ea955d7e9b340a7f5e91ae59add8987401b8f0b627d504834e6a8ec10ceb7a0d"}
Jul 21 15:00:39.061586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.061551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5574" event={"ID":"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8","Type":"ContainerStarted","Data":"d3fd50259d4fd69415e38eefa7d6445069dbd501c952a9e4047ce02461cd199a"}
Jul 21 15:00:39.065018 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.064986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pthnf" event={"ID":"a735d0c1-4141-4836-b532-1589d973eee1","Type":"ContainerStarted","Data":"712af33b80f386f9b49d09ced17b6266fdf017ad7238b5696230126b8fefcbd1"}
Jul 21 15:00:39.068017 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.067985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"27857f08cdaebcef0a4fa282c9aeb5aca172bfbac1ffc4fe5f786df7d3433b25"}
Jul 21 15:00:39.071080 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.071034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gr8hz" event={"ID":"f792d08d-7534-4a5b-bebf-af847eff1efb","Type":"ContainerStarted","Data":"9eec15d650cf4c104e2848a500ed9e1531f54ad48591f61e658e786592ea7cf4"}
Jul 21 15:00:39.076897 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.076842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ktv79" event={"ID":"3a04a2cf-0be8-43a0-86a5-8943d0d692c4","Type":"ContainerStarted","Data":"56a34d9f399ddc66af82c67bfecb53349a0c71e469216a6f1bf758c56b5c6158"}
Jul 21 15:00:39.080309 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.080280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z9d8d" event={"ID":"e9923942-bfbc-4a3c-82b0-20d1513f4f93","Type":"ContainerStarted","Data":"49483e9aa8a93d13c3b80b9564fbe507be5d85ab6a3cd4bde95282d90c7a7791"}
Jul 21 15:00:39.083563 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.083534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerStarted","Data":"cdb85d05459fc977ffe17fca90f2df1402c40893481afca64ab66e3746812ee8"}
Jul 21 15:00:39.662430 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.662382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:39.662639 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.662444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:39.662639 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:39.662485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:39.662792 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.662667    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:00:39.662792 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.662688    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:00:39.662792 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.662703    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:39.662792 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.662766    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:41.662746023 +0000 UTC m=+6.097533802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:39.663229 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.663207    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:39.663309 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.663267    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:41.663250739 +0000 UTC m=+6.098038522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:39.663369 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.663327    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:39.663369 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:39.663361    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:41.6633493 +0000 UTC m=+6.098137077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:40.033765 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:40.033667    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:55:38 +0000 UTC" deadline="2028-02-23 11:42:51.274579301 +0000 UTC"
Jul 21 15:00:40.033765 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:40.033730    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13964h42m11.240852787s"
Jul 21 15:00:40.039734 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:40.039600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:40.039903 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:40.039795    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:40.039903 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:40.039806    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:40.040079 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:40.039903    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:40.040079 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:40.039989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:40.040188 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:40.040084    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:41.680837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:41.681174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:41.681230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.681500    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.681528    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.681543    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.681607    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:45.681585958 +0000 UTC m=+10.116373739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.682011    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.682066    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:45.682049156 +0000 UTC m=+10.116836934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.682143    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:41.682241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:41.682177    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:45.682165964 +0000 UTC m=+10.116953743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:42.039290 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:42.039252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:42.039500 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:42.039401    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:42.039853 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:42.039831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:42.039966 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:42.039925    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:42.040049 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:42.039979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:42.040104 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:42.040075    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:42.105375 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:42.104581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"d26b371a22af354442f70c9ec094aa91","Type":"ContainerStarted","Data":"b37662ad2413859695e04358dc4bf80ffc630f6c9f8e3b62e78be4b37232df25"}
Jul 21 15:00:44.036862 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:44.036770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:44.037342 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:44.036923    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:44.037342 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:44.037235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:44.037432 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:44.037333    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:44.037432 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:44.037386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:44.037532 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:44.037492    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:44.114368 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:44.114324    2562 generic.go:356] "Generic (PLEG): container finished" podID="d26b371a22af354442f70c9ec094aa91" containerID="b37662ad2413859695e04358dc4bf80ffc630f6c9f8e3b62e78be4b37232df25" exitCode=0
Jul 21 15:00:44.114580 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:44.114388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"d26b371a22af354442f70c9ec094aa91","Type":"ContainerDied","Data":"b37662ad2413859695e04358dc4bf80ffc630f6c9f8e3b62e78be4b37232df25"}
Jul 21 15:00:45.723304 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:45.723261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:45.723350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:45.723385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723474    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723503    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723518    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723555    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723579    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:53.72356004 +0000 UTC m=+18.158347826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723628    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:00:53.723592585 +0000 UTC m=+18.158380379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723504    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:45.723858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:45.723664    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:00:53.72365454 +0000 UTC m=+18.158442320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:46.038247 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:46.038211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:46.038433 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:46.038295    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:46.039804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:46.039372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:46.039804 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:46.039519    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:46.039804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:46.039623    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:46.039804 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:46.039764    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:48.037492 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:48.037458    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:48.037492 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:48.037485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:48.038026 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:48.037594    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:48.038026 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:48.038016    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:48.038137 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:48.038074    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:48.038186 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:48.038146    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:50.036772 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:50.036725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:50.036772 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:50.036776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:50.037487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:50.036740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:50.037487 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:50.036879    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:50.037487 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:50.036959    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:50.037487 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:50.037036    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:52.036871 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:52.036839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:52.037292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:52.036839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:52.037292 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:52.036970    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:52.037292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:52.036840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:52.037292 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:52.037025    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:52.037292 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:52.037126    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:53.783676 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:53.783636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:53.783685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:53.783723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783823    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783846    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783848    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783871    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783884    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783905    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:09.783884002 +0000 UTC m=+34.218671786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783923    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:09.783912899 +0000 UTC m=+34.218700675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:00:53.784182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:53.783945    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:09.783936196 +0000 UTC m=+34.218723980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:00:54.040263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:54.040191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:54.040263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:54.040238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:54.040263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:54.040250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:54.040504 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:54.040344    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:54.040504 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:54.040405    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:54.040504 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:54.040459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:56.040103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:56.040069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:56.040634 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:56.040174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:56.040634 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:56.040181    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:56.040634 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:56.040206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:56.040634 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:56.040294    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:00:56.040634 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:56.040398    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:58.040478 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:58.040452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:00:58.041040 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:58.040564    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:00:58.041040 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:58.040576    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:00:58.041040 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:58.040680    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:00:58.041040 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:00:58.040722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:00:58.041040 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:00:58.040809    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:00.040018 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.039703    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:00.040747 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.039741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:00.040747 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:00.040103    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:00.040747 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.039753    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:00.040747 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:00.040168    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:00.040747 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:00.040235    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:00.147083 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.147047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ktv79" event={"ID":"3a04a2cf-0be8-43a0-86a5-8943d0d692c4","Type":"ContainerStarted","Data":"09759875963b87086c070aeaff85a104c2ed7bdc518b6a66bc0e73954335de92"}
Jul 21 15:01:00.150406 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.150357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"d26b371a22af354442f70c9ec094aa91","Type":"ContainerStarted","Data":"077389818b07ab1fab5095d737d9cf301cc3b8d31f4fc2d91c70084986540e3e"}
Jul 21 15:01:00.152396 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.152366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z9d8d" event={"ID":"e9923942-bfbc-4a3c-82b0-20d1513f4f93","Type":"ContainerStarted","Data":"30a44a6c9cbe25041751a2aab6fdbef10c527100b4375b501e7c59074393b92c"}
Jul 21 15:01:00.153888 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.153863    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc346e1d-61bf-4f69-bfbc-cdec43de8993" containerID="831db1eaefff25fd43b3661f7e720f044b34d03855e803ce04abd6b8bfea55d7" exitCode=0
Jul 21 15:01:00.153991 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.153945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerDied","Data":"831db1eaefff25fd43b3661f7e720f044b34d03855e803ce04abd6b8bfea55d7"}
Jul 21 15:01:00.155444 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.155423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rlxv7" event={"ID":"744993f6-9a37-41ff-bbd0-3b617cc71bd1","Type":"ContainerStarted","Data":"1ab01d0152d1d03963a6376b1fe0c0fbcce460d687664dd78bfc143c5e5ec92f"}
Jul 21 15:01:00.156900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.156878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw" event={"ID":"07d4448c-bc8f-42b7-b74b-46d5b43d7f96","Type":"ContainerStarted","Data":"21d8506810e23c23dbb1a35a93205ff2d97406e313a8c6cc9ddebbac1b29cbfd"}
Jul 21 15:01:00.158364 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.158338    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g5574" event={"ID":"ce9a43fc-dac3-4823-a1ee-2c7961c9a7c8","Type":"ContainerStarted","Data":"c74ef7973d6fb1a51fa3453cdba88fca2f4d8dc8a961e5096480b75ee697a6b4"}
Jul 21 15:01:00.159687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.159667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" event={"ID":"2b3614c0559335b078ab25aae1c59cdc","Type":"ContainerStarted","Data":"f541c3cfa71af4381a0112a903cc614e2a9920ae2a2d2fd964ab2f4928819c57"}
Jul 21 15:01:00.160981 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.160962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pthnf" event={"ID":"a735d0c1-4141-4836-b532-1589d973eee1","Type":"ContainerStarted","Data":"db8e35e0a0e0da5aa57aa52fa5fd9e32c2a32de0dd6a26a67d56e57f03edf442"}
Jul 21 15:01:00.163727 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.163710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"26cd4d029b501035262c4cf82a8109a38c948cdf48b7e8c360f788a4f9ccd336"}
Jul 21 15:01:00.163818 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.163757    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"aae606e487a34e2088934bd9ebd32f40bd41f9ffc354b7be887247209d6e518f"}
Jul 21 15:01:00.163818 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.163785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"52bdf598e8bfacb95326c2a4a4e4d123ac7b5f62d7e2ae864760432ebe9319c7"}
Jul 21 15:01:00.163818 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.163812    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"e2542c4d8a1eddc2d59828501dcd5573d7b1e8bf303a466bdd5178076e83beeb"}
Jul 21 15:01:00.163931 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.163840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"b367448562c143352728c8a35ced2bca3cd934933e11400ef8e4cd72386c72b4"}
Jul 21 15:01:00.163931 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.163868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"6ab68e274430c7de8bdc088875c01ef20c4c4c0433c60683dcc221b5cd647b90"}
Jul 21 15:01:00.167466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.167431    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ktv79" podStartSLOduration=7.625570483 podStartE2EDuration="24.167419903s" totalImagesPullingTime="16.54184942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.16723038 +0000 UTC m=+24.602018175" watchObservedRunningTime="2026-07-21 15:01:00.167419903 +0000 UTC m=+24.602207696"
Jul 21 15:01:00.189380 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.189298    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" podStartSLOduration=22.189285798 podStartE2EDuration="22.189285798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.189191939 +0000 UTC m=+24.623979732" watchObservedRunningTime="2026-07-21 15:01:00.189285798 +0000 UTC m=+24.624073591"
Jul 21 15:01:00.210803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.210757    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g5574" podStartSLOduration=3.313965766 podStartE2EDuration="24.210747564s" totalImagesPullingTime="20.896781798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.210429187 +0000 UTC m=+24.645216981" watchObservedRunningTime="2026-07-21 15:01:00.210747564 +0000 UTC m=+24.645535358"
Jul 21 15:01:00.230737 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.230698    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rlxv7" podStartSLOduration=3.302104264 podStartE2EDuration="24.230685477s" totalImagesPullingTime="20.928581213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.229756338 +0000 UTC m=+24.664544132" watchObservedRunningTime="2026-07-21 15:01:00.230685477 +0000 UTC m=+24.665473270"
Jul 21 15:01:00.296265 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.296214    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" podStartSLOduration=22.296198376 podStartE2EDuration="22.296198376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.296046854 +0000 UTC m=+24.730834648" watchObservedRunningTime="2026-07-21 15:01:00.296198376 +0000 UTC m=+24.730986169"
Jul 21 15:01:00.315910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.315867    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z9d8d" podStartSLOduration=6.813507089 podStartE2EDuration="23.315852385s" totalImagesPullingTime="16.502345296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.315521603 +0000 UTC m=+24.750309399" watchObservedRunningTime="2026-07-21 15:01:00.315852385 +0000 UTC m=+24.750640178"
Jul 21 15:01:00.337011 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:00.336944    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pthnf" podStartSLOduration=2.511168251 podStartE2EDuration="23.336929567s" totalImagesPullingTime="20.825761316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:00.336510185 +0000 UTC m=+24.771297979" watchObservedRunningTime="2026-07-21 15:01:00.336929567 +0000 UTC m=+24.771717428"
Jul 21 15:01:01.168018 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:01.167977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gr8hz" event={"ID":"f792d08d-7534-4a5b-bebf-af847eff1efb","Type":"ContainerStarted","Data":"0b23078d901518a144c2913cf0f9ef3210efc13d292167ad5590d4f6813c2d81"}
Jul 21 15:01:01.187230 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:01.187170    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gr8hz" podStartSLOduration=4.313755727 podStartE2EDuration="25.187148076s" totalImagesPullingTime="20.873392349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:01.186821812 +0000 UTC m=+25.621609607" watchObservedRunningTime="2026-07-21 15:01:01.187148076 +0000 UTC m=+25.621935874"
Jul 21 15:01:01.990159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:01.989795    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 15:01:01.998369 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:01.998258    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T15:01:01.989820541Z","UUID":"3d53f52f-0660-4c88-b3fa-0601be314df5","Handler":null,"Name":"","Endpoint":""}
Jul 21 15:01:01.999687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:01.999665    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 15:01:01.999795 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:01.999718    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 15:01:02.041426 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.041398    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:02.041597 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:02.041492    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:02.041750 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.041716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:02.041818 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:02.041792    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:02.041861 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.041850    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:02.041908 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:02.041894    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:02.173770 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.173678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"8e82456c876b5d243008273eef57bf7e375e546777c4556c33da3a25ed67fe30"}
Jul 21 15:01:02.175800 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.175764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw" event={"ID":"07d4448c-bc8f-42b7-b74b-46d5b43d7f96","Type":"ContainerStarted","Data":"4980475271ddc4f3c49e077518a22a6792ce86aa6d8adbe58b0f3ff6010255b0"}
Jul 21 15:01:02.503393 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.503302    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:01:02.504094 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:02.504067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:01:03.178101 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:03.178073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:01:03.178559 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:03.178539    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pthnf"
Jul 21 15:01:04.041069 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:04.040862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:04.041241 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:04.040925    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:04.041241 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:04.041162    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:04.041356 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:04.041249    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:04.041356 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:04.040934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:04.041466 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:04.041441    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:05.184207 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:05.184170    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc346e1d-61bf-4f69-bfbc-cdec43de8993" containerID="29c91b95c4d33cd37aeab5a6b7d291008c0afdbdb3ecb8af8099e8e5216ad64b" exitCode=0
Jul 21 15:01:05.185033 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:05.184262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerDied","Data":"29c91b95c4d33cd37aeab5a6b7d291008c0afdbdb3ecb8af8099e8e5216ad64b"}
Jul 21 15:01:05.186419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:05.186395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw" event={"ID":"07d4448c-bc8f-42b7-b74b-46d5b43d7f96","Type":"ContainerStarted","Data":"b49b908037485e9b5705a1a776e2d6aa2dc488a106e1e614a12b60120ef1b194"}
Jul 21 15:01:05.189998 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:05.189974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" event={"ID":"6aec8cd7-2ed7-4ba5-93a5-4889be3eb2c4","Type":"ContainerStarted","Data":"79170189d5ade877cb6b7878c90823129b4ea5a4b6aab3c2c967e097d5c8bdd9"}
Jul 21 15:01:05.228067 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:05.228015    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b5wxw" podStartSLOduration=3.359725873 podStartE2EDuration="29.227996627s" totalImagesPullingTime="25.868270754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:05.227373514 +0000 UTC m=+29.662161307" watchObservedRunningTime="2026-07-21 15:01:05.227996627 +0000 UTC m=+29.662784420"
Jul 21 15:01:05.260086 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:05.260036    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j" podStartSLOduration=7.346401383 podStartE2EDuration="28.26002111s" totalImagesPullingTime="20.913619727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:05.259761508 +0000 UTC m=+29.694549302" watchObservedRunningTime="2026-07-21 15:01:05.26002111 +0000 UTC m=+29.694808903"
Jul 21 15:01:06.040535 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.039755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:06.040535 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:06.040099    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:06.040842 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.040707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:06.040842 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.040774    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:06.041276 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:06.041247    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:06.041276 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:06.041255    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:06.192462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.192435    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 15:01:06.192978 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.192958    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:01:06.193059 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.193030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:01:06.209060 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.209038    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:01:06.209255 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.209240    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:01:06.547892 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.547861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s667c"]
Jul 21 15:01:06.548051 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.547994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:06.548110 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:06.548092    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:06.555245 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.555217    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2dggs"]
Jul 21 15:01:06.555390 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.555293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:06.555390 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:06.555373    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:06.571646 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.571623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krjpq"]
Jul 21 15:01:06.571779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.571716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:06.571834 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:06.571808    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:06.991032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:06.990944    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:01:08.037320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:08.037282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:08.037804 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:08.037408    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:08.037804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:08.037462    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:08.037804 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:08.037599    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:09.036836 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:09.036804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:09.037004 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.036926    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:09.200765 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:09.200732    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc346e1d-61bf-4f69-bfbc-cdec43de8993" containerID="ee1216b4cc3d04e38acab48094169890b7946948a69cc7ddef6956db17bdc1b1" exitCode=0
Jul 21 15:01:09.201294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:09.200785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerDied","Data":"ee1216b4cc3d04e38acab48094169890b7946948a69cc7ddef6956db17bdc1b1"}
Jul 21 15:01:09.801083 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:09.801023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:09.801083 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:09.801057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:09.801083 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:09.801091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801195    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801203    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801232    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801245    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ltctx for pod openshift-network-diagnostics/network-check-target-krjpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801256    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret podName:1b0c880c-0774-45a5-bc7c-9332c58c0600 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:41.801241684 +0000 UTC m=+66.236029458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret") pod "global-pull-secret-syncer-2dggs" (UID: "1b0c880c-0774-45a5-bc7c-9332c58c0600") : object "kube-system"/"original-pull-secret" not registered
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801293    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx podName:6aae62db-e083-4030-8044-cc446ee70724 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:41.801277176 +0000 UTC m=+66.236064962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltctx" (UniqueName: "kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx") pod "network-check-target-krjpq" (UID: "6aae62db-e083-4030-8044-cc446ee70724") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801195    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:01:09.801388 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:09.801352    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:41.801336096 +0000 UTC m=+66.236123883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 15:01:10.036671 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:10.036648    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:10.036798 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:10.036777    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dggs" podUID="1b0c880c-0774-45a5-bc7c-9332c58c0600"
Jul 21 15:01:10.036875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:10.036815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:10.036931 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:10.036908    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s667c" podUID="2d7accd1-9694-42ef-8fc8-3cc621bb0d0c"
Jul 21 15:01:10.205451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:10.205264    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc346e1d-61bf-4f69-bfbc-cdec43de8993" containerID="2804c5b511fb92d5536429c6e18465057b6098ffdce447b0dd931deda9bc5439" exitCode=0
Jul 21 15:01:10.205824 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:10.205343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerDied","Data":"2804c5b511fb92d5536429c6e18465057b6098ffdce447b0dd931deda9bc5439"}
Jul 21 15:01:11.037235 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.037207    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:11.037380 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:11.037324    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krjpq" podUID="6aae62db-e083-4030-8044-cc446ee70724"
Jul 21 15:01:11.897553 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.897520    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeReady"
Jul 21 15:01:11.897945 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.897703    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 15:01:11.934857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.934775    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c48d5b94-wk569"]
Jul 21 15:01:11.936450 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.936432    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:11.938956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.938929    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 15:01:11.939056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.939029    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tbkbj\""
Jul 21 15:01:11.939429 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.939411    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 15:01:11.939544 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.939412    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 15:01:11.945052 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.944530    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 15:01:11.952243 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.952224    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-54czh"]
Jul 21 15:01:11.956070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.956048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c48d5b94-wk569"]
Jul 21 15:01:11.956162 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.956091    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7qztt"]
Jul 21 15:01:11.956162 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.956141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:11.957973 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.957954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:11.958702 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.958676    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 15:01:11.958808 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.958741    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sj9xq\""
Jul 21 15:01:11.958868 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.958823    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 15:01:11.960325 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.960309    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9pl9l\""
Jul 21 15:01:11.960680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.960660    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 15:01:11.960680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.960677    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 15:01:11.960798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.960685    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 15:01:11.966495 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.966365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-54czh"]
Jul 21 15:01:11.967074 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:11.967054    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7qztt"]
Jul 21 15:01:12.016705 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-image-registry-private-configuration\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.016871 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bdd812-5e6f-46ac-b270-6d12f7078d50-ca-trust-extracted\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.016871 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-installation-pull-secrets\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.016871 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nmp7\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-kube-api-access-9nmp7\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.017032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.017032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-certificates\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.017032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-trusted-ca\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.017032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.016983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-bound-sa-token\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.036711 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.036677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:12.036711 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.036704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:12.040120 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.040090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 15:01:12.040410 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.040394    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d8gzv\""
Jul 21 15:01:12.040577 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.040562    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 15:01:12.117377 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-image-registry-private-configuration\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6249d0f-e876-45b8-853e-fe28e39497df-tmp-dir\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.117534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bdd812-5e6f-46ac-b270-6d12f7078d50-ca-trust-extracted\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-installation-pull-secrets\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nmp7\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-kube-api-access-9nmp7\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-certificates\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-trusted-ca\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-bound-sa-token\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.117914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6249d0f-e876-45b8-853e-fe28e39497df-config-volume\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.117914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c56438d3-aab0-41cd-8a78-38873380840a-cert\") pod \"ingress-canary-7qztt\" (UID: \"c56438d3-aab0-41cd-8a78-38873380840a\") " pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.117914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.117844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dj8b\" (UniqueName: \"kubernetes.io/projected/b6249d0f-e876-45b8-853e-fe28e39497df-kube-api-access-7dj8b\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.118155 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.118000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bdd812-5e6f-46ac-b270-6d12f7078d50-ca-trust-extracted\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.118155 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.118034    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:12.118155 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.118050    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:12.118155 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.118106    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:12.618087376 +0000 UTC m=+37.052875153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:12.118350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.118174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.118350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.118297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hx5\" (UniqueName: \"kubernetes.io/projected/c56438d3-aab0-41cd-8a78-38873380840a-kube-api-access-z5hx5\") pod \"ingress-canary-7qztt\" (UID: \"c56438d3-aab0-41cd-8a78-38873380840a\") " pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.118676 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.118654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-certificates\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.118897 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.118874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-trusted-ca\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.123303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.123283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-installation-pull-secrets\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.125009 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.124965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:12.127817 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.127797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-bound-sa-token\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.129156 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.129135    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nmp7\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-kube-api-access-9nmp7\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.130045 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.130020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-image-registry-private-configuration\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.219343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6249d0f-e876-45b8-853e-fe28e39497df-config-volume\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.219343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c56438d3-aab0-41cd-8a78-38873380840a-cert\") pod \"ingress-canary-7qztt\" (UID: \"c56438d3-aab0-41cd-8a78-38873380840a\") " pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.219343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dj8b\" (UniqueName: \"kubernetes.io/projected/b6249d0f-e876-45b8-853e-fe28e39497df-kube-api-access-7dj8b\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.219343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.220129 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.219744    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:12.220129 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hx5\" (UniqueName: \"kubernetes.io/projected/c56438d3-aab0-41cd-8a78-38873380840a-kube-api-access-z5hx5\") pod \"ingress-canary-7qztt\" (UID: \"c56438d3-aab0-41cd-8a78-38873380840a\") " pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.220129 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.219815    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:01:12.719799807 +0000 UTC m=+37.154587581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:12.220129 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6249d0f-e876-45b8-853e-fe28e39497df-tmp-dir\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.220129 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.219879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6249d0f-e876-45b8-853e-fe28e39497df-config-volume\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.220129 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.220094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6249d0f-e876-45b8-853e-fe28e39497df-tmp-dir\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.222699 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.222578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c56438d3-aab0-41cd-8a78-38873380840a-cert\") pod \"ingress-canary-7qztt\" (UID: \"c56438d3-aab0-41cd-8a78-38873380840a\") " pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.228571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.228547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dj8b\" (UniqueName: \"kubernetes.io/projected/b6249d0f-e876-45b8-853e-fe28e39497df-kube-api-access-7dj8b\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.228802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.228787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hx5\" (UniqueName: \"kubernetes.io/projected/c56438d3-aab0-41cd-8a78-38873380840a-kube-api-access-z5hx5\") pod \"ingress-canary-7qztt\" (UID: \"c56438d3-aab0-41cd-8a78-38873380840a\") " pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.276063 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.276031    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qztt"
Jul 21 15:01:12.306467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.306431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:12.435597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.435559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7qztt"]
Jul 21 15:01:12.441589 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:12.441561    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56438d3_aab0_41cd_8a78_38873380840a.slice/crio-04b10c83871e2fd1b5945142771fcc596861aa35c0c19c05a03ef435ac2afbbe WatchSource:0}: Error finding container 04b10c83871e2fd1b5945142771fcc596861aa35c0c19c05a03ef435ac2afbbe: Status 404 returned error can't find the container with id 04b10c83871e2fd1b5945142771fcc596861aa35c0c19c05a03ef435ac2afbbe
Jul 21 15:01:12.623249 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.623210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:12.623407 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.623386    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:12.623488 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.623411    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:12.623488 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.623478    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:13.623457774 +0000 UTC m=+38.058245562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:12.723676 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:12.723639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:12.723849 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.723800    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:12.723906 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:12.723871    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:01:13.723848184 +0000 UTC m=+38.158635961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:13.037159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.037127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:13.040414 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.040391    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 15:01:13.041151 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.041135    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 15:01:13.041213 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.041158    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zxdnr\""
Jul 21 15:01:13.214604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.214569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7qztt" event={"ID":"c56438d3-aab0-41cd-8a78-38873380840a","Type":"ContainerStarted","Data":"04b10c83871e2fd1b5945142771fcc596861aa35c0c19c05a03ef435ac2afbbe"}
Jul 21 15:01:13.631298 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.631264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:13.631470 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:13.631390    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:13.631470 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:13.631403    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:13.631470 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:13.631458    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:15.631444249 +0000 UTC m=+40.066232040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:13.732562 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:13.732524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:13.732759 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:13.732709    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:13.732827 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:13.732776    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:01:15.732759937 +0000 UTC m=+40.167547728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:15.222297 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:15.222097    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc346e1d-61bf-4f69-bfbc-cdec43de8993" containerID="0f6f1462316dd3f1c85565d7b6e5f19daebf779502ae1dab078451601eb88c1d" exitCode=0
Jul 21 15:01:15.222740 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:15.222195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerDied","Data":"0f6f1462316dd3f1c85565d7b6e5f19daebf779502ae1dab078451601eb88c1d"}
Jul 21 15:01:15.648445 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:15.648410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:15.648633 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:15.648542    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:15.648633 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:15.648566    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:15.648724 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:15.648648    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.64862619 +0000 UTC m=+44.083413963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:15.749324 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:15.749284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:15.749513 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:15.749425    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:15.749513 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:15.749503    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.749477366 +0000 UTC m=+44.184265141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:16.228459 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:16.228407    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc346e1d-61bf-4f69-bfbc-cdec43de8993" containerID="af47247ddf1924177127f32a9f535eb3c83c7f454b1b0a74f18f7e36f577e49c" exitCode=0
Jul 21 15:01:16.228920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:16.228476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerDied","Data":"af47247ddf1924177127f32a9f535eb3c83c7f454b1b0a74f18f7e36f577e49c"}
Jul 21 15:01:16.321281 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:16.321245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:17.234235 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.234197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jq75n" event={"ID":"fc346e1d-61bf-4f69-bfbc-cdec43de8993","Type":"ContainerStarted","Data":"4983b39945507928cb6b4b2d757702ea6d03ab228bf03592d29d2ad9d1ba711d"}
Jul 21 15:01:17.260377 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.260337    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jq75n" podStartSLOduration=6.644746614 podStartE2EDuration="40.260321219s" totalImagesPullingTime="33.615574605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:17.259811132 +0000 UTC m=+41.694598943" watchObservedRunningTime="2026-07-21 15:01:17.260321219 +0000 UTC m=+41.695109013"
Jul 21 15:01:17.430655 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.430560    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"]
Jul 21 15:01:17.448965 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.448934    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dcbc69fb-d69xs"]
Jul 21 15:01:17.449092 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.449042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.453428 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.453409    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 15:01:17.453428 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.453422    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 21 15:01:17.453592 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.453408    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s5p4j\""
Jul 21 15:01:17.453592 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.453423    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 21 15:01:17.453592 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.453408    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 15:01:17.468855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.468834    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"]
Jul 21 15:01:17.468942 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.468870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dcbc69fb-d69xs"]
Jul 21 15:01:17.468975 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.468951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.471914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.471898    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 15:01:17.471914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.471904    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 15:01:17.472062 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.471930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 15:01:17.472169 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.472153    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 15:01:17.472228 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.472172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2wnfd\""
Jul 21 15:01:17.472228 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.472190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 15:01:17.472228 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.472205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 15:01:17.535989 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.535961    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-s4ttv"]
Jul 21 15:01:17.539259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.539236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:17.554800 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.554782    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-s4ttv"]
Jul 21 15:01:17.554885 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.554861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.557180 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.557163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 21 15:01:17.557506 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.557483    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 21 15:01:17.557573 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.557517    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 15:01:17.557797 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.557781    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zf7d9\""
Jul 21 15:01:17.557845 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.557824    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 15:01:17.561763 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.561733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bae090d7-7387-4e79-bd16-b249c31fe457-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.561961 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.561763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5t5\" (UniqueName: \"kubernetes.io/projected/bae090d7-7387-4e79-bd16-b249c31fe457-kube-api-access-sd5t5\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.561961 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.561848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-stats-auth\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.561961 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.561889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.561961 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.561949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.562150 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.561986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.562150 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.562043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6th25\" (UniqueName: \"kubernetes.io/projected/8bb34876-74c1-4c41-9f40-a9f9e59478e5-kube-api-access-6th25\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.562150 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.562106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-default-certificate\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.563517 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.563498    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 21 15:01:17.663362 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bae090d7-7387-4e79-bd16-b249c31fe457-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.663487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db25418d-f0c1-4b5c-a987-67df911d1e61-snapshots\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.663487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5t5\" (UniqueName: \"kubernetes.io/projected/bae090d7-7387-4e79-bd16-b249c31fe457-kube-api-access-sd5t5\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.663487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db25418d-f0c1-4b5c-a987-67df911d1e61-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.663573 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.663573 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-default-certificate\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.663573 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6th25\" (UniqueName: \"kubernetes.io/projected/8bb34876-74c1-4c41-9f40-a9f9e59478e5-kube-api-access-6th25\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db25418d-f0c1-4b5c-a987-67df911d1e61-serving-cert\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db25418d-f0c1-4b5c-a987-67df911d1e61-service-ca-bundle\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:17.663714    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:18.16369166 +0000 UTC m=+42.598479455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : configmap references non-existent config key: service-ca.crt
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db25418d-f0c1-4b5c-a987-67df911d1e61-tmp\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:17.663783    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 15:01:17.663809 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-stats-auth\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.664091 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:17.663820    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:18.163808541 +0000 UTC m=+42.598596313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : secret "router-metrics-certs-default" not found
Jul 21 15:01:17.664091 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24hr6\" (UniqueName: \"kubernetes.io/projected/db25418d-f0c1-4b5c-a987-67df911d1e61-kube-api-access-24hr6\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.664091 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.663878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.664091 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:17.663982    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:17.664091 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:17.664039    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls podName:bae090d7-7387-4e79-bd16-b249c31fe457 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:18.164024132 +0000 UTC m=+42.598811909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-htn7r" (UID: "bae090d7-7387-4e79-bd16-b249c31fe457") : secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:17.664266 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.664159    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bae090d7-7387-4e79-bd16-b249c31fe457-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.667192 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.667171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-default-certificate\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.667266 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.667171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-stats-auth\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.673098 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.673071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5t5\" (UniqueName: \"kubernetes.io/projected/bae090d7-7387-4e79-bd16-b249c31fe457-kube-api-access-sd5t5\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:17.673430 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.673411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6th25\" (UniqueName: \"kubernetes.io/projected/8bb34876-74c1-4c41-9f40-a9f9e59478e5-kube-api-access-6th25\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:17.687973 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.687902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:17.764393 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.764370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24hr6\" (UniqueName: \"kubernetes.io/projected/db25418d-f0c1-4b5c-a987-67df911d1e61-kube-api-access-24hr6\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.764500 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.764439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db25418d-f0c1-4b5c-a987-67df911d1e61-snapshots\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.764500 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.764461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db25418d-f0c1-4b5c-a987-67df911d1e61-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.764598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.764505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db25418d-f0c1-4b5c-a987-67df911d1e61-serving-cert\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.764598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.764520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db25418d-f0c1-4b5c-a987-67df911d1e61-service-ca-bundle\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.764598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.764575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db25418d-f0c1-4b5c-a987-67df911d1e61-tmp\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.765137 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.765111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db25418d-f0c1-4b5c-a987-67df911d1e61-tmp\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.765218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.765138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db25418d-f0c1-4b5c-a987-67df911d1e61-snapshots\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.765334 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.765315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db25418d-f0c1-4b5c-a987-67df911d1e61-service-ca-bundle\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.765740 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.765725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db25418d-f0c1-4b5c-a987-67df911d1e61-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.766903 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.766885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db25418d-f0c1-4b5c-a987-67df911d1e61-serving-cert\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.773123 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.773106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24hr6\" (UniqueName: \"kubernetes.io/projected/db25418d-f0c1-4b5c-a987-67df911d1e61-kube-api-access-24hr6\") pod \"insights-operator-555d9d7885-s4ttv\" (UID: \"db25418d-f0c1-4b5c-a987-67df911d1e61\") " pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.865371 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.865348    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-s4ttv"
Jul 21 15:01:17.876180 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:17.876154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:18.013294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.013263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log" limit=1024
Jul 21 15:01:18.034323 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.034154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-s4ttv"]
Jul 21 15:01:18.038720 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:18.038694    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb25418d_f0c1_4b5c_a987_67df911d1e61.slice/crio-9a55dc45604ec0aedd919328bd1d939f4f6a4e130baeaa511c3286c5dad90710 WatchSource:0}: Error finding container 9a55dc45604ec0aedd919328bd1d939f4f6a4e130baeaa511c3286c5dad90710: Status 404 returned error can't find the container with id 9a55dc45604ec0aedd919328bd1d939f4f6a4e130baeaa511c3286c5dad90710
Jul 21 15:01:18.168339 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.168303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:18.168456 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.168370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:18.168456 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.168395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:18.168529 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:18.168476    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.168452777 +0000 UTC m=+43.603240550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : configmap references non-existent config key: service-ca.crt
Jul 21 15:01:18.168529 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:18.168490    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:18.168529 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:18.168521    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 15:01:18.168643 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:18.168535    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls podName:bae090d7-7387-4e79-bd16-b249c31fe457 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.16852432 +0000 UTC m=+43.603312091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-htn7r" (UID: "bae090d7-7387-4e79-bd16-b249c31fe457") : secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:18.168643 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:18.168587    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.16857235 +0000 UTC m=+43.603360127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : secret "router-metrics-certs-default" not found
Jul 21 15:01:18.237414 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.237342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7qztt" event={"ID":"c56438d3-aab0-41cd-8a78-38873380840a","Type":"ContainerStarted","Data":"63c74ed4de3a3143b20d0d4e4c4ab1f6297e6b7ca31ead167d6cab1fb12456c6"}
Jul 21 15:01:18.238642 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.238622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-s4ttv" event={"ID":"db25418d-f0c1-4b5c-a987-67df911d1e61","Type":"ContainerStarted","Data":"9a55dc45604ec0aedd919328bd1d939f4f6a4e130baeaa511c3286c5dad90710"}
Jul 21 15:01:18.255406 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:18.255363    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7qztt" podStartSLOduration=2.54584362 podStartE2EDuration="7.255350165s" totalImagesPullingTime="4.709506545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:18.254662301 +0000 UTC m=+42.689450110" watchObservedRunningTime="2026-07-21 15:01:18.255350165 +0000 UTC m=+42.690137958"
Jul 21 15:01:19.177654 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:19.177597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:19.177818 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:19.177702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:19.177818 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:19.177739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:19.177818 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.177769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:21.177743887 +0000 UTC m=+45.612531670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : configmap references non-existent config key: service-ca.crt
Jul 21 15:01:19.177997 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.177833    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:19.177997 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.177850    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 15:01:19.177997 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.177955    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls podName:bae090d7-7387-4e79-bd16-b249c31fe457 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:21.177878556 +0000 UTC m=+45.612666342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-htn7r" (UID: "bae090d7-7387-4e79-bd16-b249c31fe457") : secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:19.177997 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.177971    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:21.177964324 +0000 UTC m=+45.612752096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : secret "router-metrics-certs-default" not found
Jul 21 15:01:19.681015 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:19.680983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:19.681451 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.681164    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:19.681451 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.681186    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:19.681451 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.681256    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:27.681235173 +0000 UTC m=+52.116022958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:19.782325 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:19.782283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:19.782497 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.782459    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:19.782555 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:19.782544    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:01:27.78252143 +0000 UTC m=+52.217309223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:21.194453 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.194420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.194482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.194516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:21.194585    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:25.194566148 +0000 UTC m=+49.629353943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : configmap references non-existent config key: service-ca.crt
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:21.194644    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:21.194661    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:21.194696    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:25.194684135 +0000 UTC m=+49.629471907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : secret "router-metrics-certs-default" not found
Jul 21 15:01:21.194838 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:21.194710    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls podName:bae090d7-7387-4e79-bd16-b249c31fe457 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:25.194703573 +0000 UTC m=+49.629491344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-htn7r" (UID: "bae090d7-7387-4e79-bd16-b249c31fe457") : secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:21.246897 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.246867    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-s4ttv" event={"ID":"db25418d-f0c1-4b5c-a987-67df911d1e61","Type":"ContainerStarted","Data":"a95701975e26da67361021ad05dad6f21c3fada22e5b637607c4159dfb814413"}
Jul 21 15:01:21.265051 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.265010    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-s4ttv" podStartSLOduration=1.530456843 podStartE2EDuration="4.264995451s" totalImagesPullingTime="2.734538608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:21.264632252 +0000 UTC m=+45.699420051" watchObservedRunningTime="2026-07-21 15:01:21.264995451 +0000 UTC m=+45.699783244"
Jul 21 15:01:21.961462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.961434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6f5f9"]
Jul 21 15:01:21.975201 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.975167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:21.976881 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.976853    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6f5f9"]
Jul 21 15:01:21.977576 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.977555    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlkkf\""
Jul 21 15:01:21.977803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.977758    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 15:01:21.978452 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:21.978435    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 15:01:22.100786 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.100754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de11b194-8ec8-4716-b0d7-67082a42a751-data-volume\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.100960 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.100803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.100960 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.100881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de11b194-8ec8-4716-b0d7-67082a42a751-crio-socket\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.100960 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.100921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.100960 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.100942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghh9\" (UniqueName: \"kubernetes.io/projected/de11b194-8ec8-4716-b0d7-67082a42a751-kube-api-access-gghh9\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.201887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.201851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de11b194-8ec8-4716-b0d7-67082a42a751-data-volume\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.201904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.201966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de11b194-8ec8-4716-b0d7-67082a42a751-crio-socket\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.201991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.202019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghh9\" (UniqueName: \"kubernetes.io/projected/de11b194-8ec8-4716-b0d7-67082a42a751-kube-api-access-gghh9\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.202066    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.202124    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.202140    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:22.702119654 +0000 UTC m=+47.136907437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : configmap "kube-rbac-proxy" not found
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.202176    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:22.702162367 +0000 UTC m=+47.136950143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.202195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de11b194-8ec8-4716-b0d7-67082a42a751-crio-socket\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.202273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.202267    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de11b194-8ec8-4716-b0d7-67082a42a751-data-volume\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.210350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.210326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghh9\" (UniqueName: \"kubernetes.io/projected/de11b194-8ec8-4716-b0d7-67082a42a751-kube-api-access-gghh9\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.419726 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.419695    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"]
Jul 21 15:01:22.439515 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.439491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"]
Jul 21 15:01:22.439664 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.439584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:22.442165 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.442146    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:01:22.442275 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.442217    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 15:01:22.442275 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.442263    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-clggr\""
Jul 21 15:01:22.442957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.442941    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 15:01:22.605249 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.605218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw96j\" (UniqueName: \"kubernetes.io/projected/0640e863-688a-44bd-b124-29456fdafe87-kube-api-access-kw96j\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:22.605409 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.605283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:22.706688 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.706630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw96j\" (UniqueName: \"kubernetes.io/projected/0640e863-688a-44bd-b124-29456fdafe87-kube-api-access-kw96j\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:22.706688 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.706676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.706842 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.706698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:22.706842 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.706748    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:01:22.706842 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.706781    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 15:01:22.706842 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.706808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:23.706787302 +0000 UTC m=+48.141575074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : configmap "kube-rbac-proxy" not found
Jul 21 15:01:22.707031 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.706842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:22.707031 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.706884    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls podName:0640e863-688a-44bd-b124-29456fdafe87 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:23.206869177 +0000 UTC m=+47.641656952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-ldfm2" (UID: "0640e863-688a-44bd-b124-29456fdafe87") : secret "samples-operator-tls" not found
Jul 21 15:01:22.707031 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.706929    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:22.707031 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:22.706971    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:23.706961036 +0000 UTC m=+48.141748810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:22.715543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:22.715512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw96j\" (UniqueName: \"kubernetes.io/projected/0640e863-688a-44bd-b124-29456fdafe87-kube-api-access-kw96j\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:23.156699 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.156671    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktv79_3a04a2cf-0be8-43a0-86a5-8943d0d692c4/dns-node-resolver/0.log"
Jul 21 15:01:23.211470 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.211440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:23.211858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:23.211560    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 15:01:23.211858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:23.211628    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls podName:0640e863-688a-44bd-b124-29456fdafe87 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:24.211598095 +0000 UTC m=+48.646385867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-ldfm2" (UID: "0640e863-688a-44bd-b124-29456fdafe87") : secret "samples-operator-tls" not found
Jul 21 15:01:23.405556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.405524    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"]
Jul 21 15:01:23.422438 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.422387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"
Jul 21 15:01:23.425815 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.425792    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 15:01:23.425815 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.425822    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n2xcl\""
Jul 21 15:01:23.426011 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.425799    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:01:23.426097 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.426074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"]
Jul 21 15:01:23.513542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.513497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsrbh\" (UniqueName: \"kubernetes.io/projected/fae03664-2a07-46dc-a0e3-554a5908a8f3-kube-api-access-xsrbh\") pod \"volume-data-source-validator-78cf4c6f6-gmhdn\" (UID: \"fae03664-2a07-46dc-a0e3-554a5908a8f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"
Jul 21 15:01:23.614354 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.614315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsrbh\" (UniqueName: \"kubernetes.io/projected/fae03664-2a07-46dc-a0e3-554a5908a8f3-kube-api-access-xsrbh\") pod \"volume-data-source-validator-78cf4c6f6-gmhdn\" (UID: \"fae03664-2a07-46dc-a0e3-554a5908a8f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"
Jul 21 15:01:23.624700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.624670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsrbh\" (UniqueName: \"kubernetes.io/projected/fae03664-2a07-46dc-a0e3-554a5908a8f3-kube-api-access-xsrbh\") pod \"volume-data-source-validator-78cf4c6f6-gmhdn\" (UID: \"fae03664-2a07-46dc-a0e3-554a5908a8f3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"
Jul 21 15:01:23.715740 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.715666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:23.715858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.715747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:23.715858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:23.715786    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:01:23.715858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:23.715842    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:25.715827186 +0000 UTC m=+50.150614958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : configmap "kube-rbac-proxy" not found
Jul 21 15:01:23.715962 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:23.715885    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:23.715962 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:23.715935    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:25.715923264 +0000 UTC m=+50.150711035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:23.732901 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.732882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"
Jul 21 15:01:23.870716 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:23.870680    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn"]
Jul 21 15:01:23.874444 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:23.874420    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae03664_2a07_46dc_a0e3_554a5908a8f3.slice/crio-b31d510af90ec8cc6179bf746771270dcf4a56b43b27b5ef43a9601a8b51f57d WatchSource:0}: Error finding container b31d510af90ec8cc6179bf746771270dcf4a56b43b27b5ef43a9601a8b51f57d: Status 404 returned error can't find the container with id b31d510af90ec8cc6179bf746771270dcf4a56b43b27b5ef43a9601a8b51f57d
Jul 21 15:01:24.156450 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.156419    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z9d8d_e9923942-bfbc-4a3c-82b0-20d1513f4f93/node-ca/0.log"
Jul 21 15:01:24.220820 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.220785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:24.221182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:24.220943    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 15:01:24.221182 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:24.221006    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls podName:0640e863-688a-44bd-b124-29456fdafe87 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:26.220988679 +0000 UTC m=+50.655776454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-ldfm2" (UID: "0640e863-688a-44bd-b124-29456fdafe87") : secret "samples-operator-tls" not found
Jul 21 15:01:24.255749 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.255709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn" event={"ID":"fae03664-2a07-46dc-a0e3-554a5908a8f3","Type":"ContainerStarted","Data":"b31d510af90ec8cc6179bf746771270dcf4a56b43b27b5ef43a9601a8b51f57d"}
Jul 21 15:01:24.439753 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.439670    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bzh44"]
Jul 21 15:01:24.454095 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.454066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.456271 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.456249    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bzh44"]
Jul 21 15:01:24.457072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.456776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 15:01:24.457072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.456813    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 15:01:24.457072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.456832    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 15:01:24.457246 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.457092    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:01:24.458093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.458071    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l6g9w\""
Jul 21 15:01:24.465248 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.465047    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 15:01:24.557876 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.557839    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7qztt_c56438d3-aab0-41cd-8a78-38873380840a/serve-healthcheck-canary/0.log"
Jul 21 15:01:24.624241 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.624199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-serving-cert\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.624365 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.624320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-config\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.624458 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.624393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-trusted-ca\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.624506 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.624465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7hdx\" (UniqueName: \"kubernetes.io/projected/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-kube-api-access-p7hdx\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.725252 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.725178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-trusted-ca\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.725252 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.725244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7hdx\" (UniqueName: \"kubernetes.io/projected/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-kube-api-access-p7hdx\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.725538 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.725312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-serving-cert\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.725538 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.725374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-config\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.725933 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.725912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-config\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.725998 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.725949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-trusted-ca\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.727776 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.727754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-serving-cert\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.734133 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.734113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7hdx\" (UniqueName: \"kubernetes.io/projected/40e1eb9b-84a5-44a4-be8d-3dc969a932ca-kube-api-access-p7hdx\") pod \"console-operator-565b7b569d-bzh44\" (UID: \"40e1eb9b-84a5-44a4-be8d-3dc969a932ca\") " pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.767103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.767080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:24.920268 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:24.920243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-bzh44"]
Jul 21 15:01:24.923398 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:24.923368    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e1eb9b_84a5_44a4_be8d_3dc969a932ca.slice/crio-f14a37b3c876621905a18a63bc7d640aad30d4e08373066b7e53951fb7f359cc WatchSource:0}: Error finding container f14a37b3c876621905a18a63bc7d640aad30d4e08373066b7e53951fb7f359cc: Status 404 returned error can't find the container with id f14a37b3c876621905a18a63bc7d640aad30d4e08373066b7e53951fb7f359cc
Jul 21 15:01:25.231868 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:25.231833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:25.231960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:25.232004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.232038    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:33.232012689 +0000 UTC m=+57.666800481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : configmap references non-existent config key: service-ca.crt
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.232100    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.232125    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.232148    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls podName:bae090d7-7387-4e79-bd16-b249c31fe457 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:33.232134635 +0000 UTC m=+57.666922406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-htn7r" (UID: "bae090d7-7387-4e79-bd16-b249c31fe457") : secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:25.232329 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.232178    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:33.232163285 +0000 UTC m=+57.666951059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : secret "router-metrics-certs-default" not found
Jul 21 15:01:25.260309 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:25.260276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" event={"ID":"40e1eb9b-84a5-44a4-be8d-3dc969a932ca","Type":"ContainerStarted","Data":"f14a37b3c876621905a18a63bc7d640aad30d4e08373066b7e53951fb7f359cc"}
Jul 21 15:01:25.737494 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:25.737391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:25.737494 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:25.737471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:25.737641 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.737549    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 15:01:25.737691 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.737646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:29.73760171 +0000 UTC m=+54.172389507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : configmap "kube-rbac-proxy" not found
Jul 21 15:01:25.737691 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.737654    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:25.737787 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:25.737715    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:29.737698378 +0000 UTC m=+54.172486171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:26.240485 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:26.240454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:26.240850 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:26.240598    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 15:01:26.240850 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:26.240692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls podName:0640e863-688a-44bd-b124-29456fdafe87 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:30.240675426 +0000 UTC m=+54.675463198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-ldfm2" (UID: "0640e863-688a-44bd-b124-29456fdafe87") : secret "samples-operator-tls" not found
Jul 21 15:01:26.265374 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:26.265351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn" event={"ID":"fae03664-2a07-46dc-a0e3-554a5908a8f3","Type":"ContainerStarted","Data":"babd8a1eeb416495a11bcb79c76aacbdf474f07226103860f47fc2082e2828de"}
Jul 21 15:01:26.282134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:26.282072    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-gmhdn" podStartSLOduration=1.509678406 podStartE2EDuration="3.282054811s" totalImagesPullingTime="1.772376405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:26.281918183 +0000 UTC m=+50.716705977" watchObservedRunningTime="2026-07-21 15:01:26.282054811 +0000 UTC m=+50.716842606"
Jul 21 15:01:27.415261 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.415229    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"]
Jul 21 15:01:27.439308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.439280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"]
Jul 21 15:01:27.439443 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.439389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.442185 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.442166    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 15:01:27.442303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.442207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:01:27.442303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.442227    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wtxcc\""
Jul 21 15:01:27.442303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.442165    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 15:01:27.442956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.442929    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 15:01:27.449847 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.449825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.449945 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.449906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88zqx\" (UniqueName: \"kubernetes.io/projected/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-kube-api-access-88zqx\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.449988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.449970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.538576 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.538543    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"]
Jul 21 15:01:27.543436 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.543421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.546223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.546201    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 21 15:01:27.546353 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.546203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 21 15:01:27.546353 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.546241    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wv466\""
Jul 21 15:01:27.546353 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.546243    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 21 15:01:27.546546 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.546533    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:01:27.550364 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.550340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.550488 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.550418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88zqx\" (UniqueName: \"kubernetes.io/projected/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-kube-api-access-88zqx\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.550488 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.550472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjlf7\" (UniqueName: \"kubernetes.io/projected/239c3963-5483-4a5a-90f3-510fb2df1ce3-kube-api-access-rjlf7\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.550768 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.550749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.551085 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.551021    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.551085 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.551071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/239c3963-5483-4a5a-90f3-510fb2df1ce3-config\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.551223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.551151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/239c3963-5483-4a5a-90f3-510fb2df1ce3-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.552409 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.552389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"]
Jul 21 15:01:27.553120 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.553104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.559395 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.559375    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88zqx\" (UniqueName: \"kubernetes.io/projected/f6c14c70-ca1d-45e2-9c77-80dd0d95ee49-kube-api-access-88zqx\") pod \"kube-storage-version-migrator-operator-7658d9b749-gxzdv\" (UID: \"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.652211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.652145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjlf7\" (UniqueName: \"kubernetes.io/projected/239c3963-5483-4a5a-90f3-510fb2df1ce3-kube-api-access-rjlf7\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.652211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.652205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/239c3963-5483-4a5a-90f3-510fb2df1ce3-config\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.652381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.652238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/239c3963-5483-4a5a-90f3-510fb2df1ce3-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.652753 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.652733    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/239c3963-5483-4a5a-90f3-510fb2df1ce3-config\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.654449 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.654430    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/239c3963-5483-4a5a-90f3-510fb2df1ce3-serving-cert\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.660280 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.660262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjlf7\" (UniqueName: \"kubernetes.io/projected/239c3963-5483-4a5a-90f3-510fb2df1ce3-kube-api-access-rjlf7\") pod \"service-ca-operator-5bcbc94c78-7gff6\" (UID: \"239c3963-5483-4a5a-90f3-510fb2df1ce3\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.751782 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.751754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"
Jul 21 15:01:27.752974 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.752953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:27.753107 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:27.753091    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:27.753151 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:27.753110    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:27.753196 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:27.753160    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:43.753143767 +0000 UTC m=+68.187931539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:27.852894 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.852851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"
Jul 21 15:01:27.853528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.853486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:27.853819 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:27.853796    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:27.853892 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:27.853873    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:01:43.853853249 +0000 UTC m=+68.288641037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:27.902353 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.902281    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv"]
Jul 21 15:01:27.904954 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:27.904918    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c14c70_ca1d_45e2_9c77_80dd0d95ee49.slice/crio-93719e08cf707c2f6a3500ef949e6df1db7340f3a58bbcc0cdf084451bcc8b96 WatchSource:0}: Error finding container 93719e08cf707c2f6a3500ef949e6df1db7340f3a58bbcc0cdf084451bcc8b96: Status 404 returned error can't find the container with id 93719e08cf707c2f6a3500ef949e6df1db7340f3a58bbcc0cdf084451bcc8b96
Jul 21 15:01:27.998815 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:27.998786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6"]
Jul 21 15:01:28.001875 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:28.001845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239c3963_5483_4a5a_90f3_510fb2df1ce3.slice/crio-f30ca575fa6777cf57f18222421978a580b028d90a8160ea25600acbf50d3fd3 WatchSource:0}: Error finding container f30ca575fa6777cf57f18222421978a580b028d90a8160ea25600acbf50d3fd3: Status 404 returned error can't find the container with id f30ca575fa6777cf57f18222421978a580b028d90a8160ea25600acbf50d3fd3
Jul 21 15:01:28.271286 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:28.271191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv" event={"ID":"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49","Type":"ContainerStarted","Data":"93719e08cf707c2f6a3500ef949e6df1db7340f3a58bbcc0cdf084451bcc8b96"}
Jul 21 15:01:28.272187 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:28.272166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6" event={"ID":"239c3963-5483-4a5a-90f3-510fb2df1ce3","Type":"ContainerStarted","Data":"f30ca575fa6777cf57f18222421978a580b028d90a8160ea25600acbf50d3fd3"}
Jul 21 15:01:29.236064 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.236033    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"]
Jul 21 15:01:29.256127 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.256102    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"]
Jul 21 15:01:29.256278 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.256210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"
Jul 21 15:01:29.258925 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.258902    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-b6pzg\""
Jul 21 15:01:29.263477 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.263456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfjgf\" (UniqueName: \"kubernetes.io/projected/a7556605-53d5-482b-96ae-c557353c62a8-kube-api-access-bfjgf\") pod \"network-check-source-7bc5b6bf85-hpk7v\" (UID: \"a7556605-53d5-482b-96ae-c557353c62a8\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"
Jul 21 15:01:29.364664 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.364635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfjgf\" (UniqueName: \"kubernetes.io/projected/a7556605-53d5-482b-96ae-c557353c62a8-kube-api-access-bfjgf\") pod \"network-check-source-7bc5b6bf85-hpk7v\" (UID: \"a7556605-53d5-482b-96ae-c557353c62a8\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"
Jul 21 15:01:29.374067 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.374039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfjgf\" (UniqueName: \"kubernetes.io/projected/a7556605-53d5-482b-96ae-c557353c62a8-kube-api-access-bfjgf\") pod \"network-check-source-7bc5b6bf85-hpk7v\" (UID: \"a7556605-53d5-482b-96ae-c557353c62a8\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"
Jul 21 15:01:29.565149 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.565104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"
Jul 21 15:01:29.768928 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.768897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:29.769084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.768967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:29.769084 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:29.769054    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:29.769216 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:29.769105    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:37.769092333 +0000 UTC m=+62.203880105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:29.769497 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.769476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de11b194-8ec8-4716-b0d7-67082a42a751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:29.928373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:29.928343    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v"]
Jul 21 15:01:29.931302 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:29.931273    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7556605_53d5_482b_96ae_c557353c62a8.slice/crio-c5ab4f86c761248075eecfd901ebc3c4569a9e2d851f0b8d98999bad4bfdcdc9 WatchSource:0}: Error finding container c5ab4f86c761248075eecfd901ebc3c4569a9e2d851f0b8d98999bad4bfdcdc9: Status 404 returned error can't find the container with id c5ab4f86c761248075eecfd901ebc3c4569a9e2d851f0b8d98999bad4bfdcdc9
Jul 21 15:01:30.274283 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.274245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:30.274547 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:30.274409    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 15:01:30.274547 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:30.274470    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls podName:0640e863-688a-44bd-b124-29456fdafe87 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:38.274453573 +0000 UTC m=+62.709241345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-ldfm2" (UID: "0640e863-688a-44bd-b124-29456fdafe87") : secret "samples-operator-tls" not found
Jul 21 15:01:30.278357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.278329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" event={"ID":"40e1eb9b-84a5-44a4-be8d-3dc969a932ca","Type":"ContainerStarted","Data":"00608e2ec8136d74de3eae78df1252318fbf17fb3b1c086f3f04a7adf53e8440"}
Jul 21 15:01:30.278542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.278522    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:30.279710 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.279679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v" event={"ID":"a7556605-53d5-482b-96ae-c557353c62a8","Type":"ContainerStarted","Data":"c5ab4f86c761248075eecfd901ebc3c4569a9e2d851f0b8d98999bad4bfdcdc9"}
Jul 21 15:01:30.280112 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.280093    2562 patch_prober.go:28] interesting pod/console-operator-565b7b569d-bzh44 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body=
Jul 21 15:01:30.280164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.280138    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused"
Jul 21 15:01:30.305862 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:30.305810    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podStartSLOduration=1.092910377 podStartE2EDuration="6.305794424s" totalImagesPullingTime="5.212884047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:30.304780515 +0000 UTC m=+54.739568341" watchObservedRunningTime="2026-07-21 15:01:30.305794424 +0000 UTC m=+54.740582218"
Jul 21 15:01:31.286598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:31.285821    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/0.log"
Jul 21 15:01:31.286598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:31.285881    2562 generic.go:356] "Generic (PLEG): container finished" podID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca" containerID="00608e2ec8136d74de3eae78df1252318fbf17fb3b1c086f3f04a7adf53e8440" exitCode=255
Jul 21 15:01:31.286598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:31.285937    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" event={"ID":"40e1eb9b-84a5-44a4-be8d-3dc969a932ca","Type":"ContainerDied","Data":"00608e2ec8136d74de3eae78df1252318fbf17fb3b1c086f3f04a7adf53e8440"}
Jul 21 15:01:31.286598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:31.286216    2562 scope.go:117] "RemoveContainer" containerID="00608e2ec8136d74de3eae78df1252318fbf17fb3b1c086f3f04a7adf53e8440"
Jul 21 15:01:32.291067 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:32.291041    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/1.log"
Jul 21 15:01:32.291527 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:32.291511    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/0.log"
Jul 21 15:01:32.291578 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:32.291547    2562 generic.go:356] "Generic (PLEG): container finished" podID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956" exitCode=255
Jul 21 15:01:32.291631 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:32.291593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" event={"ID":"40e1eb9b-84a5-44a4-be8d-3dc969a932ca","Type":"ContainerDied","Data":"aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"}
Jul 21 15:01:32.291678 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:32.291659    2562 scope.go:117] "RemoveContainer" containerID="00608e2ec8136d74de3eae78df1252318fbf17fb3b1c086f3f04a7adf53e8440"
Jul 21 15:01:32.292093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:32.292073    2562 scope.go:117] "RemoveContainer" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"
Jul 21 15:01:32.292289 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:32.292265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:01:33.294459 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:33.294434    2562 scope.go:117] "RemoveContainer" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"
Jul 21 15:01:33.294922 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:33.294580    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:01:33.302315 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:33.302285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:33.302450 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:33.302392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:33.302523 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:33.302444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:33.302575 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:33.302549    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:49.302530773 +0000 UTC m=+73.737318546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : configmap references non-existent config key: service-ca.crt
Jul 21 15:01:33.302575 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:33.302558    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:33.302707 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:33.302558    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 15:01:33.302707 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:33.302646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls podName:bae090d7-7387-4e79-bd16-b249c31fe457 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:49.302631721 +0000 UTC m=+73.737419497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-htn7r" (UID: "bae090d7-7387-4e79-bd16-b249c31fe457") : secret "cluster-monitoring-operator-tls" not found
Jul 21 15:01:33.302707 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:33.302675    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs podName:8bb34876-74c1-4c41-9f40-a9f9e59478e5 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:49.302662362 +0000 UTC m=+73.737450140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs") pod "router-default-5dcbc69fb-d69xs" (UID: "8bb34876-74c1-4c41-9f40-a9f9e59478e5") : secret "router-metrics-certs-default" not found
Jul 21 15:01:34.299555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:34.299522    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/1.log"
Jul 21 15:01:34.768263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:34.768174    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:34.768632 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:34.768598    2562 scope.go:117] "RemoveContainer" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"
Jul 21 15:01:34.768820 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:34.768796    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:01:35.305219 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:35.305180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v" event={"ID":"a7556605-53d5-482b-96ae-c557353c62a8","Type":"ContainerStarted","Data":"c10e53abf5a884cd075c76231d79c7359fc164f722c4bb77bb2702157ae31cdc"}
Jul 21 15:01:35.306686 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:35.306656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv" event={"ID":"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49","Type":"ContainerStarted","Data":"9623b5f10e353e4ebdc3b21163aeedea79fe5523e6482ea8d8f2b904c104a43f"}
Jul 21 15:01:35.308115 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:35.308094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6" event={"ID":"239c3963-5483-4a5a-90f3-510fb2df1ce3","Type":"ContainerStarted","Data":"ade217dcc98fc262bec3a97fbf9ebece15ca33c30e0f87a9fcc676a0130499f0"}
Jul 21 15:01:35.328008 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:35.327963    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-hpk7v" podStartSLOduration=1.9099076 podStartE2EDuration="6.327951272s" totalImagesPullingTime="4.418043672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:35.327020723 +0000 UTC m=+59.761808531" watchObservedRunningTime="2026-07-21 15:01:35.327951272 +0000 UTC m=+59.762739059"
Jul 21 15:01:35.347447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:35.347401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv" podStartSLOduration=1.915397806 podStartE2EDuration="8.347384646s" totalImagesPullingTime="6.43198684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:35.346320665 +0000 UTC m=+59.781108460" watchObservedRunningTime="2026-07-21 15:01:35.347384646 +0000 UTC m=+59.782172443"
Jul 21 15:01:35.363803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:35.363761    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6" podStartSLOduration=2.040772522 podStartE2EDuration="8.363743357s" totalImagesPullingTime="6.322970835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:35.362663614 +0000 UTC m=+59.797451433" watchObservedRunningTime="2026-07-21 15:01:35.363743357 +0000 UTC m=+59.798531153"
Jul 21 15:01:37.848182 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:37.848147    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:37.848599 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:37.848290    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:37.848599 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:37.848353    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls podName:de11b194-8ec8-4716-b0d7-67082a42a751 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:53.848336937 +0000 UTC m=+78.283124708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6f5f9" (UID: "de11b194-8ec8-4716-b0d7-67082a42a751") : secret "insights-runtime-extractor-tls" not found
Jul 21 15:01:38.216711 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.216637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wf7j"
Jul 21 15:01:38.352776 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.352739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:38.352928 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:38.352850    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 15:01:38.352928 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:38.352910    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls podName:0640e863-688a-44bd-b124-29456fdafe87 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:54.352896405 +0000 UTC m=+78.787684176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-ldfm2" (UID: "0640e863-688a-44bd-b124-29456fdafe87") : secret "samples-operator-tls" not found
Jul 21 15:01:38.428746 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.428712    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k8lfw"]
Jul 21 15:01:38.453204 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.453167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k8lfw"]
Jul 21 15:01:38.453377 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.453277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.456092 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.456065    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 15:01:38.456332 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.456310    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 15:01:38.456476 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.456340    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 15:01:38.456476 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.456342    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 15:01:38.456476 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.456316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-52nkj\""
Jul 21 15:01:38.554542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.554513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4pv\" (UniqueName: \"kubernetes.io/projected/810494f8-47ea-455b-bfcb-80d18ffcea6d-kube-api-access-bl4pv\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.554717 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.554573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/810494f8-47ea-455b-bfcb-80d18ffcea6d-signing-cabundle\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.554717 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.554656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/810494f8-47ea-455b-bfcb-80d18ffcea6d-signing-key\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.656032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.655999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4pv\" (UniqueName: \"kubernetes.io/projected/810494f8-47ea-455b-bfcb-80d18ffcea6d-kube-api-access-bl4pv\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.656206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.656059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/810494f8-47ea-455b-bfcb-80d18ffcea6d-signing-cabundle\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.656206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.656193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/810494f8-47ea-455b-bfcb-80d18ffcea6d-signing-key\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.656693 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.656673    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/810494f8-47ea-455b-bfcb-80d18ffcea6d-signing-cabundle\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.658713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.658694    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/810494f8-47ea-455b-bfcb-80d18ffcea6d-signing-key\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.664515 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.664491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4pv\" (UniqueName: \"kubernetes.io/projected/810494f8-47ea-455b-bfcb-80d18ffcea6d-kube-api-access-bl4pv\") pod \"service-ca-58598695f7-k8lfw\" (UID: \"810494f8-47ea-455b-bfcb-80d18ffcea6d\") " pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.762501 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.762468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-k8lfw"
Jul 21 15:01:38.909825 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:38.909792    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k8lfw"]
Jul 21 15:01:38.913593 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:38.913559    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810494f8_47ea_455b_bfcb_80d18ffcea6d.slice/crio-6d603ea8ec7f91340d964934acf87748604eeaf629fd5bc04b12b37996709572 WatchSource:0}: Error finding container 6d603ea8ec7f91340d964934acf87748604eeaf629fd5bc04b12b37996709572: Status 404 returned error can't find the container with id 6d603ea8ec7f91340d964934acf87748604eeaf629fd5bc04b12b37996709572
Jul 21 15:01:39.322803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:39.322763    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-k8lfw" event={"ID":"810494f8-47ea-455b-bfcb-80d18ffcea6d","Type":"ContainerStarted","Data":"a0100c554c16d056265a3246cdf4a13ed9ba68c3373cb888591bf454b2f5721d"}
Jul 21 15:01:39.322990 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:39.322827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-k8lfw" event={"ID":"810494f8-47ea-455b-bfcb-80d18ffcea6d","Type":"ContainerStarted","Data":"6d603ea8ec7f91340d964934acf87748604eeaf629fd5bc04b12b37996709572"}
Jul 21 15:01:39.348218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:39.348173    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-k8lfw" podStartSLOduration=1.348157759 podStartE2EDuration="1.348157759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:39.346200419 +0000 UTC m=+63.780988212" watchObservedRunningTime="2026-07-21 15:01:39.348157759 +0000 UTC m=+63.782945552"
Jul 21 15:01:40.279516 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:40.279479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:40.279938 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:40.279864    2562 scope.go:117] "RemoveContainer" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"
Jul 21 15:01:40.280027 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:40.280008    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:01:41.882302 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.882265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:01:41.882722 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.882310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:41.882722 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.882499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:41.885185 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.885161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltctx\" (UniqueName: \"kubernetes.io/projected/6aae62db-e083-4030-8044-cc446ee70724-kube-api-access-ltctx\") pod \"network-check-target-krjpq\" (UID: \"6aae62db-e083-4030-8044-cc446ee70724\") " pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:41.885481 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.885461    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 15:01:41.885642 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.885507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 15:01:41.893098 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:41.893079    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 15:01:41.893191 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:41.893145    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs podName:2d7accd1-9694-42ef-8fc8-3cc621bb0d0c nodeName:}" failed. No retries permitted until 2026-07-21 15:02:45.893123678 +0000 UTC m=+130.327911464 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs") pod "network-metrics-daemon-s667c" (UID: "2d7accd1-9694-42ef-8fc8-3cc621bb0d0c") : secret "metrics-daemon-secret" not found
Jul 21 15:01:41.895232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:41.895213    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b0c880c-0774-45a5-bc7c-9332c58c0600-original-pull-secret\") pod \"global-pull-secret-syncer-2dggs\" (UID: \"1b0c880c-0774-45a5-bc7c-9332c58c0600\") " pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:42.049649 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.049600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dggs"
Jul 21 15:01:42.149599 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.149508    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zxdnr\""
Jul 21 15:01:42.157662 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.157633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:42.180871 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.180839    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2dggs"]
Jul 21 15:01:42.183726 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:42.183694    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0c880c_0774_45a5_bc7c_9332c58c0600.slice/crio-e0ee4936fba3fb280076861b1f81545dd47a7c1a2702924122bc0f154899e514 WatchSource:0}: Error finding container e0ee4936fba3fb280076861b1f81545dd47a7c1a2702924122bc0f154899e514: Status 404 returned error can't find the container with id e0ee4936fba3fb280076861b1f81545dd47a7c1a2702924122bc0f154899e514
Jul 21 15:01:42.299832 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.299796    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krjpq"]
Jul 21 15:01:42.303635 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:42.303593    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aae62db_e083_4030_8044_cc446ee70724.slice/crio-bc117d7eda16f4a9a5b8a010c4db0644e841a1406460e03d537ba46e362bbfd8 WatchSource:0}: Error finding container bc117d7eda16f4a9a5b8a010c4db0644e841a1406460e03d537ba46e362bbfd8: Status 404 returned error can't find the container with id bc117d7eda16f4a9a5b8a010c4db0644e841a1406460e03d537ba46e362bbfd8
Jul 21 15:01:42.337365 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.337340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krjpq" event={"ID":"6aae62db-e083-4030-8044-cc446ee70724","Type":"ContainerStarted","Data":"bc117d7eda16f4a9a5b8a010c4db0644e841a1406460e03d537ba46e362bbfd8"}
Jul 21 15:01:42.338510 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:42.338487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2dggs" event={"ID":"1b0c880c-0774-45a5-bc7c-9332c58c0600","Type":"ContainerStarted","Data":"e0ee4936fba3fb280076861b1f81545dd47a7c1a2702924122bc0f154899e514"}
Jul 21 15:01:43.344411 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:43.344348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krjpq" event={"ID":"6aae62db-e083-4030-8044-cc446ee70724","Type":"ContainerStarted","Data":"3230b296cd396a284f79bdd814a92fb11fc914b3a044fe98ff2a26c1edbf2234"}
Jul 21 15:01:43.344894 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:43.344490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:01:43.362315 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:43.362271    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-krjpq" podStartSLOduration=67.362248408 podStartE2EDuration="1m7.362248408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:43.360958534 +0000 UTC m=+67.795746329" watchObservedRunningTime="2026-07-21 15:01:43.362248408 +0000 UTC m=+67.797036206"
Jul 21 15:01:43.799411 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:43.799370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:01:43.799574 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:43.799531    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 15:01:43.799574 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:43.799551    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c48d5b94-wk569: secret "image-registry-tls" not found
Jul 21 15:01:43.799664 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:43.799618    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls podName:00bdd812-5e6f-46ac-b270-6d12f7078d50 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:15.799590574 +0000 UTC m=+100.234378348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls") pod "image-registry-75c48d5b94-wk569" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50") : secret "image-registry-tls" not found
Jul 21 15:01:43.901025 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:43.900981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:01:43.901219 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:43.901148    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 15:01:43.901289 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:43.901225    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls podName:b6249d0f-e876-45b8-853e-fe28e39497df nodeName:}" failed. No retries permitted until 2026-07-21 15:02:15.901204222 +0000 UTC m=+100.335992001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls") pod "dns-default-54czh" (UID: "b6249d0f-e876-45b8-853e-fe28e39497df") : secret "dns-default-metrics-tls" not found
Jul 21 15:01:47.361660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:47.361597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2dggs" event={"ID":"1b0c880c-0774-45a5-bc7c-9332c58c0600","Type":"ContainerStarted","Data":"bbde81cfa4cf041dfd48fde5061b50ce641159a187e1929e80ad21dd909c5d73"}
Jul 21 15:01:47.378169 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:47.378076    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2dggs" podStartSLOduration=65.439167362 podStartE2EDuration="1m10.378059307s" totalImagesPullingTime="4.938891945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:47.37726638 +0000 UTC m=+71.812054174" watchObservedRunningTime="2026-07-21 15:01:47.378059307 +0000 UTC m=+71.812847164"
Jul 21 15:01:49.349857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.349819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:49.350344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.349910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:49.350344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.349957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:49.350635 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.350589    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bb34876-74c1-4c41-9f40-a9f9e59478e5-service-ca-bundle\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:49.352339 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.352317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bae090d7-7387-4e79-bd16-b249c31fe457-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-htn7r\" (UID: \"bae090d7-7387-4e79-bd16-b249c31fe457\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:49.352437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.352361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8bb34876-74c1-4c41-9f40-a9f9e59478e5-metrics-certs\") pod \"router-default-5dcbc69fb-d69xs\" (UID: \"8bb34876-74c1-4c41-9f40-a9f9e59478e5\") " pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:49.560395 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.560365    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s5p4j\""
Jul 21 15:01:49.568353 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.568326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"
Jul 21 15:01:49.579802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.579775    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2wnfd\""
Jul 21 15:01:49.587912 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.587890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:49.720495 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.720466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r"]
Jul 21 15:01:49.723167 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:49.723135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae090d7_7387_4e79_bd16_b249c31fe457.slice/crio-d59d26982114e82079a6ddb81824c906e77758d78065542169086919eb264bfc WatchSource:0}: Error finding container d59d26982114e82079a6ddb81824c906e77758d78065542169086919eb264bfc: Status 404 returned error can't find the container with id d59d26982114e82079a6ddb81824c906e77758d78065542169086919eb264bfc
Jul 21 15:01:49.738178 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:49.738154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dcbc69fb-d69xs"]
Jul 21 15:01:49.740732 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:49.740707    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb34876_74c1_4c41_9f40_a9f9e59478e5.slice/crio-27b19eba4efd7456508985c4ddc205b0369b693705e4afc19a9c97e1769136fb WatchSource:0}: Error finding container 27b19eba4efd7456508985c4ddc205b0369b693705e4afc19a9c97e1769136fb: Status 404 returned error can't find the container with id 27b19eba4efd7456508985c4ddc205b0369b693705e4afc19a9c97e1769136fb
Jul 21 15:01:50.371626 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:50.371572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r" event={"ID":"bae090d7-7387-4e79-bd16-b249c31fe457","Type":"ContainerStarted","Data":"d59d26982114e82079a6ddb81824c906e77758d78065542169086919eb264bfc"}
Jul 21 15:01:50.372903 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:50.372876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dcbc69fb-d69xs" event={"ID":"8bb34876-74c1-4c41-9f40-a9f9e59478e5","Type":"ContainerStarted","Data":"62d29df62a8ba6fd25530b4226297b70bbf1ec111f857a2056d32e63d99e47d9"}
Jul 21 15:01:50.373032 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:50.372922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dcbc69fb-d69xs" event={"ID":"8bb34876-74c1-4c41-9f40-a9f9e59478e5","Type":"ContainerStarted","Data":"27b19eba4efd7456508985c4ddc205b0369b693705e4afc19a9c97e1769136fb"}
Jul 21 15:01:50.399563 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:50.399512    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5dcbc69fb-d69xs" podStartSLOduration=33.399496389 podStartE2EDuration="33.399496389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:50.398121665 +0000 UTC m=+74.832909484" watchObservedRunningTime="2026-07-21 15:01:50.399496389 +0000 UTC m=+74.834284182"
Jul 21 15:01:50.588754 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:50.588699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:50.591805 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:50.591780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:51.376278 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:51.376244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:51.377754 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:51.377731    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dcbc69fb-d69xs"
Jul 21 15:01:52.380849 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:52.380815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r" event={"ID":"bae090d7-7387-4e79-bd16-b249c31fe457","Type":"ContainerStarted","Data":"1469b826bcddbd6cd1c314958d3c8b584bdbea025d9f7a431d6f196b07223d54"}
Jul 21 15:01:52.406014 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:52.405962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-htn7r" podStartSLOduration=33.446753562 podStartE2EDuration="35.405944176s" totalImagesPullingTime="1.959190614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:52.405113409 +0000 UTC m=+76.839901205" watchObservedRunningTime="2026-07-21 15:01:52.405944176 +0000 UTC m=+76.840732010"
Jul 21 15:01:53.037604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.037569    2562 scope.go:117] "RemoveContainer" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"
Jul 21 15:01:53.387709 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.387633    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:01:53.388096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.387999    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/1.log"
Jul 21 15:01:53.388096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.388032    2562 generic.go:356] "Generic (PLEG): container finished" podID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca" containerID="9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7" exitCode=255
Jul 21 15:01:53.388165 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.388094    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" event={"ID":"40e1eb9b-84a5-44a4-be8d-3dc969a932ca","Type":"ContainerDied","Data":"9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7"}
Jul 21 15:01:53.388197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.388179    2562 scope.go:117] "RemoveContainer" containerID="aa37dab116c63c0572009316d98202dcb4d3da9736398e4cb27daf9392ccd956"
Jul 21 15:01:53.388584 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.388568    2562 scope.go:117] "RemoveContainer" containerID="9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7"
Jul 21 15:01:53.388718 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:53.388702    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:01:53.890758 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.890720    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:53.893262 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:53.893220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de11b194-8ec8-4716-b0d7-67082a42a751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6f5f9\" (UID: \"de11b194-8ec8-4716-b0d7-67082a42a751\") " pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:54.087731 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.087701    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlkkf\""
Jul 21 15:01:54.095895 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.095872    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6f5f9"
Jul 21 15:01:54.230409 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.230387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6f5f9"]
Jul 21 15:01:54.232809 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:01:54.232786    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde11b194_8ec8_4716_b0d7_67082a42a751.slice/crio-1f390516de06f30859103df43ab08a36713752fd60005f143ef11a41d40268b0 WatchSource:0}: Error finding container 1f390516de06f30859103df43ab08a36713752fd60005f143ef11a41d40268b0: Status 404 returned error can't find the container with id 1f390516de06f30859103df43ab08a36713752fd60005f143ef11a41d40268b0
Jul 21 15:01:54.392472 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.392431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5f9" event={"ID":"de11b194-8ec8-4716-b0d7-67082a42a751","Type":"ContainerStarted","Data":"1f390516de06f30859103df43ab08a36713752fd60005f143ef11a41d40268b0"}
Jul 21 15:01:54.393786 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.393766    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:01:54.396031 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.396009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:54.398519 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.398472    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0640e863-688a-44bd-b124-29456fdafe87-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-ldfm2\" (UID: \"0640e863-688a-44bd-b124-29456fdafe87\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:54.554136 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.554102    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-clggr\""
Jul 21 15:01:54.558923 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.558905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"
Jul 21 15:01:54.698724 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.698703    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2"]
Jul 21 15:01:54.767258 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.767229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:01:54.767576 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:54.767562    2562 scope.go:117] "RemoveContainer" containerID="9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7"
Jul 21 15:01:54.767755 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:01:54.767734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:01:55.398260 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:01:55.398224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2" event={"ID":"0640e863-688a-44bd-b124-29456fdafe87","Type":"ContainerStarted","Data":"02165b1f5771042fc32d841df57b6090c854bc184c04f8dfefbe266a8e3d0549"}
Jul 21 15:02:00.278565 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:00.278528    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:02:00.279069 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:00.279041    2562 scope.go:117] "RemoveContainer" containerID="9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7"
Jul 21 15:02:00.279306 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:00.279275    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:02:01.424001 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:01.423958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2" event={"ID":"0640e863-688a-44bd-b124-29456fdafe87","Type":"ContainerStarted","Data":"b39dc16a5758aac24d904ae3aa5531fd9294ae0f5528794e63b55f240fce0ecb"}
Jul 21 15:02:01.424443 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:01.424018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2" event={"ID":"0640e863-688a-44bd-b124-29456fdafe87","Type":"ContainerStarted","Data":"af6e69d5223fbd7c3c0b3bc618aed8523f2cbcc12cca4a212a3046055068554f"}
Jul 21 15:02:01.425395 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:01.425369    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5f9" event={"ID":"de11b194-8ec8-4716-b0d7-67082a42a751","Type":"ContainerStarted","Data":"7df59a94f9b6b8a6fe5f8e036e4f6a557e7ac7e2bb79c3d0a24aaab24aa5db37"}
Jul 21 15:02:01.442618 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:01.442556    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-ldfm2" podStartSLOduration=33.759050132 podStartE2EDuration="39.442542238s" totalImagesPullingTime="5.683492106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:01.44165518 +0000 UTC m=+85.876442992" watchObservedRunningTime="2026-07-21 15:02:01.442542238 +0000 UTC m=+85.877330031"
Jul 21 15:02:06.445427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:06.445387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5f9" event={"ID":"de11b194-8ec8-4716-b0d7-67082a42a751","Type":"ContainerStarted","Data":"e20466d722f2fc80143dc7a60d4aa69800429cff6b593365a303cd742a9bb431"}
Jul 21 15:02:09.624649 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.624568    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gr69l"]
Jul 21 15:02:09.628557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.628529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.631935 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.631749    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 15:02:09.632056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.631979    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 15:02:09.632115 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.632058    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 15:02:09.632308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.632169    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pkzcx\""
Jul 21 15:02:09.632629 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.632593    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 15:02:09.732567 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-wtmp\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.732760 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-sys\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.732760 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjgf4\" (UniqueName: \"kubernetes.io/projected/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-kube-api-access-kjgf4\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.732760 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-root\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.732920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-textfile\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.732920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732817    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-tls\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.732920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.732840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-metrics-client-ca\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.733053 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.733032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.733123 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.733108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834385 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-wtmp\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834385 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-sys\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834385 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgf4\" (UniqueName: \"kubernetes.io/projected/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-kube-api-access-kjgf4\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834385 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-root\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834385 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-textfile\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834704 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-tls\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834704 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-metrics-client-ca\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.834704 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.834458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.835242 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.835055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.835830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.835463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-root\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.835830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.835512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-sys\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.835830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.835652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-wtmp\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.835830 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:09.835719    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 15:02:09.835830 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:09.835783    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-tls podName:3299c14c-b3cc-4ca3-9ac0-79575ff44f9b nodeName:}" failed. No retries permitted until 2026-07-21 15:02:10.335763947 +0000 UTC m=+94.770551731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-tls") pod "node-exporter-gr69l" (UID: "3299c14c-b3cc-4ca3-9ac0-79575ff44f9b") : secret "node-exporter-tls" not found
Jul 21 15:02:09.836186 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.835925    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-textfile\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.836186 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.836157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-metrics-client-ca\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.848478 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.847981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:09.859956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:09.859902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjgf4\" (UniqueName: \"kubernetes.io/projected/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-kube-api-access-kjgf4\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:10.339859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.339824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-tls\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:10.342464 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.342441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3299c14c-b3cc-4ca3-9ac0-79575ff44f9b-node-exporter-tls\") pod \"node-exporter-gr69l\" (UID: \"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b\") " pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:10.540903 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.540868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gr69l"
Jul 21 15:02:10.711494 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.711412    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:02:10.718137 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.718113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.721092 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 15:02:10.721092 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721050    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 15:02:10.721483 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721460    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 15:02:10.721599 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721538    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 15:02:10.721599 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721538    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 15:02:10.721877 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721855    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 15:02:10.722010 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721899    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 15:02:10.722010 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.721918    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 15:02:10.722131 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.722038    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 15:02:10.722131 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.722064    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m9xck\""
Jul 21 15:02:10.735660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.735601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:02:10.744272 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-web-config\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-out\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744647 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744647 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744647 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.744798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.744749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnkn4\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-kube-api-access-bnkn4\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.845999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846205 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846205 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846303 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:10.846253    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle podName:8cd4b1d1-82db-438a-bcb9-06e78f3caa40 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:11.346230013 +0000 UTC m=+95.781017800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40") : configmap references non-existent config key: ca-bundle.crt
Jul 21 15:02:10.846303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-web-config\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846391 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846391 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846354    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-out\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846391 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846514 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846514 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846514 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846505    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846664 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846664 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnkn4\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-kube-api-access-bnkn4\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846664 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.846858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.846825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.850289 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.850017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.850878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.850541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.850878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.850652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.850878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.850838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.851931 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.851899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.852329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.852307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-web-config\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.852861 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.852841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.852988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.852957    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-out\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.853256 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.853219    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.853352 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.853337    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:10.858624 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:10.858580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnkn4\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-kube-api-access-bnkn4\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:11.049191 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:02:11.049162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3299c14c_b3cc_4ca3_9ac0_79575ff44f9b.slice/crio-d3a9b02d3f07fcab6383484b363706f1857d77f39203c6dae556fe3fb1083850 WatchSource:0}: Error finding container d3a9b02d3f07fcab6383484b363706f1857d77f39203c6dae556fe3fb1083850: Status 404 returned error can't find the container with id d3a9b02d3f07fcab6383484b363706f1857d77f39203c6dae556fe3fb1083850
Jul 21 15:02:11.350498 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.350403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:11.351310 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.351288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:11.464262 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.464226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gr69l" event={"ID":"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b","Type":"ContainerStarted","Data":"d3a9b02d3f07fcab6383484b363706f1857d77f39203c6dae556fe3fb1083850"}
Jul 21 15:02:11.466098 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.466071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6f5f9" event={"ID":"de11b194-8ec8-4716-b0d7-67082a42a751","Type":"ContainerStarted","Data":"57384dca91748e996ebccd750e07abda76b774d2ff1f5b9d40fe6a32c86ee8f2"}
Jul 21 15:02:11.630575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.630496    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:02:11.772185 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.772119    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6f5f9" podStartSLOduration=34.138702037 podStartE2EDuration="50.77209409s" totalImagesPullingTime="16.633392053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:11.487676037 +0000 UTC m=+95.922463847" watchObservedRunningTime="2026-07-21 15:02:11.77209409 +0000 UTC m=+96.206881890"
Jul 21 15:02:11.772439 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:11.772407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:02:11.774376 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:02:11.774345    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd4b1d1_82db_438a_bcb9_06e78f3caa40.slice/crio-cce354792fc060e4b41b2fefaa890fefdfed7646a6322eddc6c0332adfb5b70f WatchSource:0}: Error finding container cce354792fc060e4b41b2fefaa890fefdfed7646a6322eddc6c0332adfb5b70f: Status 404 returned error can't find the container with id cce354792fc060e4b41b2fefaa890fefdfed7646a6322eddc6c0332adfb5b70f
Jul 21 15:02:12.036905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:12.036881    2562 scope.go:117] "RemoveContainer" containerID="9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7"
Jul 21 15:02:12.037070 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:12.037051    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-bzh44_openshift-console-operator(40e1eb9b-84a5-44a4-be8d-3dc969a932ca)\"" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" podUID="40e1eb9b-84a5-44a4-be8d-3dc969a932ca"
Jul 21 15:02:12.470883 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:12.470796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"cce354792fc060e4b41b2fefaa890fefdfed7646a6322eddc6c0332adfb5b70f"}
Jul 21 15:02:13.476674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:13.476646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gr69l" event={"ID":"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b","Type":"ContainerStarted","Data":"6ef25d261c621e637831ac64b91fe2f9356cdee8ea7f169e7f0a02d128ef8c85"}
Jul 21 15:02:14.351876 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:14.351844    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-krjpq"
Jul 21 15:02:14.482722 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:14.482686    2562 generic.go:356] "Generic (PLEG): container finished" podID="3299c14c-b3cc-4ca3-9ac0-79575ff44f9b" containerID="6ef25d261c621e637831ac64b91fe2f9356cdee8ea7f169e7f0a02d128ef8c85" exitCode=0
Jul 21 15:02:14.483147 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:14.482776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gr69l" event={"ID":"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b","Type":"ContainerDied","Data":"6ef25d261c621e637831ac64b91fe2f9356cdee8ea7f169e7f0a02d128ef8c85"}
Jul 21 15:02:14.484433 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:14.484400    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d" exitCode=0
Jul 21 15:02:14.484534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:14.484442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"}
Jul 21 15:02:15.491334 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.491290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gr69l" event={"ID":"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b","Type":"ContainerStarted","Data":"a69fb284541e42b3f66a2bbdef5c0830a0e2a7361cbef9d84b7b939641f9547a"}
Jul 21 15:02:15.491802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.491408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gr69l" event={"ID":"3299c14c-b3cc-4ca3-9ac0-79575ff44f9b","Type":"ContainerStarted","Data":"2bec9230d18b5bd63f630f1e75dd4a9978304022f1b00f6cc1f24b711a7b5f3c"}
Jul 21 15:02:15.512624 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.512563    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gr69l" podStartSLOduration=4.112842744 podStartE2EDuration="6.512549435s" totalImagesPullingTime="2.323038618s" totalInitContainerRuntime="76.668073ms" isStatefulPod=true podCreationTimestamp="2026-07-21 15:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:15.5116527 +0000 UTC m=+99.946440518" watchObservedRunningTime="2026-07-21 15:02:15.512549435 +0000 UTC m=+99.947337229"
Jul 21 15:02:15.822959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.822921    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:02:15.826390 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.826360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.829827 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.829805    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 15:02:15.829957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.829937    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pgp6l\""
Jul 21 15:02:15.830029 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.829984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 15:02:15.830029 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.830004    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.830622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.830691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.830760    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.830892    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.830929    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831063    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 15:02:15.831146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831076    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 15:02:15.831587 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831521    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 15:02:15.831587 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 15:02:15.831734 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831622    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 15:02:15.833223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831929    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 15:02:15.833223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.831935    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9eov844v6uk59\""
Jul 21 15:02:15.833375 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.833245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 15:02:15.847795 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.847770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:02:15.892480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892674 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cnch\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-kube-api-access-7cnch\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892994 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892866    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892994 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892994 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892994 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.892994 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.892978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.893140 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.893020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:15.893140 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.893104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.893140 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.893125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.895435 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.895407    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"image-registry-75c48d5b94-wk569\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") " pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:15.993679 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993679 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.993898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.993873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.994368 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.994342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.994469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.994423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.994469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.994424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.994509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cnch\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-kube-api-access-7cnch\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:15.995831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle podName:ef87f9aa-2980-46d8-a393-62cd410bfaf4 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:16.49579985 +0000 UTC m=+100.930587621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4") : configmap references non-existent config key: ca-bundle.crt
Jul 21 15:02:15.995905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.996481 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.995916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.996481 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.996369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.997520 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.997498    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.997962 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.997560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.997962 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.997838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.998233 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.998203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:15.999284 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:15.999258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.001446 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.001421    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6249d0f-e876-45b8-853e-fe28e39497df-metrics-tls\") pod \"dns-default-54czh\" (UID: \"b6249d0f-e876-45b8-853e-fe28e39497df\") " pod="openshift-dns/dns-default-54czh"
Jul 21 15:02:16.001542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.001466    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.001967 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.001943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.002788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.002723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.002788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.002742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.003379 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.003357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.004213 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.004002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.004213 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.004145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.004213 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.004148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.004441 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.004421    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.004503 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.004427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.005823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.005803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.009805 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.009779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cnch\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-kube-api-access-7cnch\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.150038 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.150011    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tbkbj\""
Jul 21 15:02:16.158239 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.158214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:16.171498 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.171471    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sj9xq\""
Jul 21 15:02:16.178899 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.178880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-54czh"
Jul 21 15:02:16.421457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.421428    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-54czh"]
Jul 21 15:02:16.425689 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:02:16.425662    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6249d0f_e876_45b8_853e_fe28e39497df.slice/crio-4c5dbc04c5d2c7775d5ef6dd76deaff36eb315599c9d5f03980ab60c34659711 WatchSource:0}: Error finding container 4c5dbc04c5d2c7775d5ef6dd76deaff36eb315599c9d5f03980ab60c34659711: Status 404 returned error can't find the container with id 4c5dbc04c5d2c7775d5ef6dd76deaff36eb315599c9d5f03980ab60c34659711
Jul 21 15:02:16.442143 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.442120    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c48d5b94-wk569"]
Jul 21 15:02:16.444428 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:02:16.444405    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bdd812_5e6f_46ac_b270_6d12f7078d50.slice/crio-865db49cd58d6e36417fd43d559b5b2e99d6f87edd42767a141e96e7b326ec5e WatchSource:0}: Error finding container 865db49cd58d6e36417fd43d559b5b2e99d6f87edd42767a141e96e7b326ec5e: Status 404 returned error can't find the container with id 865db49cd58d6e36417fd43d559b5b2e99d6f87edd42767a141e96e7b326ec5e
Jul 21 15:02:16.496742 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.496586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54czh" event={"ID":"b6249d0f-e876-45b8-853e-fe28e39497df","Type":"ContainerStarted","Data":"4c5dbc04c5d2c7775d5ef6dd76deaff36eb315599c9d5f03980ab60c34659711"}
Jul 21 15:02:16.497697 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.497567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c48d5b94-wk569" event={"ID":"00bdd812-5e6f-46ac-b270-6d12f7078d50","Type":"ContainerStarted","Data":"865db49cd58d6e36417fd43d559b5b2e99d6f87edd42767a141e96e7b326ec5e"}
Jul 21 15:02:16.500145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.500121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"}
Jul 21 15:02:16.500287 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.500187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"}
Jul 21 15:02:16.500656 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.500433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.501243 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.501225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.738870 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.738826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:16.897436 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:16.897369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:02:16.900499 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:02:16.900468    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef87f9aa_2980_46d8_a393_62cd410bfaf4.slice/crio-b3bac837b516ba52499431742a8bb042c4efa03060e3173b53a5d4a558aa5c5d WatchSource:0}: Error finding container b3bac837b516ba52499431742a8bb042c4efa03060e3173b53a5d4a558aa5c5d: Status 404 returned error can't find the container with id b3bac837b516ba52499431742a8bb042c4efa03060e3173b53a5d4a558aa5c5d
Jul 21 15:02:17.506660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.506637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"}
Jul 21 15:02:17.506988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.506714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"}
Jul 21 15:02:17.506988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.506763    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"}
Jul 21 15:02:17.508166 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.508142    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4" exitCode=0
Jul 21 15:02:17.508251 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.508215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"}
Jul 21 15:02:17.508309 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.508281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"b3bac837b516ba52499431742a8bb042c4efa03060e3173b53a5d4a558aa5c5d"}
Jul 21 15:02:17.509812 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.509788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c48d5b94-wk569" event={"ID":"00bdd812-5e6f-46ac-b270-6d12f7078d50","Type":"ContainerStarted","Data":"e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae"}
Jul 21 15:02:17.509972 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.509922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:17.561086 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:17.561042    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75c48d5b94-wk569" podStartSLOduration=100.561027177 podStartE2EDuration="1m40.561027177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:17.560285123 +0000 UTC m=+101.995072957" watchObservedRunningTime="2026-07-21 15:02:17.561027177 +0000 UTC m=+101.995814971"
Jul 21 15:02:18.520166 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:18.520132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerStarted","Data":"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"}
Jul 21 15:02:18.551299 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:18.551225    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.904385123 podStartE2EDuration="8.551203594s" totalImagesPullingTime="4.631423288s" totalInitContainerRuntime="15.395183ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:18.549346507 +0000 UTC m=+102.984134310" watchObservedRunningTime="2026-07-21 15:02:18.551203594 +0000 UTC m=+102.985991389"
Jul 21 15:02:20.531928 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:20.531890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54czh" event={"ID":"b6249d0f-e876-45b8-853e-fe28e39497df","Type":"ContainerStarted","Data":"36a75f5203b987f5a34de85fcbc73069dad1fc4c91a3956934fa0f370c545270"}
Jul 21 15:02:21.538008 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:21.537977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"}
Jul 21 15:02:21.538438 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:21.538063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"}
Jul 21 15:02:21.540028 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:21.539987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-54czh" event={"ID":"b6249d0f-e876-45b8-853e-fe28e39497df","Type":"ContainerStarted","Data":"a25964f913f65cebbaee8137ce9ec047b141b607e7719ed895138e91ec0d2d6c"}
Jul 21 15:02:21.540159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:21.540127    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-54czh"
Jul 21 15:02:21.557840 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:21.557793    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-54czh" podStartSLOduration=67.498772471 podStartE2EDuration="1m10.557775701s" totalImagesPullingTime="3.05900323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:21.557197243 +0000 UTC m=+105.991985039" watchObservedRunningTime="2026-07-21 15:02:21.557775701 +0000 UTC m=+105.992563500"
Jul 21 15:02:23.553948 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:23.553912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"}
Jul 21 15:02:23.554314 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:23.553975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"}
Jul 21 15:02:23.554314 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:23.553999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"}
Jul 21 15:02:23.554314 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:23.554022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerStarted","Data":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"}
Jul 21 15:02:23.587354 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:23.587300    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.345338845 podStartE2EDuration="8.587280883s" totalImagesPullingTime="5.224152524s" totalInitContainerRuntime="17.789514ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:23.584496393 +0000 UTC m=+108.019284188" watchObservedRunningTime="2026-07-21 15:02:23.587280883 +0000 UTC m=+108.022068676"
Jul 21 15:02:24.725064 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:24.725031    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c48d5b94-wk569"]
Jul 21 15:02:26.739776 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:26.739746    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:02:27.037506 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:27.037484    2562 scope.go:117] "RemoveContainer" containerID="9824e697f3e72a03898540a6a57a6415c130fcc59c9fe4fc4e26aa343d37d3e7"
Jul 21 15:02:27.571208 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:27.571181    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:02:27.571354 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:27.571314    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-bzh44" event={"ID":"40e1eb9b-84a5-44a4-be8d-3dc969a932ca","Type":"ContainerStarted","Data":"0d0e5c2e5c4f5db6ba5c4569848d6ca17da01a2a4da640adae5283798ddf600b"}
Jul 21 15:02:27.571634 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:27.571593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:02:28.550328 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:28.550300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-bzh44"
Jul 21 15:02:31.547736 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:31.547706    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-54czh"
Jul 21 15:02:34.731166 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:34.731141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:41.626741 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:41.626706    2562 generic.go:356] "Generic (PLEG): container finished" podID="239c3963-5483-4a5a-90f3-510fb2df1ce3" containerID="ade217dcc98fc262bec3a97fbf9ebece15ca33c30e0f87a9fcc676a0130499f0" exitCode=0
Jul 21 15:02:41.627148 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:41.626779    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6" event={"ID":"239c3963-5483-4a5a-90f3-510fb2df1ce3","Type":"ContainerDied","Data":"ade217dcc98fc262bec3a97fbf9ebece15ca33c30e0f87a9fcc676a0130499f0"}
Jul 21 15:02:41.627148 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:41.627102    2562 scope.go:117] "RemoveContainer" containerID="ade217dcc98fc262bec3a97fbf9ebece15ca33c30e0f87a9fcc676a0130499f0"
Jul 21 15:02:42.632209 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:42.632177    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-7gff6" event={"ID":"239c3963-5483-4a5a-90f3-510fb2df1ce3","Type":"ContainerStarted","Data":"ddfe4711183ef5dd876b0adc00526076f1fc37b8ea65d02a7edd258816c02bc2"}
Jul 21 15:02:45.644530 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:45.644494    2562 generic.go:356] "Generic (PLEG): container finished" podID="f6c14c70-ca1d-45e2-9c77-80dd0d95ee49" containerID="9623b5f10e353e4ebdc3b21163aeedea79fe5523e6482ea8d8f2b904c104a43f" exitCode=0
Jul 21 15:02:45.644916 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:45.644571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv" event={"ID":"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49","Type":"ContainerDied","Data":"9623b5f10e353e4ebdc3b21163aeedea79fe5523e6482ea8d8f2b904c104a43f"}
Jul 21 15:02:45.644959 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:45.644936    2562 scope.go:117] "RemoveContainer" containerID="9623b5f10e353e4ebdc3b21163aeedea79fe5523e6482ea8d8f2b904c104a43f"
Jul 21 15:02:45.971204 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:45.971119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:02:45.973680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:45.973645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d7accd1-9694-42ef-8fc8-3cc621bb0d0c-metrics-certs\") pod \"network-metrics-daemon-s667c\" (UID: \"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c\") " pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:02:46.256811 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.256726    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d8gzv\""
Jul 21 15:02:46.264376 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.264340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s667c"
Jul 21 15:02:46.407403 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.407375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s667c"]
Jul 21 15:02:46.409508 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:02:46.409480    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7accd1_9694_42ef_8fc8_3cc621bb0d0c.slice/crio-6ec7a259012b87b7112f53760adf3f101e5f75770ac0e4a7a50969c5f1b75d1e WatchSource:0}: Error finding container 6ec7a259012b87b7112f53760adf3f101e5f75770ac0e4a7a50969c5f1b75d1e: Status 404 returned error can't find the container with id 6ec7a259012b87b7112f53760adf3f101e5f75770ac0e4a7a50969c5f1b75d1e
Jul 21 15:02:46.649964 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.649924    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s667c" event={"ID":"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c","Type":"ContainerStarted","Data":"6ec7a259012b87b7112f53760adf3f101e5f75770ac0e4a7a50969c5f1b75d1e"}
Jul 21 15:02:46.651745 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.651717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-gxzdv" event={"ID":"f6c14c70-ca1d-45e2-9c77-80dd0d95ee49","Type":"ContainerStarted","Data":"f7efdab56320f5af396522183db48bf827e508dba18127555b8cc52740a3e304"}
Jul 21 15:02:46.653203 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.653176    2562 generic.go:356] "Generic (PLEG): container finished" podID="db25418d-f0c1-4b5c-a987-67df911d1e61" containerID="a95701975e26da67361021ad05dad6f21c3fada22e5b637607c4159dfb814413" exitCode=0
Jul 21 15:02:46.653319 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.653219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-s4ttv" event={"ID":"db25418d-f0c1-4b5c-a987-67df911d1e61","Type":"ContainerDied","Data":"a95701975e26da67361021ad05dad6f21c3fada22e5b637607c4159dfb814413"}
Jul 21 15:02:46.653535 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:46.653521    2562 scope.go:117] "RemoveContainer" containerID="a95701975e26da67361021ad05dad6f21c3fada22e5b637607c4159dfb814413"
Jul 21 15:02:47.659700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:47.659657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-s4ttv" event={"ID":"db25418d-f0c1-4b5c-a987-67df911d1e61","Type":"ContainerStarted","Data":"a5415e95fa8bf1704253386f2916b9e1e56b7d813e02660b272b240a5ee289a5"}
Jul 21 15:02:48.665679 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:48.665635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s667c" event={"ID":"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c","Type":"ContainerStarted","Data":"ea90d2acde346631f8410865c6371bc567c819a81ba3cfd97705734a34468c94"}
Jul 21 15:02:48.666033 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:48.665702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s667c" event={"ID":"2d7accd1-9694-42ef-8fc8-3cc621bb0d0c","Type":"ContainerStarted","Data":"d90302c8a1b12b3035c9217b5cea87391e05725d86519df38ab6e150bbe4f645"}
Jul 21 15:02:48.683781 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:48.683734    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s667c" podStartSLOduration=130.335127887 podStartE2EDuration="2m11.683718204s" totalImagesPullingTime="1.348590317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:48.682477764 +0000 UTC m=+133.117265557" watchObservedRunningTime="2026-07-21 15:02:48.683718204 +0000 UTC m=+133.118505998"
Jul 21 15:02:49.745083 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:49.745035    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75c48d5b94-wk569" podUID="00bdd812-5e6f-46ac-b270-6d12f7078d50" containerName="registry" containerID="cri-o://e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae" gracePeriod=30
Jul 21 15:02:49.996707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:49.996639    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:50.005426 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005399    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-trusted-ca\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bdd812-5e6f-46ac-b270-6d12f7078d50-ca-trust-extracted\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nmp7\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-kube-api-access-9nmp7\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005487    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-bound-sa-token\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005518    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-certificates\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005543    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005825 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005565    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-installation-pull-secrets\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005825 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-image-registry-private-configuration\") pod \"00bdd812-5e6f-46ac-b270-6d12f7078d50\" (UID: \"00bdd812-5e6f-46ac-b270-6d12f7078d50\") "
Jul 21 15:02:50.005971 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.005944    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:02:50.006056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.006014    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:02:50.008364 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.008329    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-kube-api-access-9nmp7" (OuterVolumeSpecName: "kube-api-access-9nmp7") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "kube-api-access-9nmp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:02:50.008472 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.008425    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:02:50.008472 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.008449    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:02:50.008589 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.008550    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:02:50.008589 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.008550    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:02:50.014177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.014143    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00bdd812-5e6f-46ac-b270-6d12f7078d50-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "00bdd812-5e6f-46ac-b270-6d12f7078d50" (UID: "00bdd812-5e6f-46ac-b270-6d12f7078d50"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:02:50.106597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106564    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-trusted-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106591    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00bdd812-5e6f-46ac-b270-6d12f7078d50-ca-trust-extracted\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106601    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nmp7\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-kube-api-access-9nmp7\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106633    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-bound-sa-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106642    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-certificates\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106649    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00bdd812-5e6f-46ac-b270-6d12f7078d50-registry-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106657    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-installation-pull-secrets\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.106843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.106665    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00bdd812-5e6f-46ac-b270-6d12f7078d50-image-registry-private-configuration\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:02:50.674866 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.674828    2562 generic.go:356] "Generic (PLEG): container finished" podID="00bdd812-5e6f-46ac-b270-6d12f7078d50" containerID="e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae" exitCode=0
Jul 21 15:02:50.675038 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.674871    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c48d5b94-wk569"
Jul 21 15:02:50.675038 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.674921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c48d5b94-wk569" event={"ID":"00bdd812-5e6f-46ac-b270-6d12f7078d50","Type":"ContainerDied","Data":"e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae"}
Jul 21 15:02:50.675038 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.674974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c48d5b94-wk569" event={"ID":"00bdd812-5e6f-46ac-b270-6d12f7078d50","Type":"ContainerDied","Data":"865db49cd58d6e36417fd43d559b5b2e99d6f87edd42767a141e96e7b326ec5e"}
Jul 21 15:02:50.675038 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.674996    2562 scope.go:117] "RemoveContainer" containerID="e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae"
Jul 21 15:02:50.683081 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.683065    2562 scope.go:117] "RemoveContainer" containerID="e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae"
Jul 21 15:02:50.683357 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:02:50.683338    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae\": container with ID starting with e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae not found: ID does not exist" containerID="e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae"
Jul 21 15:02:50.683402 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.683366    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae"} err="failed to get container status \"e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae\": rpc error: code = NotFound desc = could not find container \"e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae\": container with ID starting with e59907e8abcc54e8ab15a857c0171282e623849f37d7e130cfd43dbd9a4dedae not found: ID does not exist"
Jul 21 15:02:50.715857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.715824    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c48d5b94-wk569"]
Jul 21 15:02:50.717001 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:50.716980    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c48d5b94-wk569"]
Jul 21 15:02:52.042036 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:02:52.041996    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bdd812-5e6f-46ac-b270-6d12f7078d50" path="/var/lib/kubelet/pods/00bdd812-5e6f-46ac-b270-6d12f7078d50/volumes"
Jul 21 15:03:16.739943 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:16.739908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:16.756105 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:16.756081    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:16.791393 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:16.791370    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:29.915467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915380    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:03:29.916019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915737    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="alertmanager" containerID="cri-o://d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92" gracePeriod=120
Jul 21 15:03:29.916019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915800    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-metric" containerID="cri-o://924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282" gracePeriod=120
Jul 21 15:03:29.916019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915811    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-web" containerID="cri-o://b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0" gracePeriod=120
Jul 21 15:03:29.916019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915845    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy" containerID="cri-o://3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336" gracePeriod=120
Jul 21 15:03:29.916019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915865    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="prom-label-proxy" containerID="cri-o://1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88" gracePeriod=120
Jul 21 15:03:29.916019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:29.915882    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="config-reloader" containerID="cri-o://38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6" gracePeriod=120
Jul 21 15:03:30.833953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.833922    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88" exitCode=0
Jul 21 15:03:30.833953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.833947    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336" exitCode=0
Jul 21 15:03:30.833953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.833953    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6" exitCode=0
Jul 21 15:03:30.833953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.833960    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92" exitCode=0
Jul 21 15:03:30.834218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.834003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"}
Jul 21 15:03:30.834218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.834068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"}
Jul 21 15:03:30.834218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.834099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"}
Jul 21 15:03:30.834218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:30.834123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"}
Jul 21 15:03:31.164127 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.164104    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:31.256286 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-main-tls\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-web\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-out\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-tls-assets\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256408    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256731 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256438    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-metrics-client-ca\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256731 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256470    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-web-config\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256731 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256539    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-main-db\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256731 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256573    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-cluster-tls-config\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256731 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256602    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnkn4\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-kube-api-access-bnkn4\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256981 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256784    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.256981 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.256817    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-volume\") pod \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\" (UID: \"8cd4b1d1-82db-438a-bcb9-06e78f3caa40\") "
Jul 21 15:03:31.258859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.258817    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:03:31.259060 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.259008    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:31.259197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.259125    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:31.259405 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.259378    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-out" (OuterVolumeSpecName: "config-out") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:03:31.259664 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.259640    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-kube-api-access-bnkn4" (OuterVolumeSpecName: "kube-api-access-bnkn4") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "kube-api-access-bnkn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:03:31.260133 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.260106    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.260240 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.260171    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.260390 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.260372    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:03:31.260480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.260385    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-volume" (OuterVolumeSpecName: "config-volume") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.260789 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.260769    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.260872 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.260846    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.266487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.266461    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.272330 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.272305    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-web-config" (OuterVolumeSpecName: "web-config") pod "8cd4b1d1-82db-438a-bcb9-06e78f3caa40" (UID: "8cd4b1d1-82db-438a-bcb9-06e78f3caa40"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:31.358408 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358380    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-main-db\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358408 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358403    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-cluster-tls-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358408 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358412    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnkn4\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-kube-api-access-bnkn4\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358420    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358431    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358439    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-main-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358447    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358457    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358465    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-config-out\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358472    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-tls-assets\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358481    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358490    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-metrics-client-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.358591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.358498    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd4b1d1-82db-438a-bcb9-06e78f3caa40-web-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:31.841400 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841365    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282" exitCode=0
Jul 21 15:03:31.841400 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841387    2562 generic.go:356] "Generic (PLEG): container finished" podID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerID="b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0" exitCode=0
Jul 21 15:03:31.841593 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"}
Jul 21 15:03:31.841593 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841484    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:31.841593 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"}
Jul 21 15:03:31.841593 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd4b1d1-82db-438a-bcb9-06e78f3caa40","Type":"ContainerDied","Data":"cce354792fc060e4b41b2fefaa890fefdfed7646a6322eddc6c0332adfb5b70f"}
Jul 21 15:03:31.841593 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.841582    2562 scope.go:117] "RemoveContainer" containerID="1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"
Jul 21 15:03:31.849911 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.849802    2562 scope.go:117] "RemoveContainer" containerID="924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"
Jul 21 15:03:31.858549 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.858527    2562 scope.go:117] "RemoveContainer" containerID="3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"
Jul 21 15:03:31.867244 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.867220    2562 scope.go:117] "RemoveContainer" containerID="b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"
Jul 21 15:03:31.867314 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.867272    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:03:31.873701 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.873680    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:03:31.874536 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.874522    2562 scope.go:117] "RemoveContainer" containerID="38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"
Jul 21 15:03:31.881498 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.881479    2562 scope.go:117] "RemoveContainer" containerID="d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"
Jul 21 15:03:31.888351 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.888337    2562 scope.go:117] "RemoveContainer" containerID="a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"
Jul 21 15:03:31.894967 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.894954    2562 scope.go:117] "RemoveContainer" containerID="1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"
Jul 21 15:03:31.895193 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.895171    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88\": container with ID starting with 1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88 not found: ID does not exist" containerID="1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"
Jul 21 15:03:31.895263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.895205    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"} err="failed to get container status \"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88\": rpc error: code = NotFound desc = could not find container \"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88\": container with ID starting with 1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88 not found: ID does not exist"
Jul 21 15:03:31.895263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.895230    2562 scope.go:117] "RemoveContainer" containerID="924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"
Jul 21 15:03:31.895473 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.895456    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282\": container with ID starting with 924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282 not found: ID does not exist" containerID="924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"
Jul 21 15:03:31.895514 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.895479    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"} err="failed to get container status \"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282\": rpc error: code = NotFound desc = could not find container \"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282\": container with ID starting with 924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282 not found: ID does not exist"
Jul 21 15:03:31.895514 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.895494    2562 scope.go:117] "RemoveContainer" containerID="3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"
Jul 21 15:03:31.895757 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.895740    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336\": container with ID starting with 3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336 not found: ID does not exist" containerID="3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"
Jul 21 15:03:31.895804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.895764    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"} err="failed to get container status \"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336\": rpc error: code = NotFound desc = could not find container \"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336\": container with ID starting with 3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336 not found: ID does not exist"
Jul 21 15:03:31.895804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.895778    2562 scope.go:117] "RemoveContainer" containerID="b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"
Jul 21 15:03:31.896021 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.896003    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0\": container with ID starting with b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0 not found: ID does not exist" containerID="b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"
Jul 21 15:03:31.896080 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896029    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"} err="failed to get container status \"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0\": rpc error: code = NotFound desc = could not find container \"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0\": container with ID starting with b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0 not found: ID does not exist"
Jul 21 15:03:31.896080 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896050    2562 scope.go:117] "RemoveContainer" containerID="38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"
Jul 21 15:03:31.896286 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.896272    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6\": container with ID starting with 38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6 not found: ID does not exist" containerID="38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"
Jul 21 15:03:31.896457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896291    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"} err="failed to get container status \"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6\": rpc error: code = NotFound desc = could not find container \"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6\": container with ID starting with 38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6 not found: ID does not exist"
Jul 21 15:03:31.896457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896310    2562 scope.go:117] "RemoveContainer" containerID="d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"
Jul 21 15:03:31.896564 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.896538    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92\": container with ID starting with d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92 not found: ID does not exist" containerID="d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"
Jul 21 15:03:31.896600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896564    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"} err="failed to get container status \"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92\": rpc error: code = NotFound desc = could not find container \"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92\": container with ID starting with d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92 not found: ID does not exist"
Jul 21 15:03:31.896600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896577    2562 scope.go:117] "RemoveContainer" containerID="a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"
Jul 21 15:03:31.896842 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:31.896820    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d\": container with ID starting with a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d not found: ID does not exist" containerID="a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"
Jul 21 15:03:31.896909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896846    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"} err="failed to get container status \"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d\": rpc error: code = NotFound desc = could not find container \"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d\": container with ID starting with a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d not found: ID does not exist"
Jul 21 15:03:31.896909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.896864    2562 scope.go:117] "RemoveContainer" containerID="1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"
Jul 21 15:03:31.897160 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897089    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88"} err="failed to get container status \"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88\": rpc error: code = NotFound desc = could not find container \"1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88\": container with ID starting with 1b0ecbd580c2d821d02190a9426f5ff2a82f1568b16a9d6e776643854f3dbc88 not found: ID does not exist"
Jul 21 15:03:31.897160 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897108    2562 scope.go:117] "RemoveContainer" containerID="924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"
Jul 21 15:03:31.897324 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897298    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282"} err="failed to get container status \"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282\": rpc error: code = NotFound desc = could not find container \"924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282\": container with ID starting with 924b79ccd50bcea3dfb21982a40f8efaea9de5c82dbe04da1e387a2f15c8d282 not found: ID does not exist"
Jul 21 15:03:31.897369 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897326    2562 scope.go:117] "RemoveContainer" containerID="3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"
Jul 21 15:03:31.897554 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897525    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336"} err="failed to get container status \"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336\": rpc error: code = NotFound desc = could not find container \"3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336\": container with ID starting with 3aecef56ecc1fbc7eac5f34e517c96fdd69fda92d338bd7c5778845bf4fd2336 not found: ID does not exist"
Jul 21 15:03:31.897603 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897555    2562 scope.go:117] "RemoveContainer" containerID="b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"
Jul 21 15:03:31.897807 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897782    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0"} err="failed to get container status \"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0\": rpc error: code = NotFound desc = could not find container \"b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0\": container with ID starting with b41d511a3d05cc59dca75d4b5d75f9454c528a3513c45dfcee84b1191406a4d0 not found: ID does not exist"
Jul 21 15:03:31.897847 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897809    2562 scope.go:117] "RemoveContainer" containerID="38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"
Jul 21 15:03:31.898013 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.897993    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6"} err="failed to get container status \"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6\": rpc error: code = NotFound desc = could not find container \"38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6\": container with ID starting with 38a3171b11c49bc8df2f0233f9e9feab8f7b2e4fd08c5be7a922cad7fbebdad6 not found: ID does not exist"
Jul 21 15:03:31.898057 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.898014    2562 scope.go:117] "RemoveContainer" containerID="d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"
Jul 21 15:03:31.898205 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.898189    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92"} err="failed to get container status \"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92\": rpc error: code = NotFound desc = could not find container \"d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92\": container with ID starting with d9395e58c0867b2742f1657a36d47b238cb3c24677a8ae7d69099d90c9db0a92 not found: ID does not exist"
Jul 21 15:03:31.898253 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.898205    2562 scope.go:117] "RemoveContainer" containerID="a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"
Jul 21 15:03:31.898406 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.898390    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d"} err="failed to get container status \"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d\": rpc error: code = NotFound desc = could not find container \"a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d\": container with ID starting with a727d2b393db11cbea557ac3ed8cc8ab3b053475f5466e926049d9e5d330283d not found: ID does not exist"
Jul 21 15:03:31.902188 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902167    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:03:31.902496 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902480    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="prom-label-proxy"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902500    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="prom-label-proxy"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902513    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-metric"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902522    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-metric"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902541    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902550    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902563    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="init-config-reloader"
Jul 21 15:03:31.902571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902572    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="init-config-reloader"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902582    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="alertmanager"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902590    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="alertmanager"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902599    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="config-reloader"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902633    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="config-reloader"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902654    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00bdd812-5e6f-46ac-b270-6d12f7078d50" containerName="registry"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902662    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00bdd812-5e6f-46ac-b270-6d12f7078d50" containerName="registry"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902674    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-web"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902683    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-web"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902758    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="alertmanager"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902768    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902779    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00bdd812-5e6f-46ac-b270-6d12f7078d50" containerName="registry"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902790    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="config-reloader"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902800    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-web"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902809    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="kube-rbac-proxy-metric"
Jul 21 15:03:31.902922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.902818    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" containerName="prom-label-proxy"
Jul 21 15:03:31.908359 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.908342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:31.910961 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.910943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 15:03:31.911044 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911010    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 15:03:31.911044 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.910945    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 15:03:31.911178 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911164    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 15:03:31.911275 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911262    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 15:03:31.911397 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911378    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 15:03:31.911483 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 15:03:31.911561 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911548    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 15:03:31.911726 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.911709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m9xck\""
Jul 21 15:03:31.915970 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.915954    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 15:03:31.923549 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:31.923529    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:03:32.041565 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.041535    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd4b1d1-82db-438a-bcb9-06e78f3caa40" path="/var/lib/kubelet/pods/8cd4b1d1-82db-438a-bcb9-06e78f3caa40/volumes"
Jul 21 15:03:32.064951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.064925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065041 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.064968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065041 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.064989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe49db42-e118-408f-9210-0d8a242338db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065041 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe49db42-e118-408f-9210-0d8a242338db-config-out\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065136 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065136 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-web-config\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe49db42-e118-408f-9210-0d8a242338db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xqft\" (UniqueName: \"kubernetes.io/projected/fe49db42-e118-408f-9210-0d8a242338db-kube-api-access-7xqft\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe49db42-e118-408f-9210-0d8a242338db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.065368 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.065291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe49db42-e118-408f-9210-0d8a242338db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166286 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe49db42-e118-408f-9210-0d8a242338db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166286 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166286 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe49db42-e118-408f-9210-0d8a242338db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe49db42-e118-408f-9210-0d8a242338db-config-out\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-web-config\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe49db42-e118-408f-9210-0d8a242338db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xqft\" (UniqueName: \"kubernetes.io/projected/fe49db42-e118-408f-9210-0d8a242338db-kube-api-access-7xqft\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.166835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.166532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe49db42-e118-408f-9210-0d8a242338db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.167995 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.167651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe49db42-e118-408f-9210-0d8a242338db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.169547 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.169520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.169672 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.169582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe49db42-e118-408f-9210-0d8a242338db-config-out\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.169767 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.169742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-web-config\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.169881 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.169740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.169881 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.169809    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe49db42-e118-408f-9210-0d8a242338db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.169881 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.169852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe49db42-e118-408f-9210-0d8a242338db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.170158 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.170132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.170315 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.170299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.170401 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.170380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe49db42-e118-408f-9210-0d8a242338db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.170548 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.170534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.172190 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.172173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe49db42-e118-408f-9210-0d8a242338db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.179384 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.179364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xqft\" (UniqueName: \"kubernetes.io/projected/fe49db42-e118-408f-9210-0d8a242338db-kube-api-access-7xqft\") pod \"alertmanager-main-0\" (UID: \"fe49db42-e118-408f-9210-0d8a242338db\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.217895 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.217861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 15:03:32.363518 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.363485    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 15:03:32.365678 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:03:32.365651    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe49db42_e118_408f_9210_0d8a242338db.slice/crio-1ccb5363872c4beae724601804be2a80cdb485f40ba0f0b3f674eb1045def1dd WatchSource:0}: Error finding container 1ccb5363872c4beae724601804be2a80cdb485f40ba0f0b3f674eb1045def1dd: Status 404 returned error can't find the container with id 1ccb5363872c4beae724601804be2a80cdb485f40ba0f0b3f674eb1045def1dd
Jul 21 15:03:32.848895 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.848860    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe49db42-e118-408f-9210-0d8a242338db" containerID="e22ebabc90e0dff8ff6865d5538623b5d93696263228a4d066b8f0ba44dd7dd6" exitCode=0
Jul 21 15:03:32.849037 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.848942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerDied","Data":"e22ebabc90e0dff8ff6865d5538623b5d93696263228a4d066b8f0ba44dd7dd6"}
Jul 21 15:03:32.849037 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:32.849014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"1ccb5363872c4beae724601804be2a80cdb485f40ba0f0b3f674eb1045def1dd"}
Jul 21 15:03:33.858660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.858600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"7fbcb1434e46617a6807ac460acfbe25841db591c5f9fe46a7cdcf0b60e88bb1"}
Jul 21 15:03:33.859012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.858705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"94199872f3527cd5564efac0795d2a6a5cd452db373ef9a3a5907c638f36691d"}
Jul 21 15:03:33.859012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.858750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"b5f6d49d44febdd80880adc07c1405e7293c38c60944dab2e2e1fbe250f633db"}
Jul 21 15:03:33.859012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.858786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"afac68cd964e9ab845f3adf8c5fcbfea1c3dd4e961c9cf36f6a1c7bf3fa60580"}
Jul 21 15:03:33.859012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.858819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"00790eaddba59315489e1f4a6c6f2c760baf8a7995e3640fd2d872f26e3dbad9"}
Jul 21 15:03:33.859012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.858862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe49db42-e118-408f-9210-0d8a242338db","Type":"ContainerStarted","Data":"c4a914e9eb4556b53d4b57511799c601827064bce0eeb54ccab147bde7e8cdfa"}
Jul 21 15:03:33.896051 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:33.895989    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.879388376 podStartE2EDuration="2.895967787s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.579411ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:33.894179485 +0000 UTC m=+178.328967279" watchObservedRunningTime="2026-07-21 15:03:33.895967787 +0000 UTC m=+178.330755580"
Jul 21 15:03:34.276444 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276354    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:03:34.276738 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276696    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277" gracePeriod=600
Jul 21 15:03:34.276738 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276716    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="thanos-sidecar" containerID="cri-o://061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742" gracePeriod=600
Jul 21 15:03:34.276949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276753    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="config-reloader" containerID="cri-o://d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023" gracePeriod=600
Jul 21 15:03:34.276949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276691    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="prometheus" containerID="cri-o://339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f" gracePeriod=600
Jul 21 15:03:34.276949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276723    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-web" containerID="cri-o://8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4" gracePeriod=600
Jul 21 15:03:34.276949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.276691    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy" containerID="cri-o://b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494" gracePeriod=600
Jul 21 15:03:34.537523 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.537468    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:34.689276 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689246    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-0\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689288    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-2\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689305    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689348    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-serving-certs-ca-bundle\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689477    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-thanos-prometheus-http-client-file\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689534    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cnch\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-kube-api-access-7cnch\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689564    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-web-config\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689599    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-grpc-tls\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-kube-rbac-proxy\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689685    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-tls\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.689733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689709    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-1\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689730    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689761    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689801    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-metrics-client-ca\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config-out\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689965    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-metrics-client-certs\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.689995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-tls-assets\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690020    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690016    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.690056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690051    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-db\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690074    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.690471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690080    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-kubelet-serving-ca-bundle\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\" (UID: \"ef87f9aa-2980-46d8-a393-62cd410bfaf4\") "
Jul 21 15:03:34.690471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690398    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.690687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690659    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.690687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690679    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.690784 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690694    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.690784 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690708    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.690784 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690722    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.690925 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.690789    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.691144 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.691117    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:03:34.692859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.692598    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-kube-api-access-7cnch" (OuterVolumeSpecName: "kube-api-access-7cnch") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "kube-api-access-7cnch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:03:34.692859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.692651    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.692859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.692787    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.693061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.692971    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config-out" (OuterVolumeSpecName: "config-out") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:03:34.693061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.693050    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.693332 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.693224    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.693517 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.693484    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.693863 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.693839    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:03:34.693957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.693924    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:03:34.694662 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.694642    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.694796 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.694776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.695496 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.695481    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config" (OuterVolumeSpecName: "config") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.705451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.705431    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-web-config" (OuterVolumeSpecName: "web-config") pod "ef87f9aa-2980-46d8-a393-62cd410bfaf4" (UID: "ef87f9aa-2980-46d8-a393-62cd410bfaf4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:03:34.791855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791792    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.791855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791816    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.791855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791827    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.791855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791836    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cnch\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-kube-api-access-7cnch\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.791855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791845    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-web-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.791855 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791853    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-grpc-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791861    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-kube-rbac-proxy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791869    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791877    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef87f9aa-2980-46d8-a393-62cd410bfaf4-configmap-metrics-client-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791885    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config-out\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791894    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-metrics-client-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791901    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef87f9aa-2980-46d8-a393-62cd410bfaf4-tls-assets\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791909    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791916    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef87f9aa-2980-46d8-a393-62cd410bfaf4-prometheus-k8s-db\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.792093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.791923    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef87f9aa-2980-46d8-a393-62cd410bfaf4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:03:34.865426 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865400    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277" exitCode=0
Jul 21 15:03:34.865426 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865423    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494" exitCode=0
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865432    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4" exitCode=0
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865440    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742" exitCode=0
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865448    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023" exitCode=0
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865455    2562 generic.go:356] "Generic (PLEG): container finished" podID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f" exitCode=0
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865478    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"}
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"}
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"}
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"}
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865650    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"}
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"}
Jul 21 15:03:34.865875 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.865737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef87f9aa-2980-46d8-a393-62cd410bfaf4","Type":"ContainerDied","Data":"b3bac837b516ba52499431742a8bb042c4efa03060e3173b53a5d4a558aa5c5d"}
Jul 21 15:03:34.873700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.873671    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.881526 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.881506    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.888104 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.888090    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.894669 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.894652    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.898076 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.898058    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:03:34.901733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.901716    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.905303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.905284    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:03:34.909414 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.909397    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.915896 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.915875    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.916143 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.916124    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.916227 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916156    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"} err="failed to get container status \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist"
Jul 21 15:03:34.916227 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916179    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.916397 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.916380    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.916455 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916404    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"} err="failed to get container status \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist"
Jul 21 15:03:34.916455 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916424    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.916674 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.916656    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.916727 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916680    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"} err="failed to get container status \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist"
Jul 21 15:03:34.916727 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916694    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.916900 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.916881    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.916956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916906    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"} err="failed to get container status \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist"
Jul 21 15:03:34.916956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.916925    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.917154 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.917130    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.917190 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917161    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"} err="failed to get container status \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist"
Jul 21 15:03:34.917190 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917174    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.917419 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.917402    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.917460 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917425    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"} err="failed to get container status \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist"
Jul 21 15:03:34.917460 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917451    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.917669 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:03:34.917655    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.917721 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917672    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"} err="failed to get container status \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist"
Jul 21 15:03:34.917721 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917684    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.917928 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917913    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"} err="failed to get container status \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist"
Jul 21 15:03:34.917976 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.917929    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.918132 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918117    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"} err="failed to get container status \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist"
Jul 21 15:03:34.918132 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918131    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.918321 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918306    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"} err="failed to get container status \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist"
Jul 21 15:03:34.918362 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918321    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.918503 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918489    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"} err="failed to get container status \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist"
Jul 21 15:03:34.918503 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918503    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.918693 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918678    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"} err="failed to get container status \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist"
Jul 21 15:03:34.918743 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918693    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.918860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918846    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"} err="failed to get container status \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist"
Jul 21 15:03:34.918903 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.918861    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.919069 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919052    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"} err="failed to get container status \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist"
Jul 21 15:03:34.919069 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919069    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.919260 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919246    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"} err="failed to get container status \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist"
Jul 21 15:03:34.919297 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919259    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.919452 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919434    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"} err="failed to get container status \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist"
Jul 21 15:03:34.919521 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919454    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.919669 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919654    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"} err="failed to get container status \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist"
Jul 21 15:03:34.919714 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919669    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.919854 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919840    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"} err="failed to get container status \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist"
Jul 21 15:03:34.919893 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.919854    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.920018 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920003    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"} err="failed to get container status \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist"
Jul 21 15:03:34.920018 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920017    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.920187 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920165    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"} err="failed to get container status \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist"
Jul 21 15:03:34.920187 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920186    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.920424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920406    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"} err="failed to get container status \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist"
Jul 21 15:03:34.920498 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920425    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.920721 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920702    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"} err="failed to get container status \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist"
Jul 21 15:03:34.920786 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920721    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.920962 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920946    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"} err="failed to get container status \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist"
Jul 21 15:03:34.921015 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.920962    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.921192 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921172    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"} err="failed to get container status \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist"
Jul 21 15:03:34.921260 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921205    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.921438 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921417    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"} err="failed to get container status \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist"
Jul 21 15:03:34.921490 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921439    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.921688 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921655    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"} err="failed to get container status \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist"
Jul 21 15:03:34.921688 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921688    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.921916 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921893    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"} err="failed to get container status \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist"
Jul 21 15:03:34.921953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.921920    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.922169 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922150    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"} err="failed to get container status \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist"
Jul 21 15:03:34.922217 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922171    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.922362 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922345    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"} err="failed to get container status \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist"
Jul 21 15:03:34.922406 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922362    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.922560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922539    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"} err="failed to get container status \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist"
Jul 21 15:03:34.922634 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922563    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.922837 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922820    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"} err="failed to get container status \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist"
Jul 21 15:03:34.922913 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.922838    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.923064 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923041    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"} err="failed to get container status \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist"
Jul 21 15:03:34.923064 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923056    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.923330 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923305    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"} err="failed to get container status \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist"
Jul 21 15:03:34.923330 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923331    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.923645 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923604    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"} err="failed to get container status \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist"
Jul 21 15:03:34.923645 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923645    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.924021 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923852    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"} err="failed to get container status \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist"
Jul 21 15:03:34.924021 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.923872    2562 scope.go:117] "RemoveContainer" containerID="a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"
Jul 21 15:03:34.924128 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924112    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277"} err="failed to get container status \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": rpc error: code = NotFound desc = could not find container \"a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277\": container with ID starting with a37a710f1ad0bc0317d5fc5ed4bab244fa6385d34b9a3d716b0f88a276a9d277 not found: ID does not exist"
Jul 21 15:03:34.924128 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924126    2562 scope.go:117] "RemoveContainer" containerID="b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"
Jul 21 15:03:34.924366 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924347    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494"} err="failed to get container status \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": rpc error: code = NotFound desc = could not find container \"b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494\": container with ID starting with b45ea7f620afc6f5f86d238416b26d4cf5ce43d575e792c1ca46c00c5f6b7494 not found: ID does not exist"
Jul 21 15:03:34.924427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924368    2562 scope.go:117] "RemoveContainer" containerID="8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"
Jul 21 15:03:34.924657 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924634    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4"} err="failed to get container status \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": rpc error: code = NotFound desc = could not find container \"8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4\": container with ID starting with 8b7018d927fd6dd4f1af6bd332dbcfabdd0ec5ed70fc883b06a75671652fcea4 not found: ID does not exist"
Jul 21 15:03:34.924657 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924656    2562 scope.go:117] "RemoveContainer" containerID="061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"
Jul 21 15:03:34.924922 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924903    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742"} err="failed to get container status \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": rpc error: code = NotFound desc = could not find container \"061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742\": container with ID starting with 061a4b44e4b29c7f6ff1f75c590a930e40c5c649db482382f7b0180298065742 not found: ID does not exist"
Jul 21 15:03:34.925000 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.924922    2562 scope.go:117] "RemoveContainer" containerID="d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"
Jul 21 15:03:34.925169 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.925150    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023"} err="failed to get container status \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": rpc error: code = NotFound desc = could not find container \"d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023\": container with ID starting with d1c2792a05cfbea9940efdf89d4e5ea1debecb9a83d1dc72cfe6860102d74023 not found: ID does not exist"
Jul 21 15:03:34.925229 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.925170    2562 scope.go:117] "RemoveContainer" containerID="339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"
Jul 21 15:03:34.925403 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.925387    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f"} err="failed to get container status \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": rpc error: code = NotFound desc = could not find container \"339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f\": container with ID starting with 339ad039440fcbce49007e9d4f06a635bbdcc08b12b5c174eb28c2cf0c44e48f not found: ID does not exist"
Jul 21 15:03:34.925461 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.925405    2562 scope.go:117] "RemoveContainer" containerID="a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"
Jul 21 15:03:34.925673 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.925648    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4"} err="failed to get container status \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": rpc error: code = NotFound desc = could not find container \"a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4\": container with ID starting with a263d24bbf01c2be3ad2602ce13a022cf15f333d14be2ad5c2a5359926f91df4 not found: ID does not exist"
Jul 21 15:03:34.933646 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.933599    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:03:34.934035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934017    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="init-config-reloader"
Jul 21 15:03:34.934072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934041    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="init-config-reloader"
Jul 21 15:03:34.934072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934057    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="prometheus"
Jul 21 15:03:34.934072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934068    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="prometheus"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934081    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934091    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934111    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-thanos"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934119    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-thanos"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934138    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="config-reloader"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934146    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="config-reloader"
Jul 21 15:03:34.934159 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934159    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="thanos-sidecar"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934167    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="thanos-sidecar"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934175    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-web"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934183    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-web"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934259    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="thanos-sidecar"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934272    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="prometheus"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934284    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-thanos"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934294    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy-web"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934303    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="kube-rbac-proxy"
Jul 21 15:03:34.934346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.934311    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" containerName="config-reloader"
Jul 21 15:03:34.940040 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.940023    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:34.942663 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.942629    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 15:03:34.942769 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.942645    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 15:03:34.942830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.942787    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 15:03:34.942830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.942787    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 15:03:34.943056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 15:03:34.943182 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943118    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 15:03:34.943182 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 15:03:34.943324 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 15:03:34.943522 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943503    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pgp6l\""
Jul 21 15:03:34.944134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943712    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 15:03:34.944134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943740    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9eov844v6uk59\""
Jul 21 15:03:34.944134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 15:03:34.944134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943752    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 15:03:34.944134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 15:03:34.944134 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.943891    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 15:03:34.946436 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.946417    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 15:03:34.952557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.952538    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 15:03:34.959141 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:34.958442    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:03:35.093487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/867bf4de-a066-4f28-adc9-d1b660d6b662-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zms7v\" (UniqueName: \"kubernetes.io/projected/867bf4de-a066-4f28-adc9-d1b660d6b662-kube-api-access-zms7v\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/867bf4de-a066-4f28-adc9-d1b660d6b662-config-out\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-web-config\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.093823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.094201 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.094201 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.094201 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-config\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.094201 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.093917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195147 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-web-config\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195552 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195639 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195639 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-config\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195748 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195748 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195748 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/867bf4de-a066-4f28-adc9-d1b660d6b662-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.195910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zms7v\" (UniqueName: \"kubernetes.io/projected/867bf4de-a066-4f28-adc9-d1b660d6b662-kube-api-access-zms7v\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.196320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.195998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/867bf4de-a066-4f28-adc9-d1b660d6b662-config-out\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.196320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.196107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.196320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.196199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.196729 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.196705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.197122 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.197062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.198377 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.198352    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.198500 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.198449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.198591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.198532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.198714 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.198538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-web-config\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.198847 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.198813    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.199509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.199388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/867bf4de-a066-4f28-adc9-d1b660d6b662-config-out\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.199591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.199566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.200193 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.199849    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.200193 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.199944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/867bf4de-a066-4f28-adc9-d1b660d6b662-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.200370 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.200220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.200756 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.200732    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/867bf4de-a066-4f28-adc9-d1b660d6b662-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.200888 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.200870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.201252 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.201231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-config\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.201826 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.201805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.201938 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.201922    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/867bf4de-a066-4f28-adc9-d1b660d6b662-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.208742 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.208724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zms7v\" (UniqueName: \"kubernetes.io/projected/867bf4de-a066-4f28-adc9-d1b660d6b662-kube-api-access-zms7v\") pod \"prometheus-k8s-0\" (UID: \"867bf4de-a066-4f28-adc9-d1b660d6b662\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.250798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.250768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:03:35.396935 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.396849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 15:03:35.399253 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:03:35.399228    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867bf4de_a066_4f28_adc9_d1b660d6b662.slice/crio-81fa7e2bd413971ef626c461b2c10dda20f700c1cf04bcdcdf5fc8dd8ff6eeac WatchSource:0}: Error finding container 81fa7e2bd413971ef626c461b2c10dda20f700c1cf04bcdcdf5fc8dd8ff6eeac: Status 404 returned error can't find the container with id 81fa7e2bd413971ef626c461b2c10dda20f700c1cf04bcdcdf5fc8dd8ff6eeac
Jul 21 15:03:35.872914 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.872883    2562 generic.go:356] "Generic (PLEG): container finished" podID="867bf4de-a066-4f28-adc9-d1b660d6b662" containerID="62fc66a95c8f35758fba06a736aeb6c0065ce40688c5a7b34b778d2619d8bd61" exitCode=0
Jul 21 15:03:35.873405 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.872952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerDied","Data":"62fc66a95c8f35758fba06a736aeb6c0065ce40688c5a7b34b778d2619d8bd61"}
Jul 21 15:03:35.873405 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:35.872999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"81fa7e2bd413971ef626c461b2c10dda20f700c1cf04bcdcdf5fc8dd8ff6eeac"}
Jul 21 15:03:36.043551 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.043520    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef87f9aa-2980-46d8-a393-62cd410bfaf4" path="/var/lib/kubelet/pods/ef87f9aa-2980-46d8-a393-62cd410bfaf4/volumes"
Jul 21 15:03:36.880090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.880053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"1efe7e24433c4e25347a1fb275b55dfeed2f58d24162c92a2f869410ec91e524"}
Jul 21 15:03:36.880529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.880151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"8e8f4e165d1a4858b8b550f6709f073f1851f9a558e8f031d4b21d61d965257a"}
Jul 21 15:03:36.880529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.880181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"1d8f6c97fe293e7e015e8b0bbfb9dfb4bd86e2fb34d98c000fd116ac21e06b1a"}
Jul 21 15:03:36.880529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.880206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"0a144632cce358338e5b6c164336f1f6422792148f84a9f4fc82a4d679d1dd7f"}
Jul 21 15:03:36.880529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.880231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"873cd6ba7a1b29504c54c16993a72e3a9865f7423aae31bd90042930fa1f32f5"}
Jul 21 15:03:36.880529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.880262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"867bf4de-a066-4f28-adc9-d1b660d6b662","Type":"ContainerStarted","Data":"bc003d3a4f74b0ea2a39ea03a398b007f5bceafda608988361d2ce3b0c38a822"}
Jul 21 15:03:36.914361 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:36.914311    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.896189468 podStartE2EDuration="2.914295405s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.105937ms" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:36.911576632 +0000 UTC m=+181.346364425" watchObservedRunningTime="2026-07-21 15:03:36.914295405 +0000 UTC m=+181.349083198"
Jul 21 15:03:40.251626 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:03:40.251567    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:35.251477 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:04:35.251430    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:35.267240 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:04:35.267215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:04:36.126809 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:04:36.126781    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 15:05:35.943633 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:05:35.943583    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:05:35.948230 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:05:35.948207    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:05:35.954220 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:05:35.954200    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 15:07:42.969170 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:42.969134    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zpszt"]
Jul 21 15:07:42.972054 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:42.972035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:42.974402 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:42.974381    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ntkcw\""
Jul 21 15:07:42.974544 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:42.974412    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 15:07:42.975168 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:42.975152    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 15:07:42.982751 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:42.982730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zpszt"]
Jul 21 15:07:43.086772 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.086739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwtd8\" (UniqueName: \"kubernetes.io/projected/42a5cb68-51ec-4017-af4e-b3b32f83e078-kube-api-access-nwtd8\") pod \"cert-manager-55b4d954d5-zpszt\" (UID: \"42a5cb68-51ec-4017-af4e-b3b32f83e078\") " pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.086998 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.086945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42a5cb68-51ec-4017-af4e-b3b32f83e078-bound-sa-token\") pod \"cert-manager-55b4d954d5-zpszt\" (UID: \"42a5cb68-51ec-4017-af4e-b3b32f83e078\") " pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.187976 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.187938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42a5cb68-51ec-4017-af4e-b3b32f83e078-bound-sa-token\") pod \"cert-manager-55b4d954d5-zpszt\" (UID: \"42a5cb68-51ec-4017-af4e-b3b32f83e078\") " pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.188150 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.187985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwtd8\" (UniqueName: \"kubernetes.io/projected/42a5cb68-51ec-4017-af4e-b3b32f83e078-kube-api-access-nwtd8\") pod \"cert-manager-55b4d954d5-zpszt\" (UID: \"42a5cb68-51ec-4017-af4e-b3b32f83e078\") " pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.196752 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.196720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/42a5cb68-51ec-4017-af4e-b3b32f83e078-bound-sa-token\") pod \"cert-manager-55b4d954d5-zpszt\" (UID: \"42a5cb68-51ec-4017-af4e-b3b32f83e078\") " pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.196878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.196778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwtd8\" (UniqueName: \"kubernetes.io/projected/42a5cb68-51ec-4017-af4e-b3b32f83e078-kube-api-access-nwtd8\") pod \"cert-manager-55b4d954d5-zpszt\" (UID: \"42a5cb68-51ec-4017-af4e-b3b32f83e078\") " pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.294008 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.293978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zpszt"
Jul 21 15:07:43.429575 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.429532    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zpszt"]
Jul 21 15:07:43.432711 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:07:43.432683    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42a5cb68_51ec_4017_af4e_b3b32f83e078.slice/crio-ecd5540799792486df9580530f691715a8828222cf1eaff5170cbfecf2389a85 WatchSource:0}: Error finding container ecd5540799792486df9580530f691715a8828222cf1eaff5170cbfecf2389a85: Status 404 returned error can't find the container with id ecd5540799792486df9580530f691715a8828222cf1eaff5170cbfecf2389a85
Jul 21 15:07:43.435112 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.435093    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:07:43.826560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:43.826528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zpszt" event={"ID":"42a5cb68-51ec-4017-af4e-b3b32f83e078","Type":"ContainerStarted","Data":"ecd5540799792486df9580530f691715a8828222cf1eaff5170cbfecf2389a85"}
Jul 21 15:07:46.841106 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:46.841068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zpszt" event={"ID":"42a5cb68-51ec-4017-af4e-b3b32f83e078","Type":"ContainerStarted","Data":"dbe82c1d0942828e7db55f1b546a88b9bb410bae4d1fba9cbb63a4a1b420bfe8"}
Jul 21 15:07:46.859568 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:07:46.859465    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zpszt" podStartSLOduration=1.694806542 podStartE2EDuration="4.859449908s" totalImagesPullingTime="3.164643366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:07:46.858742964 +0000 UTC m=+431.293530759" watchObservedRunningTime="2026-07-21 15:07:46.859449908 +0000 UTC m=+431.294237702"
Jul 21 15:08:16.341114 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.341079    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"]
Jul 21 15:08:16.344534 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.344512    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.347145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.347118    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 15:08:16.347258 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.347118    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 15:08:16.347443 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.347427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 15:08:16.347525 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.347496    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fmf98\""
Jul 21 15:08:16.347584 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.347496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 15:08:16.348090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.348077    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 15:08:16.353765 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.353745    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"]
Jul 21 15:08:16.372022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.371954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr4p7\" (UniqueName: \"kubernetes.io/projected/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-kube-api-access-xr4p7\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.372022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.371997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-metrics-cert\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.372164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.372088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-manager-config\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.372164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.372114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-cert\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.472591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.472545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-manager-config\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.472591 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.472592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-cert\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.472847 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.472660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr4p7\" (UniqueName: \"kubernetes.io/projected/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-kube-api-access-xr4p7\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.472847 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.472689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-metrics-cert\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.473296 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.473272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-manager-config\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.475268 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.475243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-cert\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.475366 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.475285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-metrics-cert\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.483221 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.483199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr4p7\" (UniqueName: \"kubernetes.io/projected/0219235e-5f01-4949-b1ee-7aa5d8fd54a8-kube-api-access-xr4p7\") pod \"lws-controller-manager-795f7754-s5vk7\" (UID: \"0219235e-5f01-4949-b1ee-7aa5d8fd54a8\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.653932 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.653833    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:16.784015 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.783986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"]
Jul 21 15:08:16.787297 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:08:16.787266    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0219235e_5f01_4949_b1ee_7aa5d8fd54a8.slice/crio-19de2b798fe23c7e8d7356a26f656921b9e5cb95bcaa828c694c40b110bf7f85 WatchSource:0}: Error finding container 19de2b798fe23c7e8d7356a26f656921b9e5cb95bcaa828c694c40b110bf7f85: Status 404 returned error can't find the container with id 19de2b798fe23c7e8d7356a26f656921b9e5cb95bcaa828c694c40b110bf7f85
Jul 21 15:08:16.957024 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:16.956934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7" event={"ID":"0219235e-5f01-4949-b1ee-7aa5d8fd54a8","Type":"ContainerStarted","Data":"19de2b798fe23c7e8d7356a26f656921b9e5cb95bcaa828c694c40b110bf7f85"}
Jul 21 15:08:19.973713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:19.973595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7" event={"ID":"0219235e-5f01-4949-b1ee-7aa5d8fd54a8","Type":"ContainerStarted","Data":"c4397c18f1aa6018bc36c07bfcac28ab6427413b042c28aa76851d7a2cfda2da"}
Jul 21 15:08:19.973713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:19.973705    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:19.994010 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:19.993961    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7" podStartSLOduration=1.231241422 podStartE2EDuration="3.993947432s" totalImagesPullingTime="2.76270601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:08:19.99282891 +0000 UTC m=+464.427616703" watchObservedRunningTime="2026-07-21 15:08:19.993947432 +0000 UTC m=+464.428735225"
Jul 21 15:08:24.866735 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.866698    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"]
Jul 21 15:08:24.870436 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.870418    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:24.873229 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.873203    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 15:08:24.873341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.873247    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 15:08:24.873341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.873262    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 15:08:24.873341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.873205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8mxsl\""
Jul 21 15:08:24.873341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.873329    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 15:08:24.883743 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.883721    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"]
Jul 21 15:08:24.949997 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.949962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f395b2ee-4244-4914-87fe-14a4bc9843d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:24.950194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.950007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f395b2ee-4244-4914-87fe-14a4bc9843d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:24.950194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.950042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f395b2ee-4244-4914-87fe-14a4bc9843d2-tmp\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:24.950194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.950151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz2f4\" (UniqueName: \"kubernetes.io/projected/f395b2ee-4244-4914-87fe-14a4bc9843d2-kube-api-access-kz2f4\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:24.950324 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:24.950219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f395b2ee-4244-4914-87fe-14a4bc9843d2-manifests\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.050712 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.050673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz2f4\" (UniqueName: \"kubernetes.io/projected/f395b2ee-4244-4914-87fe-14a4bc9843d2-kube-api-access-kz2f4\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.050889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.050738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f395b2ee-4244-4914-87fe-14a4bc9843d2-manifests\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.050889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.050828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f395b2ee-4244-4914-87fe-14a4bc9843d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.050889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.050852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f395b2ee-4244-4914-87fe-14a4bc9843d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.050889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.050881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f395b2ee-4244-4914-87fe-14a4bc9843d2-tmp\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.051178 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.051148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f395b2ee-4244-4914-87fe-14a4bc9843d2-manifests\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.053349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.053326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f395b2ee-4244-4914-87fe-14a4bc9843d2-tmp\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.053544 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.053522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f395b2ee-4244-4914-87fe-14a4bc9843d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.053597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.053522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f395b2ee-4244-4914-87fe-14a4bc9843d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.062689 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.062663    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz2f4\" (UniqueName: \"kubernetes.io/projected/f395b2ee-4244-4914-87fe-14a4bc9843d2-kube-api-access-kz2f4\") pod \"opendatahub-operator-controller-manager-7d78549688-lqw6h\" (UID: \"f395b2ee-4244-4914-87fe-14a4bc9843d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.180706 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.180594    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:25.326198 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:25.326177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"]
Jul 21 15:08:25.328369 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:08:25.328342    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf395b2ee_4244_4914_87fe_14a4bc9843d2.slice/crio-1f46404d34c5ec9edf83981732e214221152a638bdfaa216b6a9c51789ad094b WatchSource:0}: Error finding container 1f46404d34c5ec9edf83981732e214221152a638bdfaa216b6a9c51789ad094b: Status 404 returned error can't find the container with id 1f46404d34c5ec9edf83981732e214221152a638bdfaa216b6a9c51789ad094b
Jul 21 15:08:26.002403 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:26.002366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h" event={"ID":"f395b2ee-4244-4914-87fe-14a4bc9843d2","Type":"ContainerStarted","Data":"1f46404d34c5ec9edf83981732e214221152a638bdfaa216b6a9c51789ad094b"}
Jul 21 15:08:29.024124 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:29.024036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h" event={"ID":"f395b2ee-4244-4914-87fe-14a4bc9843d2","Type":"ContainerStarted","Data":"8c51df5e4e87f7d49ea08c1760f408a6b07f270e6f90729c6ac7f556abb9e5de"}
Jul 21 15:08:30.029942 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:30.029904    2562 generic.go:356] "Generic (PLEG): container finished" podID="f395b2ee-4244-4914-87fe-14a4bc9843d2" containerID="8c51df5e4e87f7d49ea08c1760f408a6b07f270e6f90729c6ac7f556abb9e5de" exitCode=0
Jul 21 15:08:30.030363 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:30.029996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h" event={"ID":"f395b2ee-4244-4914-87fe-14a4bc9843d2","Type":"ContainerDied","Data":"8c51df5e4e87f7d49ea08c1760f408a6b07f270e6f90729c6ac7f556abb9e5de"}
Jul 21 15:08:30.981095 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:30.980999    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-795f7754-s5vk7"
Jul 21 15:08:31.041387 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:31.040778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h" event={"ID":"f395b2ee-4244-4914-87fe-14a4bc9843d2","Type":"ContainerStarted","Data":"8d94c4ff35cc779c535e0e16f598bf8f223e91037a50bec743b40822f36bb87c"}
Jul 21 15:08:31.041387 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:31.041195    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:08:31.063552 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:31.063480    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h" podStartSLOduration=2.196360481 podStartE2EDuration="7.063457463s" totalImagesPullingTime="3.849854892s" totalInitContainerRuntime="1.01724209s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:08:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:08:31.060988504 +0000 UTC m=+475.495776299" watchObservedRunningTime="2026-07-21 15:08:31.063457463 +0000 UTC m=+475.498245260"
Jul 21 15:08:42.047062 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:08:42.047033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-lqw6h"
Jul 21 15:09:04.490469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.490438    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"]
Jul 21 15:09:04.497499 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.497476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.500269 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.500238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 15:09:04.500417 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.500290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wt47h\""
Jul 21 15:09:04.507857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.507833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"]
Jul 21 15:09:04.588069 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588032    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"]
Jul 21 15:09:04.588484 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588532 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588579 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w88d\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-kube-api-access-5w88d\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588685 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588755 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588812 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588812 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588913 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.588913 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.588863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.590802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.590785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.605218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.605190    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"]
Jul 21 15:09:04.689763 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.689763 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w88d\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-kube-api-access-5w88d\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.689935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8hs\" (UniqueName: \"kubernetes.io/projected/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-kube-api-access-gq8hs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.690344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690792 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690475    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.690792 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.690599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.692483 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.692456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.692735 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.692717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.698646 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.698597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.698802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.698788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w88d\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-kube-api-access-5w88d\") pod \"data-science-gateway-data-science-gateway-class-548557588-jhqtp\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.790879 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.790840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.790893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.790945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.790971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.790988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.791018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8hs\" (UniqueName: \"kubernetes.io/projected/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-kube-api-access-gq8hs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791070 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.791061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791397 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.791091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791397 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.791111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791721 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.791698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.791900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.791870    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.792029 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.792014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.792089 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.792042    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.792089 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.792068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.793769 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.793747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.794097 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.794067    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.799781 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.799750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8hs\" (UniqueName: \"kubernetes.io/projected/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-kube-api-access-gq8hs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.800525 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.800503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cb7dc6-dd3a-49ea-8ccb-f6504393085a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6785gccn\" (UID: \"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.808530 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.808502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:04.900988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.900957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:04.968560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:04.968535    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"]
Jul 21 15:09:04.971083 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:09:04.971044    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299c48ee_1b1e_4358_ac11_5d5a458cc0e2.slice/crio-86eacf1838deb9d7221a96f793231488bfe84fd6277b65719c36a2050932b31b WatchSource:0}: Error finding container 86eacf1838deb9d7221a96f793231488bfe84fd6277b65719c36a2050932b31b: Status 404 returned error can't find the container with id 86eacf1838deb9d7221a96f793231488bfe84fd6277b65719c36a2050932b31b
Jul 21 15:09:05.048251 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:05.048225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"]
Jul 21 15:09:05.050507 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:09:05.050481    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cb7dc6_dd3a_49ea_8ccb_f6504393085a.slice/crio-24f4e09ad736d728a127cc6a0b20dcf927fa676b85d2f6c0791b26b0458b21bb WatchSource:0}: Error finding container 24f4e09ad736d728a127cc6a0b20dcf927fa676b85d2f6c0791b26b0458b21bb: Status 404 returned error can't find the container with id 24f4e09ad736d728a127cc6a0b20dcf927fa676b85d2f6c0791b26b0458b21bb
Jul 21 15:09:05.193485 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:05.193446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn" event={"ID":"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a","Type":"ContainerStarted","Data":"24f4e09ad736d728a127cc6a0b20dcf927fa676b85d2f6c0791b26b0458b21bb"}
Jul 21 15:09:05.194774 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:05.194748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" event={"ID":"299c48ee-1b1e-4358-ac11-5d5a458cc0e2","Type":"ContainerStarted","Data":"86eacf1838deb9d7221a96f793231488bfe84fd6277b65719c36a2050932b31b"}
Jul 21 15:09:08.103435 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.103394    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:09:08.103764 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.103473    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:09:08.103764 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.103507    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:09:08.109944 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.109902    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:09:08.110019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.109983    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:09:08.110062 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.110021    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:09:08.215158 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.215097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn" event={"ID":"b7cb7dc6-dd3a-49ea-8ccb-f6504393085a","Type":"ContainerStarted","Data":"3d81ba7f6625b48da522a5e8a192c99e8d92cf551a6575e9f3263a358b0ac36c"}
Jul 21 15:09:08.219294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.218444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" event={"ID":"299c48ee-1b1e-4358-ac11-5d5a458cc0e2","Type":"ContainerStarted","Data":"a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f"}
Jul 21 15:09:08.239412 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.239336    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn" podStartSLOduration=1.188694129 podStartE2EDuration="4.239314558s" totalImagesPullingTime="3.050620429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:08.237733955 +0000 UTC m=+512.672521761" watchObservedRunningTime="2026-07-21 15:09:08.239314558 +0000 UTC m=+512.674102350"
Jul 21 15:09:08.261681 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.261592    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" podStartSLOduration=1.12516194 podStartE2EDuration="4.26156035s" totalImagesPullingTime="3.13639841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:08.258053643 +0000 UTC m=+512.692841438" watchObservedRunningTime="2026-07-21 15:09:08.26156035 +0000 UTC m=+512.696348146"
Jul 21 15:09:08.809544 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.809504    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:08.902078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:08.902037    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:09.810868 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:09.810834    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-jhqtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 21 15:09:09.811261 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:09.810897    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 21 15:09:09.905956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:09.905928    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:10.227217 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:10.227130    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:10.228240 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:10.228225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6785gccn"
Jul 21 15:09:10.331111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:10.331083    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"]
Jul 21 15:09:10.809920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:10.809883    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-jhqtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 21 15:09:10.810093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:10.809938    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 21 15:09:11.231740 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:11.231640    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerName="istio-proxy" containerID="cri-o://a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f" gracePeriod=30
Jul 21 15:09:16.490540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.490516    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:16.607555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607520    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-certs\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.607555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-credential-socket\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.607830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607584    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w88d\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-kube-api-access-5w88d\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.607830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607637    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-podinfo\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.607830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607731    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-data\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.607830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607811    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-envoy\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.608035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607833    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-socket\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.608035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607857    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istiod-ca-cert\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.608035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607858    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:09:16.608035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607905    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-token\") pod \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\" (UID: \"299c48ee-1b1e-4358-ac11-5d5a458cc0e2\") "
Jul 21 15:09:16.608035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.607919    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:09:16.608320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608091    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:09:16.608320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608112    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:09:16.608320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608223    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:09:16.608462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608359    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-data\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.608462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608378    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.608462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608394    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istiod-ca-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.608462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608408    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-workload-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.608462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.608420    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-credential-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.610205 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.610178    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-kube-api-access-5w88d" (OuterVolumeSpecName: "kube-api-access-5w88d") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "kube-api-access-5w88d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:09:16.610331 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.610228    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 15:09:16.610486 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.610470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:09:16.610559 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.610545    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "299c48ee-1b1e-4358-ac11-5d5a458cc0e2" (UID: "299c48ee-1b1e-4358-ac11-5d5a458cc0e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:09:16.709103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.709027    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w88d\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-kube-api-access-5w88d\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.709103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.709055    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-podinfo\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.709103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.709064    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-envoy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:16.709103 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:16.709072    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/299c48ee-1b1e-4358-ac11-5d5a458cc0e2-istio-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:17.260365 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.260323    2562 generic.go:356] "Generic (PLEG): container finished" podID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerID="a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f" exitCode=0
Jul 21 15:09:17.260365 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.260369    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"
Jul 21 15:09:17.260578 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.260413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" event={"ID":"299c48ee-1b1e-4358-ac11-5d5a458cc0e2","Type":"ContainerDied","Data":"a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f"}
Jul 21 15:09:17.260578 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.260469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp" event={"ID":"299c48ee-1b1e-4358-ac11-5d5a458cc0e2","Type":"ContainerDied","Data":"86eacf1838deb9d7221a96f793231488bfe84fd6277b65719c36a2050932b31b"}
Jul 21 15:09:17.260578 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.260491    2562 scope.go:117] "RemoveContainer" containerID="a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f"
Jul 21 15:09:17.270217 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.270203    2562 scope.go:117] "RemoveContainer" containerID="a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f"
Jul 21 15:09:17.270467 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:09:17.270449    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f\": container with ID starting with a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f not found: ID does not exist" containerID="a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f"
Jul 21 15:09:17.270567 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.270476    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f"} err="failed to get container status \"a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f\": rpc error: code = NotFound desc = could not find container \"a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f\": container with ID starting with a60ad1dd94c7db65eb4583895cf476919788b2e89aee724bee40adecd305461f not found: ID does not exist"
Jul 21 15:09:17.283522 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.283498    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"]
Jul 21 15:09:17.293202 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:17.290756    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-jhqtp"]
Jul 21 15:09:18.042085 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:18.042055    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" path="/var/lib/kubelet/pods/299c48ee-1b1e-4358-ac11-5d5a458cc0e2/volumes"
Jul 21 15:09:46.810238 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.810199    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6s8pr"]
Jul 21 15:09:46.810667 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.810522    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerName="istio-proxy"
Jul 21 15:09:46.810667 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.810532    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerName="istio-proxy"
Jul 21 15:09:46.810667 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.810596    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="299c48ee-1b1e-4358-ac11-5d5a458cc0e2" containerName="istio-proxy"
Jul 21 15:09:46.816200 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.816177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:46.819502 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.819247    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 15:09:46.820139 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.820119    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-p5lkw\""
Jul 21 15:09:46.820139 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.820127    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 15:09:46.825732 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.825711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6s8pr"]
Jul 21 15:09:46.875211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.875178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jbzl\" (UniqueName: \"kubernetes.io/projected/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c-kube-api-access-9jbzl\") pod \"kuadrant-operator-catalog-6s8pr\" (UID: \"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c\") " pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:46.976695 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.976655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jbzl\" (UniqueName: \"kubernetes.io/projected/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c-kube-api-access-9jbzl\") pod \"kuadrant-operator-catalog-6s8pr\" (UID: \"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c\") " pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:46.985077 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:46.985045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jbzl\" (UniqueName: \"kubernetes.io/projected/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c-kube-api-access-9jbzl\") pod \"kuadrant-operator-catalog-6s8pr\" (UID: \"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c\") " pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:47.127594 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.127506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:47.157669 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.157638    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6s8pr"]
Jul 21 15:09:47.296218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.296199    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6s8pr"]
Jul 21 15:09:47.385504 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.385416    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ddhp"]
Jul 21 15:09:47.388641 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.388597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:47.391680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.391651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr" event={"ID":"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c","Type":"ContainerStarted","Data":"b33b135f2499f0e1269af85f68dfb7af747ae241e37815f78e6ad8065c84888c"}
Jul 21 15:09:47.399142 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.399119    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ddhp"]
Jul 21 15:09:47.480859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.480824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6tc\" (UniqueName: \"kubernetes.io/projected/13470c67-c9be-4330-a1f4-e2517db4330c-kube-api-access-wk6tc\") pod \"kuadrant-operator-catalog-5ddhp\" (UID: \"13470c67-c9be-4330-a1f4-e2517db4330c\") " pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:47.581537 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.581504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6tc\" (UniqueName: \"kubernetes.io/projected/13470c67-c9be-4330-a1f4-e2517db4330c-kube-api-access-wk6tc\") pod \"kuadrant-operator-catalog-5ddhp\" (UID: \"13470c67-c9be-4330-a1f4-e2517db4330c\") " pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:47.590828 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.590801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6tc\" (UniqueName: \"kubernetes.io/projected/13470c67-c9be-4330-a1f4-e2517db4330c-kube-api-access-wk6tc\") pod \"kuadrant-operator-catalog-5ddhp\" (UID: \"13470c67-c9be-4330-a1f4-e2517db4330c\") " pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:47.698777 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.698681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:47.840323 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:47.840298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5ddhp"]
Jul 21 15:09:47.842644 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:09:47.842596    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13470c67_c9be_4330_a1f4_e2517db4330c.slice/crio-3530eb0bf1fd55166441e130d7a4858693c62fe26d8a1d06ad77e78a0767aaec WatchSource:0}: Error finding container 3530eb0bf1fd55166441e130d7a4858693c62fe26d8a1d06ad77e78a0767aaec: Status 404 returned error can't find the container with id 3530eb0bf1fd55166441e130d7a4858693c62fe26d8a1d06ad77e78a0767aaec
Jul 21 15:09:48.397218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:48.397186    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp" event={"ID":"13470c67-c9be-4330-a1f4-e2517db4330c","Type":"ContainerStarted","Data":"3530eb0bf1fd55166441e130d7a4858693c62fe26d8a1d06ad77e78a0767aaec"}
Jul 21 15:09:50.408889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.408781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr" event={"ID":"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c","Type":"ContainerStarted","Data":"d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7"}
Jul 21 15:09:50.408889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.408875    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr" podUID="bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" containerName="registry-server" containerID="cri-o://d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7" gracePeriod=2
Jul 21 15:09:50.410494 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.410471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp" event={"ID":"13470c67-c9be-4330-a1f4-e2517db4330c","Type":"ContainerStarted","Data":"b9b8ed58f1ae9f01076d615ae22a07335e106b33f42538e7fb074e1b78550f3d"}
Jul 21 15:09:50.433858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.433814    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr" podStartSLOduration=1.674333309 podStartE2EDuration="4.433799154s" totalImagesPullingTime="2.759465845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:50.43232637 +0000 UTC m=+554.867114190" watchObservedRunningTime="2026-07-21 15:09:50.433799154 +0000 UTC m=+554.868586948"
Jul 21 15:09:50.451492 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.451444    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp" podStartSLOduration=1.234484527 podStartE2EDuration="3.451428127s" totalImagesPullingTime="2.2169436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:50.450513043 +0000 UTC m=+554.885300837" watchObservedRunningTime="2026-07-21 15:09:50.451428127 +0000 UTC m=+554.886215921"
Jul 21 15:09:50.661029 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.660970    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:50.713369 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.713341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jbzl\" (UniqueName: \"kubernetes.io/projected/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c-kube-api-access-9jbzl\") pod \"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c\" (UID: \"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c\") "
Jul 21 15:09:50.715587 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.715565    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c-kube-api-access-9jbzl" (OuterVolumeSpecName: "kube-api-access-9jbzl") pod "bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" (UID: "bbaa7abb-ebe8-44c6-bfe5-a8635c84706c"). InnerVolumeSpecName "kube-api-access-9jbzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:09:50.813979 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:50.813943    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jbzl\" (UniqueName: \"kubernetes.io/projected/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c-kube-api-access-9jbzl\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:09:51.416097 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.416004    2562 generic.go:356] "Generic (PLEG): container finished" podID="bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" containerID="d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7" exitCode=0
Jul 21 15:09:51.416097 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.416052    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr"
Jul 21 15:09:51.416748 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.416092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr" event={"ID":"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c","Type":"ContainerDied","Data":"d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7"}
Jul 21 15:09:51.416748 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.416139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6s8pr" event={"ID":"bbaa7abb-ebe8-44c6-bfe5-a8635c84706c","Type":"ContainerDied","Data":"b33b135f2499f0e1269af85f68dfb7af747ae241e37815f78e6ad8065c84888c"}
Jul 21 15:09:51.416748 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.416160    2562 scope.go:117] "RemoveContainer" containerID="d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7"
Jul 21 15:09:51.425697 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.425679    2562 scope.go:117] "RemoveContainer" containerID="d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7"
Jul 21 15:09:51.425952 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:09:51.425931    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7\": container with ID starting with d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7 not found: ID does not exist" containerID="d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7"
Jul 21 15:09:51.426002 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.425966    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7"} err="failed to get container status \"d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7\": rpc error: code = NotFound desc = could not find container \"d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7\": container with ID starting with d7498acb4d7d52aa1b1d2782257c9e73a4ad0950edbfe9b1eb7cd34597f19aa7 not found: ID does not exist"
Jul 21 15:09:51.437196 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.437172    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6s8pr"]
Jul 21 15:09:51.441262 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:51.441238    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6s8pr"]
Jul 21 15:09:52.043590 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:52.043542    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" path="/var/lib/kubelet/pods/bbaa7abb-ebe8-44c6-bfe5-a8635c84706c/volumes"
Jul 21 15:09:57.699592 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:57.699554    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:57.700115 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:57.699656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:57.722915 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:57.722877    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:09:58.468683 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:09:58.468650    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5ddhp"
Jul 21 15:10:20.131491 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.131460    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"]
Jul 21 15:10:20.131904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.131822    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" containerName="registry-server"
Jul 21 15:10:20.131904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.131834    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" containerName="registry-server"
Jul 21 15:10:20.131904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.131886    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbaa7abb-ebe8-44c6-bfe5-a8635c84706c" containerName="registry-server"
Jul 21 15:10:20.133816 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.133801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:20.136458 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.136436    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ct92d\""
Jul 21 15:10:20.155673 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.155648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"]
Jul 21 15:10:20.189508 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.189474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl25c\" (UniqueName: \"kubernetes.io/projected/6ffa5cef-bb08-42b3-b8ee-ab91dc811960-kube-api-access-sl25c\") pod \"authorino-operator-75cc8d5cb7-m46lk\" (UID: \"6ffa5cef-bb08-42b3-b8ee-ab91dc811960\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:20.290367 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.290333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl25c\" (UniqueName: \"kubernetes.io/projected/6ffa5cef-bb08-42b3-b8ee-ab91dc811960-kube-api-access-sl25c\") pod \"authorino-operator-75cc8d5cb7-m46lk\" (UID: \"6ffa5cef-bb08-42b3-b8ee-ab91dc811960\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:20.299315 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.299283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl25c\" (UniqueName: \"kubernetes.io/projected/6ffa5cef-bb08-42b3-b8ee-ab91dc811960-kube-api-access-sl25c\") pod \"authorino-operator-75cc8d5cb7-m46lk\" (UID: \"6ffa5cef-bb08-42b3-b8ee-ab91dc811960\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:20.444556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.444479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:20.590072 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:20.589999    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"]
Jul 21 15:10:20.592696 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:10:20.592667    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffa5cef_bb08_42b3_b8ee_ab91dc811960.slice/crio-2f8979cb3227259b9acef4e8841e1c3aba75d0b8bc6a4eb911433c373eca141d WatchSource:0}: Error finding container 2f8979cb3227259b9acef4e8841e1c3aba75d0b8bc6a4eb911433c373eca141d: Status 404 returned error can't find the container with id 2f8979cb3227259b9acef4e8841e1c3aba75d0b8bc6a4eb911433c373eca141d
Jul 21 15:10:21.556709 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:21.556666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk" event={"ID":"6ffa5cef-bb08-42b3-b8ee-ab91dc811960","Type":"ContainerStarted","Data":"2f8979cb3227259b9acef4e8841e1c3aba75d0b8bc6a4eb911433c373eca141d"}
Jul 21 15:10:23.570046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:23.570004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk" event={"ID":"6ffa5cef-bb08-42b3-b8ee-ab91dc811960","Type":"ContainerStarted","Data":"a5db1696e1b9fe8260bf47117cdec17b55b5320fdf3f5ef259b9e89676a55fd4"}
Jul 21 15:10:23.570438 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:23.570095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:23.590214 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:23.590160    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk" podStartSLOduration=1.182408228 podStartE2EDuration="3.590147304s" totalImagesPullingTime="2.407739076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:23.589256835 +0000 UTC m=+588.024044643" watchObservedRunningTime="2026-07-21 15:10:23.590147304 +0000 UTC m=+588.024935098"
Jul 21 15:10:25.940630 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:25.940581    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"]
Jul 21 15:10:25.944882 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:25.944865    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:25.949295 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:25.949271    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 15:10:25.949529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:25.949505    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qsg26\""
Jul 21 15:10:25.966932 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:25.966908    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"]
Jul 21 15:10:26.049661 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:26.049622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf6qd\" (UniqueName: \"kubernetes.io/projected/fbc8a438-dafc-4a67-98a8-a986ce131367-kube-api-access-nf6qd\") pod \"dns-operator-controller-manager-864dd78c4c-226bl\" (UID: \"fbc8a438-dafc-4a67-98a8-a986ce131367\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:26.150683 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:26.150641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf6qd\" (UniqueName: \"kubernetes.io/projected/fbc8a438-dafc-4a67-98a8-a986ce131367-kube-api-access-nf6qd\") pod \"dns-operator-controller-manager-864dd78c4c-226bl\" (UID: \"fbc8a438-dafc-4a67-98a8-a986ce131367\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:26.159676 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:26.159655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf6qd\" (UniqueName: \"kubernetes.io/projected/fbc8a438-dafc-4a67-98a8-a986ce131367-kube-api-access-nf6qd\") pod \"dns-operator-controller-manager-864dd78c4c-226bl\" (UID: \"fbc8a438-dafc-4a67-98a8-a986ce131367\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:26.255570 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:26.255482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:26.392745 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:26.392720    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"]
Jul 21 15:10:26.394929 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:10:26.394898    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc8a438_dafc_4a67_98a8_a986ce131367.slice/crio-041b74f7eff30841c0ccfc1ab3430b3f4433efa518d445f8588856c86e99f036 WatchSource:0}: Error finding container 041b74f7eff30841c0ccfc1ab3430b3f4433efa518d445f8588856c86e99f036: Status 404 returned error can't find the container with id 041b74f7eff30841c0ccfc1ab3430b3f4433efa518d445f8588856c86e99f036
Jul 21 15:10:26.585279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:26.585245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl" event={"ID":"fbc8a438-dafc-4a67-98a8-a986ce131367","Type":"ContainerStarted","Data":"041b74f7eff30841c0ccfc1ab3430b3f4433efa518d445f8588856c86e99f036"}
Jul 21 15:10:30.107178 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.107136    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"]
Jul 21 15:10:30.110956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.110934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.113554 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.113519    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-htkq2\""
Jul 21 15:10:30.122284 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.122257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"]
Jul 21 15:10:30.195797 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.195761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rlt\" (UniqueName: \"kubernetes.io/projected/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-kube-api-access-l6rlt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.196019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.195875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.296576 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.296538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.296827 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.296648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rlt\" (UniqueName: \"kubernetes.io/projected/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-kube-api-access-l6rlt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.297113 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.297081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.306240 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.306216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rlt\" (UniqueName: \"kubernetes.io/projected/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-kube-api-access-l6rlt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.423533 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.423227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:30.577717 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.577679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"]
Jul 21 15:10:30.579599 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:10:30.579574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4f59f0_c80b_4cf2_a590_9e2cf5e6b698.slice/crio-bf37cc1fe137677d9b1e6991a65e9a32192ed0e043d9962e5961b2e4718bcbd0 WatchSource:0}: Error finding container bf37cc1fe137677d9b1e6991a65e9a32192ed0e043d9962e5961b2e4718bcbd0: Status 404 returned error can't find the container with id bf37cc1fe137677d9b1e6991a65e9a32192ed0e043d9962e5961b2e4718bcbd0
Jul 21 15:10:30.605948 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:30.605917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw" event={"ID":"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698","Type":"ContainerStarted","Data":"bf37cc1fe137677d9b1e6991a65e9a32192ed0e043d9962e5961b2e4718bcbd0"}
Jul 21 15:10:31.612393 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:31.612365    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl" event={"ID":"fbc8a438-dafc-4a67-98a8-a986ce131367","Type":"ContainerStarted","Data":"00c64e03251587d05c7a5afa66df20ed918e8553375fdb9237fa8b08307c9993"}
Jul 21 15:10:31.612749 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:31.612508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:31.646116 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:31.646062    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl" podStartSLOduration=1.531827029 podStartE2EDuration="6.646048261s" totalImagesPullingTime="5.114221232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:31.644652271 +0000 UTC m=+596.079440085" watchObservedRunningTime="2026-07-21 15:10:31.646048261 +0000 UTC m=+596.080836055"
Jul 21 15:10:34.577078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:34.577041    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m46lk"
Jul 21 15:10:35.974967 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:35.974940    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:10:35.976560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:35.976538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:10:38.654192 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:38.654152    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw" event={"ID":"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698","Type":"ContainerStarted","Data":"0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b"}
Jul 21 15:10:38.654576 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:38.654289    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:38.673675 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:38.673592    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw" podStartSLOduration=1.339178485 podStartE2EDuration="8.673570817s" totalImagesPullingTime="7.334392332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:38.672323932 +0000 UTC m=+603.107111747" watchObservedRunningTime="2026-07-21 15:10:38.673570817 +0000 UTC m=+603.108358611"
Jul 21 15:10:42.619156 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:42.619123    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-226bl"
Jul 21 15:10:49.661307 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:49.661277    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:50.992744 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:50.992694    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"]
Jul 21 15:10:50.996680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:50.996657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.013984 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.013959    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"]
Jul 21 15:10:51.086333 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.086298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf64a4c8-a435-494f-9117-0a70779718d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.086522 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.086358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8zb\" (UniqueName: \"kubernetes.io/projected/cf64a4c8-a435-494f-9117-0a70779718d0-kube-api-access-7d8zb\") pod \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.187175 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.187133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf64a4c8-a435-494f-9117-0a70779718d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.187347 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.187190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8zb\" (UniqueName: \"kubernetes.io/projected/cf64a4c8-a435-494f-9117-0a70779718d0-kube-api-access-7d8zb\") pod \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.187559 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.187540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf64a4c8-a435-494f-9117-0a70779718d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.195724 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.195689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8zb\" (UniqueName: \"kubernetes.io/projected/cf64a4c8-a435-494f-9117-0a70779718d0-kube-api-access-7d8zb\") pod \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.306351 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.306308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:51.336383 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.336350    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"]
Jul 21 15:10:51.341331 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.341304    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"]
Jul 21 15:10:51.352545 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.352517    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"]
Jul 21 15:10:51.353004 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.352950    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" containerName="manager" containerID="cri-o://0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b" gracePeriod=2
Jul 21 15:10:51.355311 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.355289    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"]
Jul 21 15:10:51.358910 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.358880    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.376823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.376793    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"]
Jul 21 15:10:51.377354 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.377336    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" containerName="manager"
Jul 21 15:10:51.377354 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.377356    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" containerName="manager"
Jul 21 15:10:51.377485 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.377451    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" containerName="manager"
Jul 21 15:10:51.380401 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.380383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.403719 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.403691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"]
Jul 21 15:10:51.407001 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.406977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.407427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.407409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"]
Jul 21 15:10:51.431596 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.431555    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.434131 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.434093    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.435766 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.435708    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"]
Jul 21 15:10:51.489986 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.489955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmj89\" (UniqueName: \"kubernetes.io/projected/934ff864-5b6f-40b6-9505-b2c4024cb7f8-kube-api-access-rmj89\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh4c2\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.490145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.489993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9jqh4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.490145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.490013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr7s2\" (UniqueName: \"kubernetes.io/projected/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-kube-api-access-mr7s2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9jqh4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.490145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.490043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934ff864-5b6f-40b6-9505-b2c4024cb7f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh4c2\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.590929 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.590899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmj89\" (UniqueName: \"kubernetes.io/projected/934ff864-5b6f-40b6-9505-b2c4024cb7f8-kube-api-access-rmj89\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh4c2\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.591065 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.590942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9jqh4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.591065 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.590976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr7s2\" (UniqueName: \"kubernetes.io/projected/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-kube-api-access-mr7s2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9jqh4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.591065 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.591015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934ff864-5b6f-40b6-9505-b2c4024cb7f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh4c2\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.591417 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.591398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9jqh4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.591467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.591427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934ff864-5b6f-40b6-9505-b2c4024cb7f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh4c2\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.597570 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.597552    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.601166 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.601144    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.604988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.604961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr7s2\" (UniqueName: \"kubernetes.io/projected/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-kube-api-access-mr7s2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9jqh4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.607206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.607185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmj89\" (UniqueName: \"kubernetes.io/projected/934ff864-5b6f-40b6-9505-b2c4024cb7f8-kube-api-access-rmj89\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh4c2\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.691581 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.691549    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-extensions-socket-volume\") pod \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") "
Jul 21 15:10:51.691762 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.691656    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6rlt\" (UniqueName: \"kubernetes.io/projected/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-kube-api-access-l6rlt\") pod \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\" (UID: \"5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698\") "
Jul 21 15:10:51.692075 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.692045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" (UID: "5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:10:51.693837 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.693813    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-kube-api-access-l6rlt" (OuterVolumeSpecName: "kube-api-access-l6rlt") pod "5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" (UID: "5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698"). InnerVolumeSpecName "kube-api-access-l6rlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:10:51.714690 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.714658    2562 generic.go:356] "Generic (PLEG): container finished" podID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" containerID="0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b" exitCode=0
Jul 21 15:10:51.714781 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.714703    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.714781 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.714722    2562 scope.go:117] "RemoveContainer" containerID="0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b"
Jul 21 15:10:51.717076 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.717044    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.723827 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.723807    2562 scope.go:117] "RemoveContainer" containerID="0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b"
Jul 21 15:10:51.724085 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.724066    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b\": container with ID starting with 0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b not found: ID does not exist" containerID="0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b"
Jul 21 15:10:51.724128 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.724112    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b"} err="failed to get container status \"0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b\": rpc error: code = NotFound desc = could not find container \"0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b\": container with ID starting with 0869844c3532629e788f865a8e6e9d01250a92163d4cba6f0d625cdb96b3246b not found: ID does not exist"
Jul 21 15:10:51.724858 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:51.724836    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zm9kw\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zm9kw"
Jul 21 15:10:51.744682 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.744655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:51.750858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.750842    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:51.792453 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.792420    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-extensions-socket-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:10:51.792453 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.792451    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6rlt\" (UniqueName: \"kubernetes.io/projected/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698-kube-api-access-l6rlt\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:10:51.905883 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.905856    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"]
Jul 21 15:10:51.907633 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:10:51.907589    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934ff864_5b6f_40b6_9505_b2c4024cb7f8.slice/crio-83daef67e36f628d03d43d9aad481f1660a4d4fc6ead51141e7e6bec328810b9 WatchSource:0}: Error finding container 83daef67e36f628d03d43d9aad481f1660a4d4fc6ead51141e7e6bec328810b9: Status 404 returned error can't find the container with id 83daef67e36f628d03d43d9aad481f1660a4d4fc6ead51141e7e6bec328810b9
Jul 21 15:10:51.921528 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:51.921504    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"]
Jul 21 15:10:51.925211 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:10:51.925187    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dacc0c_a5fe_4ee8_b82a_bbc2ff43fcc4.slice/crio-d340ec21ff6550c8ee54f79708ff85e1532d4c2c5d27433c038ed3b42aeebe01 WatchSource:0}: Error finding container d340ec21ff6550c8ee54f79708ff85e1532d4c2c5d27433c038ed3b42aeebe01: Status 404 returned error can't find the container with id d340ec21ff6550c8ee54f79708ff85e1532d4c2c5d27433c038ed3b42aeebe01
Jul 21 15:10:52.043222 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.043190    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698" path="/var/lib/kubelet/pods/5e4f59f0-c80b-4cf2-a590-9e2cf5e6b698/volumes"
Jul 21 15:10:52.321666 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:52.321592    2562 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 21 15:10:52.321666 ip-10-0-128-244 kubenswrapper[2562]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-rzmd8_kuadrant-system_cf64a4c8-a435-494f-9117-0a70779718d0_0(d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-rzmd8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029" Netns:"/var/run/netns/4be9bb54-450d-4b4b-8527-75afc19830fd" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-rzmd8;K8S_POD_INFRA_CONTAINER_ID=d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029;K8S_POD_UID=cf64a4c8-a435-494f-9117-0a70779718d0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8/cf64a4c8-a435-494f-9117-0a70779718d0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8 d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8 d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-rzmd8" not found
Jul 21 15:10:52.321666 ip-10-0-128-244 kubenswrapper[2562]:         '
Jul 21 15:10:52.321666 ip-10-0-128-244 kubenswrapper[2562]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 21 15:10:52.321666 ip-10-0-128-244 kubenswrapper[2562]:  >
Jul 21 15:10:52.321949 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:52.321690    2562 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 21 15:10:52.321949 ip-10-0-128-244 kubenswrapper[2562]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-rzmd8_kuadrant-system_cf64a4c8-a435-494f-9117-0a70779718d0_0(d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-rzmd8 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029" Netns:"/var/run/netns/4be9bb54-450d-4b4b-8527-75afc19830fd" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-rzmd8;K8S_POD_INFRA_CONTAINER_ID=d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029;K8S_POD_UID=cf64a4c8-a435-494f-9117-0a70779718d0" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8/cf64a4c8-a435-494f-9117-0a70779718d0:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8 d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8 d8363f7d084523e0f832f01b1f142c3c39280f9008a05f267b0abe6f83a53029 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-rzmd8" not found
Jul 21 15:10:52.321949 ip-10-0-128-244 kubenswrapper[2562]:         '
Jul 21 15:10:52.321949 ip-10-0-128-244 kubenswrapper[2562]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 21 15:10:52.321949 ip-10-0-128-244 kubenswrapper[2562]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:52.730776 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.730743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2" event={"ID":"934ff864-5b6f-40b6-9505-b2c4024cb7f8","Type":"ContainerStarted","Data":"4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49"}
Jul 21 15:10:52.730979 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.730821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2" event={"ID":"934ff864-5b6f-40b6-9505-b2c4024cb7f8","Type":"ContainerStarted","Data":"83daef67e36f628d03d43d9aad481f1660a4d4fc6ead51141e7e6bec328810b9"}
Jul 21 15:10:52.730979 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.730874    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:10:52.733640 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.733595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:52.733767 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.733651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4" event={"ID":"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4","Type":"ContainerStarted","Data":"c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353"}
Jul 21 15:10:52.733767 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.733692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4" event={"ID":"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4","Type":"ContainerStarted","Data":"d340ec21ff6550c8ee54f79708ff85e1532d4c2c5d27433c038ed3b42aeebe01"}
Jul 21 15:10:52.733767 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.733733    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:10:52.742160 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.742142    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:52.753709 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:52.753676    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="cf64a4c8-a435-494f-9117-0a70779718d0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:52.754269 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.754235    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2" podStartSLOduration=1.754222481 podStartE2EDuration="1.754222481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:52.75137466 +0000 UTC m=+617.186162453" watchObservedRunningTime="2026-07-21 15:10:52.754222481 +0000 UTC m=+617.189010275"
Jul 21 15:10:52.793336 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.793284    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4" podStartSLOduration=1.793267014 podStartE2EDuration="1.793267014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:10:52.791789883 +0000 UTC m=+617.226577702" watchObservedRunningTime="2026-07-21 15:10:52.793267014 +0000 UTC m=+617.228054807"
Jul 21 15:10:52.804179 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.804152    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf64a4c8-a435-494f-9117-0a70779718d0-extensions-socket-volume\") pod \"cf64a4c8-a435-494f-9117-0a70779718d0\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") "
Jul 21 15:10:52.804307 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.804215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8zb\" (UniqueName: \"kubernetes.io/projected/cf64a4c8-a435-494f-9117-0a70779718d0-kube-api-access-7d8zb\") pod \"cf64a4c8-a435-494f-9117-0a70779718d0\" (UID: \"cf64a4c8-a435-494f-9117-0a70779718d0\") "
Jul 21 15:10:52.804498 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.804470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf64a4c8-a435-494f-9117-0a70779718d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf64a4c8-a435-494f-9117-0a70779718d0" (UID: "cf64a4c8-a435-494f-9117-0a70779718d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:10:52.807016 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.806992    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf64a4c8-a435-494f-9117-0a70779718d0-kube-api-access-7d8zb" (OuterVolumeSpecName: "kube-api-access-7d8zb") pod "cf64a4c8-a435-494f-9117-0a70779718d0" (UID: "cf64a4c8-a435-494f-9117-0a70779718d0"). InnerVolumeSpecName "kube-api-access-7d8zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:10:52.905895 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.905855    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf64a4c8-a435-494f-9117-0a70779718d0-extensions-socket-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:10:52.905895 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:52.905888    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d8zb\" (UniqueName: \"kubernetes.io/projected/cf64a4c8-a435-494f-9117-0a70779718d0-kube-api-access-7d8zb\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:10:53.738330 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:53.738296    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:53.741059 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:53.741032    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="cf64a4c8-a435-494f-9117-0a70779718d0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:53.746106 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:10:53.746080    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-rzmd8\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="cf64a4c8-a435-494f-9117-0a70779718d0" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rzmd8"
Jul 21 15:10:54.042964 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:10:54.042936    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf64a4c8-a435-494f-9117-0a70779718d0" path="/var/lib/kubelet/pods/cf64a4c8-a435-494f-9117-0a70779718d0/volumes"
Jul 21 15:11:03.741259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:03.741174    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:11:03.741259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:03.741253    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:11:03.852533 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:03.852497    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"]
Jul 21 15:11:03.852795 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:03.852747    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4" podUID="e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" containerName="manager" containerID="cri-o://c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353" gracePeriod=10
Jul 21 15:11:04.112773 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.112746    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:11:04.209985 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.209957    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-extensions-socket-volume\") pod \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") "
Jul 21 15:11:04.210188 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.210036    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr7s2\" (UniqueName: \"kubernetes.io/projected/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-kube-api-access-mr7s2\") pod \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\" (UID: \"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4\") "
Jul 21 15:11:04.210422 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.210392    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" (UID: "e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:11:04.212197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.212174    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-kube-api-access-mr7s2" (OuterVolumeSpecName: "kube-api-access-mr7s2") pod "e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" (UID: "e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4"). InnerVolumeSpecName "kube-api-access-mr7s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:11:04.310790 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.310759    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-extensions-socket-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:11:04.310790 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.310787    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr7s2\" (UniqueName: \"kubernetes.io/projected/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4-kube-api-access-mr7s2\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:11:04.409044 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.409000    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"]
Jul 21 15:11:04.409383 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.409371    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" containerName="manager"
Jul 21 15:11:04.409427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.409385    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" containerName="manager"
Jul 21 15:11:04.409469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.409461    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" containerName="manager"
Jul 21 15:11:04.411517 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.411499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.431779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.431750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"]
Jul 21 15:11:04.512828 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.512794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8l594\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.512998 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.512923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjjq9\" (UniqueName: \"kubernetes.io/projected/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-kube-api-access-hjjq9\") pod \"kuadrant-operator-controller-manager-86878c769f-8l594\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.613893 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.613804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjjq9\" (UniqueName: \"kubernetes.io/projected/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-kube-api-access-hjjq9\") pod \"kuadrant-operator-controller-manager-86878c769f-8l594\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.613893 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.613854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8l594\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.614188 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.614171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8l594\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.625219 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.625194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjjq9\" (UniqueName: \"kubernetes.io/projected/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-kube-api-access-hjjq9\") pod \"kuadrant-operator-controller-manager-86878c769f-8l594\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.721073 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.721027    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:04.792913 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.792882    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" containerID="c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353" exitCode=0
Jul 21 15:11:04.793343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.792928    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"
Jul 21 15:11:04.793343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.792976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4" event={"ID":"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4","Type":"ContainerDied","Data":"c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353"}
Jul 21 15:11:04.793343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.793037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4" event={"ID":"e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4","Type":"ContainerDied","Data":"d340ec21ff6550c8ee54f79708ff85e1532d4c2c5d27433c038ed3b42aeebe01"}
Jul 21 15:11:04.793343 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.793062    2562 scope.go:117] "RemoveContainer" containerID="c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353"
Jul 21 15:11:04.803465 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.803436    2562 scope.go:117] "RemoveContainer" containerID="c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353"
Jul 21 15:11:04.803770 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:11:04.803750    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353\": container with ID starting with c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353 not found: ID does not exist" containerID="c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353"
Jul 21 15:11:04.803852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.803777    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353"} err="failed to get container status \"c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353\": rpc error: code = NotFound desc = could not find container \"c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353\": container with ID starting with c481f5af8dd049e620eb072c612df510d57a48cd2792b1ff0d480ec96bc81353 not found: ID does not exist"
Jul 21 15:11:04.822505 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.822471    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"]
Jul 21 15:11:04.839178 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.839151    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9jqh4"]
Jul 21 15:11:04.885216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:04.885125    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"]
Jul 21 15:11:04.890894 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:11:04.890864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d7b2a1_3d5f_4d77_8c63_f3f25b6613fd.slice/crio-6d0a05c7583b9667dbd1220c4826b5327f02727932cc8a3dd3bc852bd0167299 WatchSource:0}: Error finding container 6d0a05c7583b9667dbd1220c4826b5327f02727932cc8a3dd3bc852bd0167299: Status 404 returned error can't find the container with id 6d0a05c7583b9667dbd1220c4826b5327f02727932cc8a3dd3bc852bd0167299
Jul 21 15:11:05.799007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:05.798968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594" event={"ID":"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd","Type":"ContainerStarted","Data":"71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194"}
Jul 21 15:11:05.799466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:05.799027    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594" event={"ID":"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd","Type":"ContainerStarted","Data":"6d0a05c7583b9667dbd1220c4826b5327f02727932cc8a3dd3bc852bd0167299"}
Jul 21 15:11:05.799466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:05.799048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:05.822982 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:05.822928    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594" podStartSLOduration=1.822913163 podStartE2EDuration="1.822913163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:05.821859212 +0000 UTC m=+630.256647008" watchObservedRunningTime="2026-07-21 15:11:05.822913163 +0000 UTC m=+630.257700956"
Jul 21 15:11:06.042981 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:06.042952    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4" path="/var/lib/kubelet/pods/e9dacc0c-a5fe-4ee8-b82a-bbc2ff43fcc4/volumes"
Jul 21 15:11:16.806945 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:16.806914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:11:16.860542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:16.860510    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"]
Jul 21 15:11:16.860746 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:16.860722    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2" podUID="934ff864-5b6f-40b6-9505-b2c4024cb7f8" containerName="manager" containerID="cri-o://4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49" gracePeriod=10
Jul 21 15:11:17.112790 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.112764    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:11:17.224197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.224172    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934ff864-5b6f-40b6-9505-b2c4024cb7f8-extensions-socket-volume\") pod \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") "
Jul 21 15:11:17.224379 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.224223    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmj89\" (UniqueName: \"kubernetes.io/projected/934ff864-5b6f-40b6-9505-b2c4024cb7f8-kube-api-access-rmj89\") pod \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\" (UID: \"934ff864-5b6f-40b6-9505-b2c4024cb7f8\") "
Jul 21 15:11:17.224661 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.224634    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/934ff864-5b6f-40b6-9505-b2c4024cb7f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "934ff864-5b6f-40b6-9505-b2c4024cb7f8" (UID: "934ff864-5b6f-40b6-9505-b2c4024cb7f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:11:17.226478 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.226450    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/934ff864-5b6f-40b6-9505-b2c4024cb7f8-kube-api-access-rmj89" (OuterVolumeSpecName: "kube-api-access-rmj89") pod "934ff864-5b6f-40b6-9505-b2c4024cb7f8" (UID: "934ff864-5b6f-40b6-9505-b2c4024cb7f8"). InnerVolumeSpecName "kube-api-access-rmj89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:11:17.325307 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.325276    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934ff864-5b6f-40b6-9505-b2c4024cb7f8-extensions-socket-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:11:17.325307 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.325305    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmj89\" (UniqueName: \"kubernetes.io/projected/934ff864-5b6f-40b6-9505-b2c4024cb7f8-kube-api-access-rmj89\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:11:17.863543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.863511    2562 generic.go:356] "Generic (PLEG): container finished" podID="934ff864-5b6f-40b6-9505-b2c4024cb7f8" containerID="4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49" exitCode=0
Jul 21 15:11:17.864007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.863570    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"
Jul 21 15:11:17.864007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.863603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2" event={"ID":"934ff864-5b6f-40b6-9505-b2c4024cb7f8","Type":"ContainerDied","Data":"4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49"}
Jul 21 15:11:17.864007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.863697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2" event={"ID":"934ff864-5b6f-40b6-9505-b2c4024cb7f8","Type":"ContainerDied","Data":"83daef67e36f628d03d43d9aad481f1660a4d4fc6ead51141e7e6bec328810b9"}
Jul 21 15:11:17.864007 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.863720    2562 scope.go:117] "RemoveContainer" containerID="4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49"
Jul 21 15:11:17.872657 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.872642    2562 scope.go:117] "RemoveContainer" containerID="4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49"
Jul 21 15:11:17.872904 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:11:17.872888    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49\": container with ID starting with 4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49 not found: ID does not exist" containerID="4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49"
Jul 21 15:11:17.872981 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.872911    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49"} err="failed to get container status \"4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49\": rpc error: code = NotFound desc = could not find container \"4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49\": container with ID starting with 4e8ca297b1c6718d9638cf2415b6c2114ebca0e8073b0194984939f373045e49 not found: ID does not exist"
Jul 21 15:11:17.887139 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.887111    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"]
Jul 21 15:11:17.892958 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:17.892938    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh4c2"]
Jul 21 15:11:18.042963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:18.042925    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="934ff864-5b6f-40b6-9505-b2c4024cb7f8" path="/var/lib/kubelet/pods/934ff864-5b6f-40b6-9505-b2c4024cb7f8/volumes"
Jul 21 15:11:20.339763 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.339730    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"]
Jul 21 15:11:20.340294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.340280    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="934ff864-5b6f-40b6-9505-b2c4024cb7f8" containerName="manager"
Jul 21 15:11:20.340339 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.340297    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="934ff864-5b6f-40b6-9505-b2c4024cb7f8" containerName="manager"
Jul 21 15:11:20.340384 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.340374    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="934ff864-5b6f-40b6-9505-b2c4024cb7f8" containerName="manager"
Jul 21 15:11:20.343417 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.343395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.347546 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.347525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wfqjs\""
Jul 21 15:11:20.360479 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.360456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"]
Jul 21 15:11:20.454837 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.454805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.454837 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.454849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.454885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2vg\" (UniqueName: \"kubernetes.io/projected/19e02434-3d35-4705-82df-6cbfbb463fb7-kube-api-access-wh2vg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.454942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.454987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.455004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.455022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.455061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.455265 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.455084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e02434-3d35-4705-82df-6cbfbb463fb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.555849 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.555815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.555849 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.555855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.555880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e02434-3d35-4705-82df-6cbfbb463fb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556265 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556265 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556265 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2vg\" (UniqueName: \"kubernetes.io/projected/19e02434-3d35-4705-82df-6cbfbb463fb7-kube-api-access-wh2vg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556516 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556587 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556781 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556932 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556872    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.556932 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.556902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e02434-3d35-4705-82df-6cbfbb463fb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.558303 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.558282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.558692 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.558671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.573630 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.573568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e02434-3d35-4705-82df-6cbfbb463fb7-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.573800 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.573772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2vg\" (UniqueName: \"kubernetes.io/projected/19e02434-3d35-4705-82df-6cbfbb463fb7-kube-api-access-wh2vg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-llw7b\" (UID: \"19e02434-3d35-4705-82df-6cbfbb463fb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.653985 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.653900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:20.798429 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.798403    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"]
Jul 21 15:11:20.800573 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:11:20.800547    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e02434_3d35_4705_82df_6cbfbb463fb7.slice/crio-3c1de04749ad96f2a4a33402ef670fa95e3c5ee1aef17e17d921ad9173b90dd7 WatchSource:0}: Error finding container 3c1de04749ad96f2a4a33402ef670fa95e3c5ee1aef17e17d921ad9173b90dd7: Status 404 returned error can't find the container with id 3c1de04749ad96f2a4a33402ef670fa95e3c5ee1aef17e17d921ad9173b90dd7
Jul 21 15:11:20.802484 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.802455    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:11:20.802549 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.802535    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:11:20.802590 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.802569    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:11:20.881424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.881395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" event={"ID":"19e02434-3d35-4705-82df-6cbfbb463fb7","Type":"ContainerStarted","Data":"195472c7739bfc345a73c7c52daa36b3e62f4f2d95a6a0f6bbd9943bcb1d1762"}
Jul 21 15:11:20.881582 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.881443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" event={"ID":"19e02434-3d35-4705-82df-6cbfbb463fb7","Type":"ContainerStarted","Data":"3c1de04749ad96f2a4a33402ef670fa95e3c5ee1aef17e17d921ad9173b90dd7"}
Jul 21 15:11:20.909587 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:20.909480    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" podStartSLOduration=0.90946491 podStartE2EDuration="909.46491ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:20.906769068 +0000 UTC m=+645.341556886" watchObservedRunningTime="2026-07-21 15:11:20.90946491 +0000 UTC m=+645.344252704"
Jul 21 15:11:21.654394 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:21.654358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:21.659120 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:21.659097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:21.887403 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:21.887377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:21.888170 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:21.888153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:11:36.473292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.473259    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwgw7"]
Jul 21 15:11:36.476722 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.476685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:11:36.479566 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.479544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hkqrt\""
Jul 21 15:11:36.484770 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.484749    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwgw7"]
Jul 21 15:11:36.509883 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.509852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f54bv\" (UniqueName: \"kubernetes.io/projected/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213-kube-api-access-f54bv\") pod \"authorino-75d556bd77-cwgw7\" (UID: \"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213\") " pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:11:36.610458 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.610427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f54bv\" (UniqueName: \"kubernetes.io/projected/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213-kube-api-access-f54bv\") pod \"authorino-75d556bd77-cwgw7\" (UID: \"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213\") " pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:11:36.620254 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.620231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f54bv\" (UniqueName: \"kubernetes.io/projected/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213-kube-api-access-f54bv\") pod \"authorino-75d556bd77-cwgw7\" (UID: \"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213\") " pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:11:36.786693 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.786662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:11:36.926945 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.926923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwgw7"]
Jul 21 15:11:36.928676 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:11:36.928646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc89f9d7_db14_4fa1_b3e1_b8a85ca32213.slice/crio-cbcc3fe672c8ec4535bb567f1c3b6cd53edf56839619f8ce42100d418a136b54 WatchSource:0}: Error finding container cbcc3fe672c8ec4535bb567f1c3b6cd53edf56839619f8ce42100d418a136b54: Status 404 returned error can't find the container with id cbcc3fe672c8ec4535bb567f1c3b6cd53edf56839619f8ce42100d418a136b54
Jul 21 15:11:36.958700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:36.958674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwgw7" event={"ID":"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213","Type":"ContainerStarted","Data":"cbcc3fe672c8ec4535bb567f1c3b6cd53edf56839619f8ce42100d418a136b54"}
Jul 21 15:11:40.987182 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:40.987148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwgw7" event={"ID":"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213","Type":"ContainerStarted","Data":"678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45"}
Jul 21 15:11:41.009054 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:11:41.009004    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cwgw7" podStartSLOduration=1.624242948 podStartE2EDuration="5.008986685s" totalImagesPullingTime="3.384743737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:41.008665814 +0000 UTC m=+665.443453608" watchObservedRunningTime="2026-07-21 15:11:41.008986685 +0000 UTC m=+665.443774478"
Jul 21 15:12:08.703571 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:08.703540    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwgw7"]
Jul 21 15:12:08.704118 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:08.703745    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cwgw7" podUID="fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" containerName="authorino" containerID="cri-o://678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45" gracePeriod=30
Jul 21 15:12:08.955555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:08.955499    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:12:09.110012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.109983    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f54bv\" (UniqueName: \"kubernetes.io/projected/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213-kube-api-access-f54bv\") pod \"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213\" (UID: \"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213\") "
Jul 21 15:12:09.112151 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.112120    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213-kube-api-access-f54bv" (OuterVolumeSpecName: "kube-api-access-f54bv") pod "fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" (UID: "fc89f9d7-db14-4fa1-b3e1-b8a85ca32213"). InnerVolumeSpecName "kube-api-access-f54bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:12:09.122637 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.122576    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" containerID="678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45" exitCode=0
Jul 21 15:12:09.122761 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.122637    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cwgw7"
Jul 21 15:12:09.122761 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.122665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwgw7" event={"ID":"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213","Type":"ContainerDied","Data":"678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45"}
Jul 21 15:12:09.122761 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.122712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cwgw7" event={"ID":"fc89f9d7-db14-4fa1-b3e1-b8a85ca32213","Type":"ContainerDied","Data":"cbcc3fe672c8ec4535bb567f1c3b6cd53edf56839619f8ce42100d418a136b54"}
Jul 21 15:12:09.122761 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.122729    2562 scope.go:117] "RemoveContainer" containerID="678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45"
Jul 21 15:12:09.132458 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.132440    2562 scope.go:117] "RemoveContainer" containerID="678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45"
Jul 21 15:12:09.132734 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:12:09.132714    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45\": container with ID starting with 678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45 not found: ID does not exist" containerID="678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45"
Jul 21 15:12:09.132806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.132747    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45"} err="failed to get container status \"678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45\": rpc error: code = NotFound desc = could not find container \"678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45\": container with ID starting with 678c3674759ffd6e6e63a979c40b53fe1007c4e653fbbe39377fd51eb0d49e45 not found: ID does not exist"
Jul 21 15:12:09.151464 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.151444    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwgw7"]
Jul 21 15:12:09.159210 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.159186    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cwgw7"]
Jul 21 15:12:09.211102 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:09.211045    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f54bv\" (UniqueName: \"kubernetes.io/projected/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213-kube-api-access-f54bv\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:12:10.042956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:10.042923    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" path="/var/lib/kubelet/pods/fc89f9d7-db14-4fa1-b3e1-b8a85ca32213/volumes"
Jul 21 15:12:13.454073 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.454043    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cc7d6989d-x7vf4"]
Jul 21 15:12:13.454472 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.454434    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" containerName="authorino"
Jul 21 15:12:13.454472 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.454445    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" containerName="authorino"
Jul 21 15:12:13.454562 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.454520    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc89f9d7-db14-4fa1-b3e1-b8a85ca32213" containerName="authorino"
Jul 21 15:12:13.457223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.457202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:13.459911 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.459883    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 15:12:13.460061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.460021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vgfvr\""
Jul 21 15:12:13.460899 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.460878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 15:12:13.469958 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.469935    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc7d6989d-x7vf4"]
Jul 21 15:12:13.548080 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.548046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjq6\" (UniqueName: \"kubernetes.io/projected/8c5654ce-a021-494e-8b44-ddfba3600ad4-kube-api-access-shjq6\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:13.548080 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.548081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:13.633166 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.633134    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9f676b784-26swh"]
Jul 21 15:12:13.635754 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.635733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:13.647211 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.647189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f676b784-26swh"]
Jul 21 15:12:13.649218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.649197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shjq6\" (UniqueName: \"kubernetes.io/projected/8c5654ce-a021-494e-8b44-ddfba3600ad4-kube-api-access-shjq6\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:13.649317 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.649227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:13.649448 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:12:13.649429    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 15:12:13.649516 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:12:13.649506    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert podName:8c5654ce-a021-494e-8b44-ddfba3600ad4 nodeName:}" failed. No retries permitted until 2026-07-21 15:12:14.149487078 +0000 UTC m=+698.584274865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert") pod "maas-controller-5cc7d6989d-x7vf4" (UID: "8c5654ce-a021-494e-8b44-ddfba3600ad4") : secret "maas-controller-webhook-cert" not found
Jul 21 15:12:13.666677 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.666652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjq6\" (UniqueName: \"kubernetes.io/projected/8c5654ce-a021-494e-8b44-ddfba3600ad4-kube-api-access-shjq6\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:13.750464 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.750387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:13.750464 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.750439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5pjw\" (UniqueName: \"kubernetes.io/projected/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-kube-api-access-b5pjw\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:13.851127 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.851091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5pjw\" (UniqueName: \"kubernetes.io/projected/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-kube-api-access-b5pjw\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:13.851346 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.851213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:13.851346 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:12:13.851323    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 15:12:13.851459 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:12:13.851387    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert podName:384702bb-52da-47f2-a6cc-c7fd6fbc8caa nodeName:}" failed. No retries permitted until 2026-07-21 15:12:14.351367776 +0000 UTC m=+698.786155552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert") pod "maas-controller-9f676b784-26swh" (UID: "384702bb-52da-47f2-a6cc-c7fd6fbc8caa") : secret "maas-controller-webhook-cert" not found
Jul 21 15:12:13.862848 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:13.862826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5pjw\" (UniqueName: \"kubernetes.io/projected/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-kube-api-access-b5pjw\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:14.153555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.153525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:14.155941 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.155924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert\") pod \"maas-controller-5cc7d6989d-x7vf4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") " pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:14.355187 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.355154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:14.357686 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.357653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert\") pod \"maas-controller-9f676b784-26swh\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") " pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:14.369116 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.369090    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:14.503711 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.503681    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cc7d6989d-x7vf4"]
Jul 21 15:12:14.506763 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:12:14.506737    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5654ce_a021_494e_8b44_ddfba3600ad4.slice/crio-851fc10f2bde692c18ed99e4db10ec702eae60ff89c6a76e7045540b2f466519 WatchSource:0}: Error finding container 851fc10f2bde692c18ed99e4db10ec702eae60ff89c6a76e7045540b2f466519: Status 404 returned error can't find the container with id 851fc10f2bde692c18ed99e4db10ec702eae60ff89c6a76e7045540b2f466519
Jul 21 15:12:14.546096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.546070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:14.683880 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:14.683858    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f676b784-26swh"]
Jul 21 15:12:14.687298 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:12:14.687267    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384702bb_52da_47f2_a6cc_c7fd6fbc8caa.slice/crio-55690abde021d471082f901a1de58fd575a8fd19ed4cb6253a3f3a27bf8cc77a WatchSource:0}: Error finding container 55690abde021d471082f901a1de58fd575a8fd19ed4cb6253a3f3a27bf8cc77a: Status 404 returned error can't find the container with id 55690abde021d471082f901a1de58fd575a8fd19ed4cb6253a3f3a27bf8cc77a
Jul 21 15:12:15.159205 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:15.159169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-26swh" event={"ID":"384702bb-52da-47f2-a6cc-c7fd6fbc8caa","Type":"ContainerStarted","Data":"55690abde021d471082f901a1de58fd575a8fd19ed4cb6253a3f3a27bf8cc77a"}
Jul 21 15:12:15.160505 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:15.160479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4" event={"ID":"8c5654ce-a021-494e-8b44-ddfba3600ad4","Type":"ContainerStarted","Data":"851fc10f2bde692c18ed99e4db10ec702eae60ff89c6a76e7045540b2f466519"}
Jul 21 15:12:17.172287 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:17.172184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4" event={"ID":"8c5654ce-a021-494e-8b44-ddfba3600ad4","Type":"ContainerStarted","Data":"7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff"}
Jul 21 15:12:17.172667 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:17.172299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:17.192838 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:17.192788    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4" podStartSLOduration=1.8388476580000002 podStartE2EDuration="4.192773126s" totalImagesPullingTime="2.353925468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:17.191988633 +0000 UTC m=+701.626776449" watchObservedRunningTime="2026-07-21 15:12:17.192773126 +0000 UTC m=+701.627560930"
Jul 21 15:12:18.178281 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:18.178243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-26swh" event={"ID":"384702bb-52da-47f2-a6cc-c7fd6fbc8caa","Type":"ContainerStarted","Data":"8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347"}
Jul 21 15:12:18.201419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:18.201365    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9f676b784-26swh" podStartSLOduration=2.668706495 podStartE2EDuration="5.20134922s" totalImagesPullingTime="2.532642725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:18.199273869 +0000 UTC m=+702.634061675" watchObservedRunningTime="2026-07-21 15:12:18.20134922 +0000 UTC m=+702.636137073"
Jul 21 15:12:19.183535 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:19.183509    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:28.180777 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:28.180698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:30.191105 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.191075    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:12:30.245724 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.245687    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cc7d6989d-x7vf4"]
Jul 21 15:12:30.245968 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.245946    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4" podUID="8c5654ce-a021-494e-8b44-ddfba3600ad4" containerName="manager" containerID="cri-o://7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff" gracePeriod=30
Jul 21 15:12:30.489794 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.489771    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:30.611386 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.611356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert\") pod \"8c5654ce-a021-494e-8b44-ddfba3600ad4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") "
Jul 21 15:12:30.611548 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.611463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shjq6\" (UniqueName: \"kubernetes.io/projected/8c5654ce-a021-494e-8b44-ddfba3600ad4-kube-api-access-shjq6\") pod \"8c5654ce-a021-494e-8b44-ddfba3600ad4\" (UID: \"8c5654ce-a021-494e-8b44-ddfba3600ad4\") "
Jul 21 15:12:30.613882 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.613854    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5654ce-a021-494e-8b44-ddfba3600ad4-kube-api-access-shjq6" (OuterVolumeSpecName: "kube-api-access-shjq6") pod "8c5654ce-a021-494e-8b44-ddfba3600ad4" (UID: "8c5654ce-a021-494e-8b44-ddfba3600ad4"). InnerVolumeSpecName "kube-api-access-shjq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:12:30.614033 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.613852    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8c5654ce-a021-494e-8b44-ddfba3600ad4" (UID: "8c5654ce-a021-494e-8b44-ddfba3600ad4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:12:30.712206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.712176    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shjq6\" (UniqueName: \"kubernetes.io/projected/8c5654ce-a021-494e-8b44-ddfba3600ad4-kube-api-access-shjq6\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:12:30.712206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:30.712202    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c5654ce-a021-494e-8b44-ddfba3600ad4-webhook-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:12:31.241650 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.241588    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c5654ce-a021-494e-8b44-ddfba3600ad4" containerID="7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff" exitCode=0
Jul 21 15:12:31.242078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.241662    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4"
Jul 21 15:12:31.242078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.241675    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4" event={"ID":"8c5654ce-a021-494e-8b44-ddfba3600ad4","Type":"ContainerDied","Data":"7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff"}
Jul 21 15:12:31.242078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.241736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cc7d6989d-x7vf4" event={"ID":"8c5654ce-a021-494e-8b44-ddfba3600ad4","Type":"ContainerDied","Data":"851fc10f2bde692c18ed99e4db10ec702eae60ff89c6a76e7045540b2f466519"}
Jul 21 15:12:31.242078 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.241767    2562 scope.go:117] "RemoveContainer" containerID="7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff"
Jul 21 15:12:31.251146 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.250982    2562 scope.go:117] "RemoveContainer" containerID="7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff"
Jul 21 15:12:31.251248 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:12:31.251228    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff\": container with ID starting with 7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff not found: ID does not exist" containerID="7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff"
Jul 21 15:12:31.251289 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.251260    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff"} err="failed to get container status \"7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff\": rpc error: code = NotFound desc = could not find container \"7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff\": container with ID starting with 7de7741100dbc57f84eb49ca5c7923e2392d4d183026dbf76e8368d494007dff not found: ID does not exist"
Jul 21 15:12:31.266515 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.266483    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cc7d6989d-x7vf4"]
Jul 21 15:12:31.270935 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:31.270912    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cc7d6989d-x7vf4"]
Jul 21 15:12:32.043025 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:32.042990    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c5654ce-a021-494e-8b44-ddfba3600ad4" path="/var/lib/kubelet/pods/8c5654ce-a021-494e-8b44-ddfba3600ad4/volumes"
Jul 21 15:12:49.653889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.653856    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"]
Jul 21 15:12:49.654357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.654239    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5654ce-a021-494e-8b44-ddfba3600ad4" containerName="manager"
Jul 21 15:12:49.654357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.654251    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5654ce-a021-494e-8b44-ddfba3600ad4" containerName="manager"
Jul 21 15:12:49.654357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.654317    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5654ce-a021-494e-8b44-ddfba3600ad4" containerName="manager"
Jul 21 15:12:49.658856 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.658835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.661658 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.661635    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 15:12:49.661796 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.661702    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wb62b\""
Jul 21 15:12:49.661860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.661804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 15:12:49.662480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.662457    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 15:12:49.673358 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.673327    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"]
Jul 21 15:12:49.786447 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.786407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-openshift-service-ca\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.786680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.786456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzzxl\" (UniqueName: \"kubernetes.io/projected/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-kube-api-access-hzzxl\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.786680 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.786581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-maas-api-tls\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.887639 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.887595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-openshift-service-ca\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.887806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.887654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzzxl\" (UniqueName: \"kubernetes.io/projected/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-kube-api-access-hzzxl\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.887806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.887782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-maas-api-tls\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.888199 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.888180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-openshift-service-ca\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.890482 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.890459    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-maas-api-tls\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.896687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.896662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzzxl\" (UniqueName: \"kubernetes.io/projected/c2bbb78d-7b5f-4d64-a43d-9d1d0447739e-kube-api-access-hzzxl\") pod \"maas-api-5958b6998f-4b9gg\" (UID: \"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e\") " pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:49.974562 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:49.974470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:50.136692 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.136665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"]
Jul 21 15:12:50.139088 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:12:50.139053    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2bbb78d_7b5f_4d64_a43d_9d1d0447739e.slice/crio-7dc1df19c34dbbecc2cbbdb6c858bf22464bec09357a8ef028c0b7f515e37ffd WatchSource:0}: Error finding container 7dc1df19c34dbbecc2cbbdb6c858bf22464bec09357a8ef028c0b7f515e37ffd: Status 404 returned error can't find the container with id 7dc1df19c34dbbecc2cbbdb6c858bf22464bec09357a8ef028c0b7f515e37ffd
Jul 21 15:12:50.140773 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.140755    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:12:50.208076 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.208045    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-frh4h"]
Jul 21 15:12:50.216851 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.216006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.219948 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.219919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7tqj5\""
Jul 21 15:12:50.220186 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.220155    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 15:12:50.222825 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.222792    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-frh4h"]
Jul 21 15:12:50.266237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.266202    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"]
Jul 21 15:12:50.277409 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.277377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.280221 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.280196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"]
Jul 21 15:12:50.339585 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.339549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg" event={"ID":"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e","Type":"ContainerStarted","Data":"7dc1df19c34dbbecc2cbbdb6c858bf22464bec09357a8ef028c0b7f515e37ffd"}
Jul 21 15:12:50.392207 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.392162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eeaa77e-6745-4e3c-a231-5d264c9a06e4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-frh4h\" (UID: \"0eeaa77e-6745-4e3c-a231-5d264c9a06e4\") " pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.392370 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.392289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5b4c0b-269e-47cc-81da-14d86ccc9e71-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-2ccqb\" (UID: \"cc5b4c0b-269e-47cc-81da-14d86ccc9e71\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.392370 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.392362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltlvr\" (UniqueName: \"kubernetes.io/projected/cc5b4c0b-269e-47cc-81da-14d86ccc9e71-kube-api-access-ltlvr\") pod \"payload-pre-processing-7677b774bb-2ccqb\" (UID: \"cc5b4c0b-269e-47cc-81da-14d86ccc9e71\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.392456 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.392388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppxg7\" (UniqueName: \"kubernetes.io/projected/0eeaa77e-6745-4e3c-a231-5d264c9a06e4-kube-api-access-ppxg7\") pod \"payload-processing-5bf47cd988-frh4h\" (UID: \"0eeaa77e-6745-4e3c-a231-5d264c9a06e4\") " pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.493505 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.493418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eeaa77e-6745-4e3c-a231-5d264c9a06e4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-frh4h\" (UID: \"0eeaa77e-6745-4e3c-a231-5d264c9a06e4\") " pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.493505 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.493483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5b4c0b-269e-47cc-81da-14d86ccc9e71-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-2ccqb\" (UID: \"cc5b4c0b-269e-47cc-81da-14d86ccc9e71\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.493803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.493527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltlvr\" (UniqueName: \"kubernetes.io/projected/cc5b4c0b-269e-47cc-81da-14d86ccc9e71-kube-api-access-ltlvr\") pod \"payload-pre-processing-7677b774bb-2ccqb\" (UID: \"cc5b4c0b-269e-47cc-81da-14d86ccc9e71\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.493803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.493544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxg7\" (UniqueName: \"kubernetes.io/projected/0eeaa77e-6745-4e3c-a231-5d264c9a06e4-kube-api-access-ppxg7\") pod \"payload-processing-5bf47cd988-frh4h\" (UID: \"0eeaa77e-6745-4e3c-a231-5d264c9a06e4\") " pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.494238 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.494214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc5b4c0b-269e-47cc-81da-14d86ccc9e71-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-2ccqb\" (UID: \"cc5b4c0b-269e-47cc-81da-14d86ccc9e71\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.494275 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.494249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eeaa77e-6745-4e3c-a231-5d264c9a06e4-plugins-config-volume\") pod \"payload-processing-5bf47cd988-frh4h\" (UID: \"0eeaa77e-6745-4e3c-a231-5d264c9a06e4\") " pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.502101 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.502071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltlvr\" (UniqueName: \"kubernetes.io/projected/cc5b4c0b-269e-47cc-81da-14d86ccc9e71-kube-api-access-ltlvr\") pod \"payload-pre-processing-7677b774bb-2ccqb\" (UID: \"cc5b4c0b-269e-47cc-81da-14d86ccc9e71\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.502216 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.502071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppxg7\" (UniqueName: \"kubernetes.io/projected/0eeaa77e-6745-4e3c-a231-5d264c9a06e4-kube-api-access-ppxg7\") pod \"payload-processing-5bf47cd988-frh4h\" (UID: \"0eeaa77e-6745-4e3c-a231-5d264c9a06e4\") " pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.529111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.529083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:50.590538 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.590513    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:50.686267 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.686189    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-frh4h"]
Jul 21 15:12:50.688697 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:12:50.688604    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eeaa77e_6745_4e3c_a231_5d264c9a06e4.slice/crio-0731c45fc9a390c4caca3dd519f160ef0e6a27c64ea2454d68be0a420db277f8 WatchSource:0}: Error finding container 0731c45fc9a390c4caca3dd519f160ef0e6a27c64ea2454d68be0a420db277f8: Status 404 returned error can't find the container with id 0731c45fc9a390c4caca3dd519f160ef0e6a27c64ea2454d68be0a420db277f8
Jul 21 15:12:50.763313 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:50.763288    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"]
Jul 21 15:12:50.765801 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:12:50.765766    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5b4c0b_269e_47cc_81da_14d86ccc9e71.slice/crio-a26e2b328e72a71de1779b56156a6f2d1f933b1253d3e40e0910e61a49c955e3 WatchSource:0}: Error finding container a26e2b328e72a71de1779b56156a6f2d1f933b1253d3e40e0910e61a49c955e3: Status 404 returned error can't find the container with id a26e2b328e72a71de1779b56156a6f2d1f933b1253d3e40e0910e61a49c955e3
Jul 21 15:12:51.346574 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:51.346533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb" event={"ID":"cc5b4c0b-269e-47cc-81da-14d86ccc9e71","Type":"ContainerStarted","Data":"a26e2b328e72a71de1779b56156a6f2d1f933b1253d3e40e0910e61a49c955e3"}
Jul 21 15:12:51.347821 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:51.347783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h" event={"ID":"0eeaa77e-6745-4e3c-a231-5d264c9a06e4","Type":"ContainerStarted","Data":"0731c45fc9a390c4caca3dd519f160ef0e6a27c64ea2454d68be0a420db277f8"}
Jul 21 15:12:54.367237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.367203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb" event={"ID":"cc5b4c0b-269e-47cc-81da-14d86ccc9e71","Type":"ContainerStarted","Data":"e54c7804ef217c7d13c9d46842a8132b62536d1661fbcc26e59c324c514f0823"}
Jul 21 15:12:54.367733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.367269    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:12:54.368807 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.368772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h" event={"ID":"0eeaa77e-6745-4e3c-a231-5d264c9a06e4","Type":"ContainerStarted","Data":"caa62bf52947e4be95023126e28770180edb4da8a0f616d824553250fa687eff"}
Jul 21 15:12:54.368944 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.368816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:12:54.370256 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.370234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg" event={"ID":"c2bbb78d-7b5f-4d64-a43d-9d1d0447739e","Type":"ContainerStarted","Data":"1aee9f1fdab2070ed141ef6a24304293fc17df23e521bbc5ec522a2e9d8b7b02"}
Jul 21 15:12:54.370374 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.370355    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:12:54.386745 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.386700    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb" podStartSLOduration=1.504920518 podStartE2EDuration="4.386683962s" totalImagesPullingTime="2.881763444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:54.385702365 +0000 UTC m=+738.820490179" watchObservedRunningTime="2026-07-21 15:12:54.386683962 +0000 UTC m=+738.821471749"
Jul 21 15:12:54.403274 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:54.403223    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg" podStartSLOduration=1.8531225949999999 podStartE2EDuration="5.403207273s" totalImagesPullingTime="3.550084678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:54.402138197 +0000 UTC m=+738.836925990" watchObservedRunningTime="2026-07-21 15:12:54.403207273 +0000 UTC m=+738.837995067"
Jul 21 15:12:58.391427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.391341    2562 generic.go:356] "Generic (PLEG): container finished" podID="19e02434-3d35-4705-82df-6cbfbb463fb7" containerID="195472c7739bfc345a73c7c52daa36b3e62f4f2d95a6a0f6bbd9943bcb1d1762" exitCode=0
Jul 21 15:12:58.391427 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.391415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" event={"ID":"19e02434-3d35-4705-82df-6cbfbb463fb7","Type":"ContainerDied","Data":"195472c7739bfc345a73c7c52daa36b3e62f4f2d95a6a0f6bbd9943bcb1d1762"}
Jul 21 15:12:58.391894 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.391831    2562 scope.go:117] "RemoveContainer" containerID="195472c7739bfc345a73c7c52daa36b3e62f4f2d95a6a0f6bbd9943bcb1d1762"
Jul 21 15:12:58.392900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.392876    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:12:58.392973 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.392940    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:12:58.393010 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.392971    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:12:58.417746 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:58.417698    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h" podStartSLOduration=5.420512569 podStartE2EDuration="8.417682055s" totalImagesPullingTime="2.997169486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:54.421912133 +0000 UTC m=+738.856699930" watchObservedRunningTime="2026-07-21 15:12:58.417682055 +0000 UTC m=+742.852469869"
Jul 21 15:12:59.398196 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:59.398165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" event={"ID":"19e02434-3d35-4705-82df-6cbfbb463fb7","Type":"ContainerStarted","Data":"37b4081bf971c79a0f552f954b5461108f14c692bb0704bd0adeea8ea18ba362"}
Jul 21 15:12:59.654443 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:59.654338    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:12:59.654715 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:59.654692    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-llw7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 21 15:12:59.654782 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:12:59.654751    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" podUID="19e02434-3d35-4705-82df-6cbfbb463fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 21 15:13:00.380556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:00.380527    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5958b6998f-4b9gg"
Jul 21 15:13:00.655046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:00.654955    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-llw7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 21 15:13:00.655046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:00.655014    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" podUID="19e02434-3d35-4705-82df-6cbfbb463fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 21 15:13:01.655282 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:01.655246    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-llw7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 21 15:13:01.655725 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:01.655301    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" podUID="19e02434-3d35-4705-82df-6cbfbb463fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 21 15:13:02.654530 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:02.654493    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-llw7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 21 15:13:02.654745 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:02.654553    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b" podUID="19e02434-3d35-4705-82df-6cbfbb463fb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 21 15:13:03.658501 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:03.658468    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:13:03.658949 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:03.658835    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:13:03.659603 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:03.659585    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-llw7b"
Jul 21 15:13:05.377545 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:05.377511    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-2ccqb"
Jul 21 15:13:05.378003 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:05.377669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-frh4h"
Jul 21 15:13:33.036486 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.036450    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"]
Jul 21 15:13:33.041111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.041084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.044842 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.044817    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 15:13:33.044842 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.044830    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpz6c\""
Jul 21 15:13:33.045023 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.044861    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 15:13:33.045023 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.044817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 15:13:33.050097 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.050062    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"]
Jul 21 15:13:33.229593 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.229554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.229803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.229702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.229803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.229749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.229803 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.229798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knrqm\" (UniqueName: \"kubernetes.io/projected/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-kube-api-access-knrqm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.229957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.229852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.229957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.229892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.330772 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.330677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.330772 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.330718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.330772 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.330754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.331046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.330927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.331046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.330991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.331046 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.331043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knrqm\" (UniqueName: \"kubernetes.io/projected/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-kube-api-access-knrqm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.331244 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.331221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.331323 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.331301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.331425 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.331408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.333246 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.333221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.333494 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.333478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.339782 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.339760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knrqm\" (UniqueName: \"kubernetes.io/projected/c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc-kube-api-access-knrqm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdvjz\" (UID: \"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.355654 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.355631    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:33.494185 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.494158    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"]
Jul 21 15:13:33.497027 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:13:33.496997    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b1e9fa_2544_47cc_8e95_e5ebc8e3a8fc.slice/crio-33e6ce07ef4ed4df97fc2cf13d472ff1a5734d5b607b79671f55b6eceba87c9d WatchSource:0}: Error finding container 33e6ce07ef4ed4df97fc2cf13d472ff1a5734d5b607b79671f55b6eceba87c9d: Status 404 returned error can't find the container with id 33e6ce07ef4ed4df97fc2cf13d472ff1a5734d5b607b79671f55b6eceba87c9d
Jul 21 15:13:33.567316 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:33.567281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz" event={"ID":"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc","Type":"ContainerStarted","Data":"33e6ce07ef4ed4df97fc2cf13d472ff1a5734d5b607b79671f55b6eceba87c9d"}
Jul 21 15:13:35.580049 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:35.580014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz" event={"ID":"c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc","Type":"ContainerStarted","Data":"fdac38b88bd907e99e3afb41530f3b58360478ecf2808a5f39ff97539dd5db91"}
Jul 21 15:13:35.602628 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:35.602564    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz" podStartSLOduration=1.424908323 podStartE2EDuration="2.602548109s" totalImagesPullingTime="1.177639786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:35.600897611 +0000 UTC m=+780.035685431" watchObservedRunningTime="2026-07-21 15:13:35.602548109 +0000 UTC m=+780.037335903"
Jul 21 15:13:43.356013 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:43.355972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:43.356488 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:43.356044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:43.368770 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:43.368743    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:13:43.633034 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:13:43.632938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdvjz"
Jul 21 15:14:26.944061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:26.944031    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"]
Jul 21 15:14:26.948232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:26.948211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:26.950835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:26.950812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 15:14:26.957992 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:26.957968    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"]
Jul 21 15:14:27.039426 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.039387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.039426 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.039432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.039687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.039495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhr77\" (UniqueName: \"kubernetes.io/projected/57f07dab-095f-46be-b1f7-e1d20d936f0f-kube-api-access-fhr77\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.039687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.039589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.039687 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.039641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57f07dab-095f-46be-b1f7-e1d20d936f0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.039811 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.039697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141172 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57f07dab-095f-46be-b1f7-e1d20d936f0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141573 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhr77\" (UniqueName: \"kubernetes.io/projected/57f07dab-095f-46be-b1f7-e1d20d936f0f-kube-api-access-fhr77\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141756 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141862 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141822    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.141938 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.141916    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.143793 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.143771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57f07dab-095f-46be-b1f7-e1d20d936f0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.143924 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.143907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57f07dab-095f-46be-b1f7-e1d20d936f0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.150550 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.150531    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhr77\" (UniqueName: \"kubernetes.io/projected/57f07dab-095f-46be-b1f7-e1d20d936f0f-kube-api-access-fhr77\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz\" (UID: \"57f07dab-095f-46be-b1f7-e1d20d936f0f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.258521 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.258445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:27.400681 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.400643    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"]
Jul 21 15:14:27.403628 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:14:27.403578    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57f07dab_095f_46be_b1f7_e1d20d936f0f.slice/crio-a9e5279de843563bb69845c18dd39cc9db3348c6fab9e1f54453a89e2dbaaa45 WatchSource:0}: Error finding container a9e5279de843563bb69845c18dd39cc9db3348c6fab9e1f54453a89e2dbaaa45: Status 404 returned error can't find the container with id a9e5279de843563bb69845c18dd39cc9db3348c6fab9e1f54453a89e2dbaaa45
Jul 21 15:14:27.845802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.845768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz" event={"ID":"57f07dab-095f-46be-b1f7-e1d20d936f0f","Type":"ContainerStarted","Data":"a153349036129120d1ebe6104a98a4ea77b4e2e9b6d8cfe89d8f09410cfa675e"}
Jul 21 15:14:27.845973 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.845817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz" event={"ID":"57f07dab-095f-46be-b1f7-e1d20d936f0f","Type":"ContainerStarted","Data":"a9e5279de843563bb69845c18dd39cc9db3348c6fab9e1f54453a89e2dbaaa45"}
Jul 21 15:14:27.864359 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:27.864310    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz" podStartSLOduration=1.529068805 podStartE2EDuration="1.864293902s" totalImagesPullingTime="335.225097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:14:27.862818668 +0000 UTC m=+832.297606463" watchObservedRunningTime="2026-07-21 15:14:27.864293902 +0000 UTC m=+832.299081759"
Jul 21 15:14:37.259570 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:37.259533    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:37.259993 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:37.259630    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:37.272707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:37.272680    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:14:37.906251 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:14:37.906226    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz"
Jul 21 15:15:00.151087 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:00.151051    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"]
Jul 21 15:15:00.153655 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:00.153639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"
Jul 21 15:15:00.156797 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:00.156778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\""
Jul 21 15:15:00.162957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:00.162937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"
Jul 21 15:15:00.168845 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:00.168817    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"]
Jul 21 15:15:00.305113 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:00.305088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"]
Jul 21 15:15:00.307983 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:15:00.307952    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f8fdd5_80d3_4ff6_8ca9_04891e29dcc8.slice/crio-a3087646e6f4a7ff4ca7974194238ac43c50e08b90712318fa50d1863ffd4396 WatchSource:0}: Error finding container a3087646e6f4a7ff4ca7974194238ac43c50e08b90712318fa50d1863ffd4396: Status 404 returned error can't find the container with id a3087646e6f4a7ff4ca7974194238ac43c50e08b90712318fa50d1863ffd4396
Jul 21 15:15:01.014306 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:01.014269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx" event={"ID":"f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8","Type":"ContainerStarted","Data":"a3087646e6f4a7ff4ca7974194238ac43c50e08b90712318fa50d1863ffd4396"}
Jul 21 15:15:04.032196 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:04.032162    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8" containerID="c9a348309637edf7e74dd0e1473063b7f7dc7f35bc0d128242b3e2fa9efe57e8" exitCode=0
Jul 21 15:15:04.032570 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:04.032254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx" event={"ID":"f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8","Type":"ContainerDied","Data":"c9a348309637edf7e74dd0e1473063b7f7dc7f35bc0d128242b3e2fa9efe57e8"}
Jul 21 15:15:05.180115 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:05.180086    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"
Jul 21 15:15:06.045483 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:06.045451    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx"
Jul 21 15:15:06.045683 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:06.045456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744115-9xfmx" event={"ID":"f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8","Type":"ContainerDied","Data":"a3087646e6f4a7ff4ca7974194238ac43c50e08b90712318fa50d1863ffd4396"}
Jul 21 15:15:06.045683 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:06.045589    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3087646e6f4a7ff4ca7974194238ac43c50e08b90712318fa50d1863ffd4396"
Jul 21 15:15:36.006955 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:36.006878    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:15:36.007469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:15:36.007058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:16:02.552887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.552849    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9f676b784-26swh"]
Jul 21 15:16:02.553344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.553070    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9f676b784-26swh" podUID="384702bb-52da-47f2-a6cc-c7fd6fbc8caa" containerName="manager" containerID="cri-o://8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347" gracePeriod=30
Jul 21 15:16:02.805905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.805835    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:16:02.858385 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.858350    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert\") pod \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") "
Jul 21 15:16:02.858603 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.858465    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5pjw\" (UniqueName: \"kubernetes.io/projected/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-kube-api-access-b5pjw\") pod \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\" (UID: \"384702bb-52da-47f2-a6cc-c7fd6fbc8caa\") "
Jul 21 15:16:02.860678 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.860646    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "384702bb-52da-47f2-a6cc-c7fd6fbc8caa" (UID: "384702bb-52da-47f2-a6cc-c7fd6fbc8caa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:16:02.860868 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.860742    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-kube-api-access-b5pjw" (OuterVolumeSpecName: "kube-api-access-b5pjw") pod "384702bb-52da-47f2-a6cc-c7fd6fbc8caa" (UID: "384702bb-52da-47f2-a6cc-c7fd6fbc8caa"). InnerVolumeSpecName "kube-api-access-b5pjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:16:02.959638 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.959577    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-webhook-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:16:02.959638 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:02.959633    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5pjw\" (UniqueName: \"kubernetes.io/projected/384702bb-52da-47f2-a6cc-c7fd6fbc8caa-kube-api-access-b5pjw\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:16:03.338413 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.338374    2562 generic.go:356] "Generic (PLEG): container finished" podID="384702bb-52da-47f2-a6cc-c7fd6fbc8caa" containerID="8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347" exitCode=0
Jul 21 15:16:03.338586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.338480    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-26swh"
Jul 21 15:16:03.338586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.338511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-26swh" event={"ID":"384702bb-52da-47f2-a6cc-c7fd6fbc8caa","Type":"ContainerDied","Data":"8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347"}
Jul 21 15:16:03.338586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.338564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-26swh" event={"ID":"384702bb-52da-47f2-a6cc-c7fd6fbc8caa","Type":"ContainerDied","Data":"55690abde021d471082f901a1de58fd575a8fd19ed4cb6253a3f3a27bf8cc77a"}
Jul 21 15:16:03.338725 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.338591    2562 scope.go:117] "RemoveContainer" containerID="8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347"
Jul 21 15:16:03.348333 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.348314    2562 scope.go:117] "RemoveContainer" containerID="8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347"
Jul 21 15:16:03.348595 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:16:03.348575    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347\": container with ID starting with 8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347 not found: ID does not exist" containerID="8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347"
Jul 21 15:16:03.348673 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.348628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347"} err="failed to get container status \"8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347\": rpc error: code = NotFound desc = could not find container \"8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347\": container with ID starting with 8f105dd5de7dfc96fbc3b80fcccfbf195a2857008d5a18f959b6a9c45124f347 not found: ID does not exist"
Jul 21 15:16:03.366360 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.366321    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9f676b784-26swh"]
Jul 21 15:16:03.367018 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:03.366992    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9f676b784-26swh"]
Jul 21 15:16:04.043531 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:16:04.043492    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="384702bb-52da-47f2-a6cc-c7fd6fbc8caa" path="/var/lib/kubelet/pods/384702bb-52da-47f2-a6cc-c7fd6fbc8caa/volumes"
Jul 21 15:17:04.141373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141284    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9f676b784-bnqz6"]
Jul 21 15:17:04.141951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141849    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="384702bb-52da-47f2-a6cc-c7fd6fbc8caa" containerName="manager"
Jul 21 15:17:04.141951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141868    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="384702bb-52da-47f2-a6cc-c7fd6fbc8caa" containerName="manager"
Jul 21 15:17:04.141951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141882    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8" containerName="cleanup"
Jul 21 15:17:04.141951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141891    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8" containerName="cleanup"
Jul 21 15:17:04.142111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141962    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8" containerName="cleanup"
Jul 21 15:17:04.142111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.141975    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="384702bb-52da-47f2-a6cc-c7fd6fbc8caa" containerName="manager"
Jul 21 15:17:04.143967 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.143952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.147327 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.147308    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vgfvr\""
Jul 21 15:17:04.147454 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.147308    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 15:17:04.147454 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.147348    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 15:17:04.155886 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.155863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f676b784-bnqz6"]
Jul 21 15:17:04.162167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.162140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvdh7\" (UniqueName: \"kubernetes.io/projected/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-kube-api-access-qvdh7\") pod \"maas-controller-9f676b784-bnqz6\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") " pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.162294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.162273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-webhook-cert\") pod \"maas-controller-9f676b784-bnqz6\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") " pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.263745 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.263708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvdh7\" (UniqueName: \"kubernetes.io/projected/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-kube-api-access-qvdh7\") pod \"maas-controller-9f676b784-bnqz6\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") " pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.263923 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.263799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-webhook-cert\") pod \"maas-controller-9f676b784-bnqz6\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") " pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.266423 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.266402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-webhook-cert\") pod \"maas-controller-9f676b784-bnqz6\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") " pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.274348 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.274301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvdh7\" (UniqueName: \"kubernetes.io/projected/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-kube-api-access-qvdh7\") pod \"maas-controller-9f676b784-bnqz6\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") " pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.454311 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.454220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:04.595204 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.595181    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f676b784-bnqz6"]
Jul 21 15:17:04.597076 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:17:04.597044    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e2ea1b_e1d8_46dd_97d3_b2bf7f76fb7d.slice/crio-c697c6239b84db3d21b22a37eedea421a550f0a07a70ba676de608d5c62fe822 WatchSource:0}: Error finding container c697c6239b84db3d21b22a37eedea421a550f0a07a70ba676de608d5c62fe822: Status 404 returned error can't find the container with id c697c6239b84db3d21b22a37eedea421a550f0a07a70ba676de608d5c62fe822
Jul 21 15:17:04.653388 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:04.653355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-bnqz6" event={"ID":"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d","Type":"ContainerStarted","Data":"c697c6239b84db3d21b22a37eedea421a550f0a07a70ba676de608d5c62fe822"}
Jul 21 15:17:06.666156 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:06.666122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-bnqz6" event={"ID":"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d","Type":"ContainerStarted","Data":"52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2"}
Jul 21 15:17:06.666542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:06.666177    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:06.685984 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:06.685940    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9f676b784-bnqz6" podStartSLOduration=1.563341688 podStartE2EDuration="2.685923865s" totalImagesPullingTime="1.122582177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:17:06.684390125 +0000 UTC m=+991.119177921" watchObservedRunningTime="2026-07-21 15:17:06.685923865 +0000 UTC m=+991.120711659"
Jul 21 15:17:17.681005 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:17.680976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:22.300043 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.300010    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9f676b784-bnqz6"]
Jul 21 15:17:22.300506 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.300196    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9f676b784-bnqz6" podUID="a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" containerName="manager" containerID="cri-o://52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2" gracePeriod=30
Jul 21 15:17:22.539086 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.539055    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:22.643665 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.643567    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvdh7\" (UniqueName: \"kubernetes.io/projected/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-kube-api-access-qvdh7\") pod \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") "
Jul 21 15:17:22.643665 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.643638    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-webhook-cert\") pod \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\" (UID: \"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d\") "
Jul 21 15:17:22.645712 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.645686    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" (UID: "a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:17:22.645828 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.645757    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-kube-api-access-qvdh7" (OuterVolumeSpecName: "kube-api-access-qvdh7") pod "a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" (UID: "a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d"). InnerVolumeSpecName "kube-api-access-qvdh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:17:22.744466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.744436    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvdh7\" (UniqueName: \"kubernetes.io/projected/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-kube-api-access-qvdh7\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:17:22.744466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.744465    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d-webhook-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:17:22.757905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.757880    2562 generic.go:356] "Generic (PLEG): container finished" podID="a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" containerID="52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2" exitCode=0
Jul 21 15:17:22.758066 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.757924    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-bnqz6"
Jul 21 15:17:22.758066 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.757975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-bnqz6" event={"ID":"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d","Type":"ContainerDied","Data":"52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2"}
Jul 21 15:17:22.758066 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.758034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-bnqz6" event={"ID":"a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d","Type":"ContainerDied","Data":"c697c6239b84db3d21b22a37eedea421a550f0a07a70ba676de608d5c62fe822"}
Jul 21 15:17:22.758066 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.758065    2562 scope.go:117] "RemoveContainer" containerID="52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2"
Jul 21 15:17:22.767293 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.767278    2562 scope.go:117] "RemoveContainer" containerID="52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2"
Jul 21 15:17:22.767584 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:17:22.767566    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2\": container with ID starting with 52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2 not found: ID does not exist" containerID="52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2"
Jul 21 15:17:22.767709 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.767593    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2"} err="failed to get container status \"52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2\": rpc error: code = NotFound desc = could not find container \"52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2\": container with ID starting with 52a4b16d5fb6ee31f204c1dee2b7aa4d58590de53b3120efbe42443ec8e68af2 not found: ID does not exist"
Jul 21 15:17:22.779744 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.779719    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9f676b784-bnqz6"]
Jul 21 15:17:22.783019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:22.783001    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9f676b784-bnqz6"]
Jul 21 15:17:23.518268 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.518230    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9f676b784-hb7bd"]
Jul 21 15:17:23.518880 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.518860    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" containerName="manager"
Jul 21 15:17:23.518956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.518883    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" containerName="manager"
Jul 21 15:17:23.519029 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.518987    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" containerName="manager"
Jul 21 15:17:23.522197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.522178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.525742 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.525722    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vgfvr\""
Jul 21 15:17:23.525843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.525771    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 15:17:23.525843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.525793    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 15:17:23.531024 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.531005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f676b784-hb7bd"]
Jul 21 15:17:23.652743 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.652713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b2e9e49-b052-4149-8ce7-5091a0621b0f-webhook-cert\") pod \"maas-controller-9f676b784-hb7bd\" (UID: \"8b2e9e49-b052-4149-8ce7-5091a0621b0f\") " pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.652743 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.652751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ssjs\" (UniqueName: \"kubernetes.io/projected/8b2e9e49-b052-4149-8ce7-5091a0621b0f-kube-api-access-6ssjs\") pod \"maas-controller-9f676b784-hb7bd\" (UID: \"8b2e9e49-b052-4149-8ce7-5091a0621b0f\") " pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.753270 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.753238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b2e9e49-b052-4149-8ce7-5091a0621b0f-webhook-cert\") pod \"maas-controller-9f676b784-hb7bd\" (UID: \"8b2e9e49-b052-4149-8ce7-5091a0621b0f\") " pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.753462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.753283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ssjs\" (UniqueName: \"kubernetes.io/projected/8b2e9e49-b052-4149-8ce7-5091a0621b0f-kube-api-access-6ssjs\") pod \"maas-controller-9f676b784-hb7bd\" (UID: \"8b2e9e49-b052-4149-8ce7-5091a0621b0f\") " pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.755978 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.755951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b2e9e49-b052-4149-8ce7-5091a0621b0f-webhook-cert\") pod \"maas-controller-9f676b784-hb7bd\" (UID: \"8b2e9e49-b052-4149-8ce7-5091a0621b0f\") " pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.763351 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.763308    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ssjs\" (UniqueName: \"kubernetes.io/projected/8b2e9e49-b052-4149-8ce7-5091a0621b0f-kube-api-access-6ssjs\") pod \"maas-controller-9f676b784-hb7bd\" (UID: \"8b2e9e49-b052-4149-8ce7-5091a0621b0f\") " pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.834033 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.834001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:23.977335 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:23.977308    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9f676b784-hb7bd"]
Jul 21 15:17:23.979330 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:17:23.979305    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2e9e49_b052_4149_8ce7_5091a0621b0f.slice/crio-da4feda419948d3ea1a699e15c1d26081528887299725bc576438dc29df61556 WatchSource:0}: Error finding container da4feda419948d3ea1a699e15c1d26081528887299725bc576438dc29df61556: Status 404 returned error can't find the container with id da4feda419948d3ea1a699e15c1d26081528887299725bc576438dc29df61556
Jul 21 15:17:24.042829 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:24.042798    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d" path="/var/lib/kubelet/pods/a5e2ea1b-e1d8-46dd-97d3-b2bf7f76fb7d/volumes"
Jul 21 15:17:24.772626 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:24.772526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-hb7bd" event={"ID":"8b2e9e49-b052-4149-8ce7-5091a0621b0f","Type":"ContainerStarted","Data":"619475cab087b3cc4d47e5dd5a2921b81a74f2ab3e058ce280f8bdaba36e0c39"}
Jul 21 15:17:24.772626 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:24.772581    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:17:24.772626 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:24.772598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9f676b784-hb7bd" event={"ID":"8b2e9e49-b052-4149-8ce7-5091a0621b0f","Type":"ContainerStarted","Data":"da4feda419948d3ea1a699e15c1d26081528887299725bc576438dc29df61556"}
Jul 21 15:17:24.791424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:24.791380    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9f676b784-hb7bd" podStartSLOduration=1.407842505 podStartE2EDuration="1.791365543s" totalImagesPullingTime="383.523038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:17:24.790284674 +0000 UTC m=+1009.225072468" watchObservedRunningTime="2026-07-21 15:17:24.791365543 +0000 UTC m=+1009.226153336"
Jul 21 15:17:35.780938 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:17:35.780905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9f676b784-hb7bd"
Jul 21 15:20:36.042269 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:20:36.042240    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:20:36.043869 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:20:36.043848    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:21:59.413418 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:21:59.413333    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"]
Jul 21 15:21:59.414135 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:21:59.413538    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594" podUID="e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" containerName="manager" containerID="cri-o://71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194" gracePeriod=10
Jul 21 15:22:02.872542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:02.872466    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:22:02.951352 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:02.951314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-extensions-socket-volume\") pod \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") "
Jul 21 15:22:02.951525 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:02.951404    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjjq9\" (UniqueName: \"kubernetes.io/projected/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-kube-api-access-hjjq9\") pod \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\" (UID: \"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd\") "
Jul 21 15:22:02.951725 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:02.951701    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" (UID: "e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:22:02.953556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:02.953531    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-kube-api-access-hjjq9" (OuterVolumeSpecName: "kube-api-access-hjjq9") pod "e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" (UID: "e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd"). InnerVolumeSpecName "kube-api-access-hjjq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:22:03.052519 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.052474    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-extensions-socket-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:22:03.052519 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.052509    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjjq9\" (UniqueName: \"kubernetes.io/projected/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd-kube-api-access-hjjq9\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:22:03.199370 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.199269    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" containerID="71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194" exitCode=0
Jul 21 15:22:03.199370 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.199335    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"
Jul 21 15:22:03.199652 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.199366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594" event={"ID":"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd","Type":"ContainerDied","Data":"71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194"}
Jul 21 15:22:03.199652 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.199440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594" event={"ID":"e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd","Type":"ContainerDied","Data":"6d0a05c7583b9667dbd1220c4826b5327f02727932cc8a3dd3bc852bd0167299"}
Jul 21 15:22:03.199652 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.199470    2562 scope.go:117] "RemoveContainer" containerID="71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194"
Jul 21 15:22:03.210184 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.210163    2562 scope.go:117] "RemoveContainer" containerID="71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194"
Jul 21 15:22:03.210461 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:22:03.210441    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194\": container with ID starting with 71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194 not found: ID does not exist" containerID="71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194"
Jul 21 15:22:03.210529 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.210476    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194"} err="failed to get container status \"71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194\": rpc error: code = NotFound desc = could not find container \"71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194\": container with ID starting with 71729ac626af63d5b9f51b5c96756534c6403bb88ba760a86102ac3244125194 not found: ID does not exist"
Jul 21 15:22:03.222249 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.222210    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"]
Jul 21 15:22:03.225948 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:03.225925    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8l594"]
Jul 21 15:22:04.043240 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:22:04.043197    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" path="/var/lib/kubelet/pods/e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd/volumes"
Jul 21 15:23:00.507792 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.507709    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"]
Jul 21 15:23:00.508223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.508140    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" containerName="manager"
Jul 21 15:23:00.508223 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.508152    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" containerName="manager"
Jul 21 15:23:00.508316 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.508246    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d7b2a1-3d5f-4d77-8c63-f3f25b6613fd" containerName="manager"
Jul 21 15:23:00.512299 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.512281    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.514828 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.514806    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-htkq2\""
Jul 21 15:23:00.523728 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.523702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"]
Jul 21 15:23:00.611759 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.611716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d198f97f-80ad-4158-a7c9-a4be6ba52df0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nkm7w\" (UID: \"d198f97f-80ad-4158-a7c9-a4be6ba52df0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.611951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.611788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjfx\" (UniqueName: \"kubernetes.io/projected/d198f97f-80ad-4158-a7c9-a4be6ba52df0-kube-api-access-ppjfx\") pod \"kuadrant-operator-controller-manager-86878c769f-nkm7w\" (UID: \"d198f97f-80ad-4158-a7c9-a4be6ba52df0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.713123 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.713075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjfx\" (UniqueName: \"kubernetes.io/projected/d198f97f-80ad-4158-a7c9-a4be6ba52df0-kube-api-access-ppjfx\") pod \"kuadrant-operator-controller-manager-86878c769f-nkm7w\" (UID: \"d198f97f-80ad-4158-a7c9-a4be6ba52df0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.713309 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.713193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d198f97f-80ad-4158-a7c9-a4be6ba52df0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nkm7w\" (UID: \"d198f97f-80ad-4158-a7c9-a4be6ba52df0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.713526 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.713510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d198f97f-80ad-4158-a7c9-a4be6ba52df0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nkm7w\" (UID: \"d198f97f-80ad-4158-a7c9-a4be6ba52df0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.723524 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.723486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjfx\" (UniqueName: \"kubernetes.io/projected/d198f97f-80ad-4158-a7c9-a4be6ba52df0-kube-api-access-ppjfx\") pod \"kuadrant-operator-controller-manager-86878c769f-nkm7w\" (UID: \"d198f97f-80ad-4158-a7c9-a4be6ba52df0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.824471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.824424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:00.979453 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:00.979426    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"]
Jul 21 15:23:00.982040 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:23:00.982010    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd198f97f_80ad_4158_a7c9_a4be6ba52df0.slice/crio-809fb3d1e0579286a73fbccba8d331021b535099c2c396bc0e21f304dbb876ac WatchSource:0}: Error finding container 809fb3d1e0579286a73fbccba8d331021b535099c2c396bc0e21f304dbb876ac: Status 404 returned error can't find the container with id 809fb3d1e0579286a73fbccba8d331021b535099c2c396bc0e21f304dbb876ac
Jul 21 15:23:01.498933 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:01.498898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w" event={"ID":"d198f97f-80ad-4158-a7c9-a4be6ba52df0","Type":"ContainerStarted","Data":"95840c5c9fc6b6bfac102ee1cbe6104d68d6cde1f7acf20418bd35943e53a1a2"}
Jul 21 15:23:01.499154 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:01.498952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w" event={"ID":"d198f97f-80ad-4158-a7c9-a4be6ba52df0","Type":"ContainerStarted","Data":"809fb3d1e0579286a73fbccba8d331021b535099c2c396bc0e21f304dbb876ac"}
Jul 21 15:23:01.499154 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:01.499009    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:23:01.523542 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:01.523490    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w" podStartSLOduration=1.523475248 podStartE2EDuration="1.523475248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:23:01.521142523 +0000 UTC m=+1345.955930337" watchObservedRunningTime="2026-07-21 15:23:01.523475248 +0000 UTC m=+1345.958263042"
Jul 21 15:23:12.507079 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:23:12.507046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nkm7w"
Jul 21 15:25:36.074483 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:36.074442    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:25:36.077712 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:36.077688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:25:45.529095 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.529060    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"]
Jul 21 15:25:45.532951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.532924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.535623 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.535578    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-2c038283-kserve-self-signed-certs\""
Jul 21 15:25:45.541642 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.541589    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"]
Jul 21 15:25:45.619372 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.619336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df748\" (UniqueName: \"kubernetes.io/projected/90d5d985-ba62-4b93-a121-f58d9a11b1f5-kube-api-access-df748\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.619557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.619463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-home\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.619557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.619503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-dshm\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.619729 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.619560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-model-cache\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.619729 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.619592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tmp-dir\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.619805 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.619745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tls-certs\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721041 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tls-certs\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721285 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df748\" (UniqueName: \"kubernetes.io/projected/90d5d985-ba62-4b93-a121-f58d9a11b1f5-kube-api-access-df748\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721285 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-home\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721285 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-dshm\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721468 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-model-cache\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721468 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tmp-dir\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721707 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-home\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.721818 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721774    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-model-cache\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.722050 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.721827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tmp-dir\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.723651 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.723588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-dshm\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.723929 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.723906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tls-certs\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.730161 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.730122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df748\" (UniqueName: \"kubernetes.io/projected/90d5d985-ba62-4b93-a121-f58d9a11b1f5-kube-api-access-df748\") pod \"e2e-same-id-b-2c038283-kserve-8467895847-nblkp\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") " pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.842892 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.842804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:45.990581 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:45.990553    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"]
Jul 21 15:25:45.992688 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:25:45.992660    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90d5d985_ba62_4b93_a121_f58d9a11b1f5.slice/crio-723d7ca79bb1d85de5d2f186767ab0529234120a3ca1cd5995fa54a490ddce2e WatchSource:0}: Error finding container 723d7ca79bb1d85de5d2f186767ab0529234120a3ca1cd5995fa54a490ddce2e: Status 404 returned error can't find the container with id 723d7ca79bb1d85de5d2f186767ab0529234120a3ca1cd5995fa54a490ddce2e
Jul 21 15:25:46.366516 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:46.366479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp" event={"ID":"90d5d985-ba62-4b93-a121-f58d9a11b1f5","Type":"ContainerStarted","Data":"c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063"}
Jul 21 15:25:46.366717 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:46.366529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp" event={"ID":"90d5d985-ba62-4b93-a121-f58d9a11b1f5","Type":"ContainerStarted","Data":"723d7ca79bb1d85de5d2f186767ab0529234120a3ca1cd5995fa54a490ddce2e"}
Jul 21 15:25:46.386209 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:46.386153    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp" podStartSLOduration=1.386136828 podStartE2EDuration="1.386136828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:25:46.384291679 +0000 UTC m=+1510.819079477" watchObservedRunningTime="2026-07-21 15:25:46.386136828 +0000 UTC m=+1510.820924622"
Jul 21 15:25:55.843810 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:55.843764    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:55.844263 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:55.843825    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:55.856999 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:55.856974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:25:56.430714 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:25:56.430683    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:26:18.139013 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:18.138982    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"]
Jul 21 15:26:33.164602 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.164561    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp" podUID="90d5d985-ba62-4b93-a121-f58d9a11b1f5" containerName="main" containerID="cri-o://c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063" gracePeriod=45
Jul 21 15:26:33.428646 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.428570    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:26:33.605362 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605330    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-dshm\") pod \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") "
Jul 21 15:26:33.605563 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605390    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-model-cache\") pod \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") "
Jul 21 15:26:33.605563 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605519    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tmp-dir\") pod \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") "
Jul 21 15:26:33.605563 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605545    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tls-certs\") pod \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") "
Jul 21 15:26:33.605779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df748\" (UniqueName: \"kubernetes.io/projected/90d5d985-ba62-4b93-a121-f58d9a11b1f5-kube-api-access-df748\") pod \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") "
Jul 21 15:26:33.605779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605663    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-home\") pod \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\" (UID: \"90d5d985-ba62-4b93-a121-f58d9a11b1f5\") "
Jul 21 15:26:33.605779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-model-cache" (OuterVolumeSpecName: "model-cache") pod "90d5d985-ba62-4b93-a121-f58d9a11b1f5" (UID: "90d5d985-ba62-4b93-a121-f58d9a11b1f5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:26:33.605940 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605804    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90d5d985-ba62-4b93-a121-f58d9a11b1f5" (UID: "90d5d985-ba62-4b93-a121-f58d9a11b1f5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:26:33.606024 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.605999    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-home" (OuterVolumeSpecName: "home") pod "90d5d985-ba62-4b93-a121-f58d9a11b1f5" (UID: "90d5d985-ba62-4b93-a121-f58d9a11b1f5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:26:33.606081 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.606068    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-model-cache\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:26:33.606081 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.606080    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tmp-dir\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:26:33.608038 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.608009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90d5d985-ba62-4b93-a121-f58d9a11b1f5" (UID: "90d5d985-ba62-4b93-a121-f58d9a11b1f5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:26:33.608138 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.608062    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d5d985-ba62-4b93-a121-f58d9a11b1f5-kube-api-access-df748" (OuterVolumeSpecName: "kube-api-access-df748") pod "90d5d985-ba62-4b93-a121-f58d9a11b1f5" (UID: "90d5d985-ba62-4b93-a121-f58d9a11b1f5"). InnerVolumeSpecName "kube-api-access-df748". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:26:33.608138 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.608068    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-dshm" (OuterVolumeSpecName: "dshm") pod "90d5d985-ba62-4b93-a121-f58d9a11b1f5" (UID: "90d5d985-ba62-4b93-a121-f58d9a11b1f5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:26:33.609488 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.609464    2562 generic.go:356] "Generic (PLEG): container finished" podID="90d5d985-ba62-4b93-a121-f58d9a11b1f5" containerID="c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063" exitCode=0
Jul 21 15:26:33.609589 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.609506    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"
Jul 21 15:26:33.609589 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.609544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp" event={"ID":"90d5d985-ba62-4b93-a121-f58d9a11b1f5","Type":"ContainerDied","Data":"c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063"}
Jul 21 15:26:33.609589 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.609587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp" event={"ID":"90d5d985-ba62-4b93-a121-f58d9a11b1f5","Type":"ContainerDied","Data":"723d7ca79bb1d85de5d2f186767ab0529234120a3ca1cd5995fa54a490ddce2e"}
Jul 21 15:26:33.609840 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.609620    2562 scope.go:117] "RemoveContainer" containerID="c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063"
Jul 21 15:26:33.627778 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.627697    2562 scope.go:117] "RemoveContainer" containerID="c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063"
Jul 21 15:26:33.628035 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:26:33.628013    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063\": container with ID starting with c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063 not found: ID does not exist" containerID="c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063"
Jul 21 15:26:33.628095 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.628043    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063"} err="failed to get container status \"c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063\": rpc error: code = NotFound desc = could not find container \"c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063\": container with ID starting with c797b2ea694ad660b3f51964287ca414947aab58a1cd438864187d9d3b2c5063 not found: ID does not exist"
Jul 21 15:26:33.639915 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.639892    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"]
Jul 21 15:26:33.643151 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.643131    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-2c038283-kserve-8467895847-nblkp"]
Jul 21 15:26:33.707457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.707367    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90d5d985-ba62-4b93-a121-f58d9a11b1f5-tls-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:26:33.707457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.707395    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df748\" (UniqueName: \"kubernetes.io/projected/90d5d985-ba62-4b93-a121-f58d9a11b1f5-kube-api-access-df748\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:26:33.707457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.707408    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-home\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:26:33.707457 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:33.707418    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90d5d985-ba62-4b93-a121-f58d9a11b1f5-dshm\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:26:34.043728 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:26:34.043696    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d5d985-ba62-4b93-a121-f58d9a11b1f5" path="/var/lib/kubelet/pods/90d5d985-ba62-4b93-a121-f58d9a11b1f5/volumes"
Jul 21 15:29:56.435873 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.435842    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"]
Jul 21 15:29:56.436452 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.436250    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d5d985-ba62-4b93-a121-f58d9a11b1f5" containerName="main"
Jul 21 15:29:56.436452 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.436260    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d5d985-ba62-4b93-a121-f58d9a11b1f5" containerName="main"
Jul 21 15:29:56.436452 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.436317    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d5d985-ba62-4b93-a121-f58d9a11b1f5" containerName="main"
Jul 21 15:29:56.439546 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.439527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.442125 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.442102    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2f780905-openshift-default-dockercfg-hbw6t\""
Jul 21 15:29:56.478276 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.478246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"]
Jul 21 15:29:56.531151 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-token\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.531461 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-socket\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.531643 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6375f71-9b40-4703-8b72-acfaef9864b9-istiod-ca-cert\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.531843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-certs\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.531939 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwx7z\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-kube-api-access-bwx7z\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.531939 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-data\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.532047 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-credential-socket\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.532047 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.531991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-envoy\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.532047 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.532034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-podinfo\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633423 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-token\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633663 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-socket\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633663 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6375f71-9b40-4703-8b72-acfaef9864b9-istiod-ca-cert\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633663 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-certs\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633663 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwx7z\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-kube-api-access-bwx7z\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-data\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-credential-socket\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-envoy\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-podinfo\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.633904 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-socket\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.634164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.633912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-certs\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.634164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.634109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-data\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.634164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.634139    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-credential-socket\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.634311 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.634291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6375f71-9b40-4703-8b72-acfaef9864b9-istiod-ca-cert\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.636197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.636176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-envoy\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.636435 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.636417    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-podinfo\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.641492 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.641466    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-token\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.641695 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.641677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwx7z\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-kube-api-access-bwx7z\") pod \"e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") " pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.751467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.751387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:56.905383 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.905359    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"]
Jul 21 15:29:56.907589 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:29:56.907563    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6375f71_9b40_4703_8b72_acfaef9864b9.slice/crio-96c6ef9c3c1111c9213f93593233ccb8644aef2798ff351cf759942837f5ce41 WatchSource:0}: Error finding container 96c6ef9c3c1111c9213f93593233ccb8644aef2798ff351cf759942837f5ce41: Status 404 returned error can't find the container with id 96c6ef9c3c1111c9213f93593233ccb8644aef2798ff351cf759942837f5ce41
Jul 21 15:29:56.910254 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.910224    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:29:56.910349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.910291    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:29:56.910349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:56.910332    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:29:57.665293 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:57.665260    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" event={"ID":"a6375f71-9b40-4703-8b72-acfaef9864b9","Type":"ContainerStarted","Data":"a19cebcc5957c10db21107faa5523be677f511cd0c636f12fbbcef4c4d736214"}
Jul 21 15:29:57.665692 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:57.665319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" event={"ID":"a6375f71-9b40-4703-8b72-acfaef9864b9","Type":"ContainerStarted","Data":"96c6ef9c3c1111c9213f93593233ccb8644aef2798ff351cf759942837f5ce41"}
Jul 21 15:29:57.689478 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:57.689432    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" podStartSLOduration=1.689416198 podStartE2EDuration="1.689416198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:29:57.687593587 +0000 UTC m=+1762.122381405" watchObservedRunningTime="2026-07-21 15:29:57.689416198 +0000 UTC m=+1762.124203992"
Jul 21 15:29:57.752372 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:57.752343    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:57.757968 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:57.757943    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:58.673446 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:58.673421    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:58.674338 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:58.674321    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:29:59.271576 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.271544    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"]
Jul 21 15:29:59.275433 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.275409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.278005 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.277984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2f780905-serving-cert\""
Jul 21 15:29:59.287358 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.287333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"]
Jul 21 15:29:59.364225 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.364188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknmq\" (UniqueName: \"kubernetes.io/projected/f3c729a9-c8b4-441e-bb17-603b5c3715c4-kube-api-access-dknmq\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.364428 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.364286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.364428 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.364357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c729a9-c8b4-441e-bb17-603b5c3715c4-openshift-service-ca\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.465594 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.465553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c729a9-c8b4-441e-bb17-603b5c3715c4-openshift-service-ca\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.465797 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.465684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknmq\" (UniqueName: \"kubernetes.io/projected/f3c729a9-c8b4-441e-bb17-603b5c3715c4-kube-api-access-dknmq\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.465797 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.465760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.465922 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:29:59.465897    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-serving-cert: secret "maas-api-e2e-ait-2f780905-serving-cert" not found
Jul 21 15:29:59.465994 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:29:59.465982    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls podName:f3c729a9-c8b4-441e-bb17-603b5c3715c4 nodeName:}" failed. No retries permitted until 2026-07-21 15:29:59.965961691 +0000 UTC m=+1764.400749463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls") pod "maas-api-e2e-ait-2f780905-7d6497897-gkf97" (UID: "f3c729a9-c8b4-441e-bb17-603b5c3715c4") : secret "maas-api-e2e-ait-2f780905-serving-cert" not found
Jul 21 15:29:59.466281 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.466262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c729a9-c8b4-441e-bb17-603b5c3715c4-openshift-service-ca\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.479142 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.479109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknmq\" (UniqueName: \"kubernetes.io/projected/f3c729a9-c8b4-441e-bb17-603b5c3715c4-kube-api-access-dknmq\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.970741 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.970701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:29:59.973325 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:29:59.973304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls\") pod \"maas-api-e2e-ait-2f780905-7d6497897-gkf97\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:30:00.190627 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:00.190554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:30:00.545698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:00.545660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"]
Jul 21 15:30:00.548832 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:30:00.548802    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c729a9_c8b4_441e_bb17_603b5c3715c4.slice/crio-58668a90a196eb23b621926b9b8afc684906fe608b2057b30d2516102dcfac4d WatchSource:0}: Error finding container 58668a90a196eb23b621926b9b8afc684906fe608b2057b30d2516102dcfac4d: Status 404 returned error can't find the container with id 58668a90a196eb23b621926b9b8afc684906fe608b2057b30d2516102dcfac4d
Jul 21 15:30:00.550289 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:00.550268    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 15:30:00.685037 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:00.685000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97" event={"ID":"f3c729a9-c8b4-441e-bb17-603b5c3715c4","Type":"ContainerStarted","Data":"58668a90a196eb23b621926b9b8afc684906fe608b2057b30d2516102dcfac4d"}
Jul 21 15:30:01.691199 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:01.691170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97" event={"ID":"f3c729a9-c8b4-441e-bb17-603b5c3715c4","Type":"ContainerStarted","Data":"c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff"}
Jul 21 15:30:01.691574 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:01.691293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:30:01.712294 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:01.712249    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97" podStartSLOduration=2.12771428 podStartE2EDuration="2.712235459s" totalImagesPullingTime="584.521179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:01.710863042 +0000 UTC m=+1766.145650836" watchObservedRunningTime="2026-07-21 15:30:01.712235459 +0000 UTC m=+1766.147023258"
Jul 21 15:30:07.702958 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:07.702917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:30:12.767556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:12.767477    2562 generic.go:356] "Generic (PLEG): container finished" podID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerID="a19cebcc5957c10db21107faa5523be677f511cd0c636f12fbbcef4c4d736214" exitCode=0
Jul 21 15:30:12.767968 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:12.767549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" event={"ID":"a6375f71-9b40-4703-8b72-acfaef9864b9","Type":"ContainerDied","Data":"a19cebcc5957c10db21107faa5523be677f511cd0c636f12fbbcef4c4d736214"}
Jul 21 15:30:12.767968 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:12.767959    2562 scope.go:117] "RemoveContainer" containerID="a19cebcc5957c10db21107faa5523be677f511cd0c636f12fbbcef4c4d736214"
Jul 21 15:30:12.768996 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:12.768968    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:12.769067 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:12.769050    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:12.769119 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:12.769104    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:13.673657 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:13.673599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:13.774900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:13.774866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" event={"ID":"a6375f71-9b40-4703-8b72-acfaef9864b9","Type":"ContainerStarted","Data":"9b2860a1977092f6a1ab9c4940254cdbfac264b7e304b782caa06650f5ebf0e2"}
Jul 21 15:30:14.752351 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:14.752316    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:14.753467 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:14.753445    2562 patch_prober.go:28] interesting pod/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 15:30:14.753658 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:14.753636    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 15:30:15.752684 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:15.752651    2562 patch_prober.go:28] interesting pod/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 15:30:15.753121 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:15.752913    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 15:30:16.752786 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:16.752749    2562 patch_prober.go:28] interesting pod/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 21 15:30:16.753197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:16.752804    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 21 15:30:17.756344 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:17.756315    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:17.756751 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:17.756731    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:17.757454 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:17.757439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:35.075431 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.075392    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"]
Jul 21 15:30:35.075852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.075666    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97" podUID="f3c729a9-c8b4-441e-bb17-603b5c3715c4" containerName="maas-api" containerID="cri-o://c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff" gracePeriod=30
Jul 21 15:30:35.333487 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.333418    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:30:35.411015 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.410986    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c729a9-c8b4-441e-bb17-603b5c3715c4-openshift-service-ca\") pod \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") "
Jul 21 15:30:35.411015 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.411015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dknmq\" (UniqueName: \"kubernetes.io/projected/f3c729a9-c8b4-441e-bb17-603b5c3715c4-kube-api-access-dknmq\") pod \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") "
Jul 21 15:30:35.411198 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.411062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls\") pod \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\" (UID: \"f3c729a9-c8b4-441e-bb17-603b5c3715c4\") "
Jul 21 15:30:35.411400 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.411377    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c729a9-c8b4-441e-bb17-603b5c3715c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3c729a9-c8b4-441e-bb17-603b5c3715c4" (UID: "f3c729a9-c8b4-441e-bb17-603b5c3715c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:30:35.413382 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.413365    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c729a9-c8b4-441e-bb17-603b5c3715c4-kube-api-access-dknmq" (OuterVolumeSpecName: "kube-api-access-dknmq") pod "f3c729a9-c8b4-441e-bb17-603b5c3715c4" (UID: "f3c729a9-c8b4-441e-bb17-603b5c3715c4"). InnerVolumeSpecName "kube-api-access-dknmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:30:35.413474 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.413456    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3c729a9-c8b4-441e-bb17-603b5c3715c4" (UID: "f3c729a9-c8b4-441e-bb17-603b5c3715c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:30:35.512112 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.512082    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c729a9-c8b4-441e-bb17-603b5c3715c4-openshift-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:35.512112 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.512109    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dknmq\" (UniqueName: \"kubernetes.io/projected/f3c729a9-c8b4-441e-bb17-603b5c3715c4-kube-api-access-dknmq\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:35.512275 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.512118    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c729a9-c8b4-441e-bb17-603b5c3715c4-maas-api-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:35.891122 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.891091    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c729a9-c8b4-441e-bb17-603b5c3715c4" containerID="c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff" exitCode=0
Jul 21 15:30:35.891304 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.891145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"
Jul 21 15:30:35.891304 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.891183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97" event={"ID":"f3c729a9-c8b4-441e-bb17-603b5c3715c4","Type":"ContainerDied","Data":"c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff"}
Jul 21 15:30:35.891304 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.891238    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97" event={"ID":"f3c729a9-c8b4-441e-bb17-603b5c3715c4","Type":"ContainerDied","Data":"58668a90a196eb23b621926b9b8afc684906fe608b2057b30d2516102dcfac4d"}
Jul 21 15:30:35.891304 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.891266    2562 scope.go:117] "RemoveContainer" containerID="c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff"
Jul 21 15:30:35.900177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.900161    2562 scope.go:117] "RemoveContainer" containerID="c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff"
Jul 21 15:30:35.900411 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:30:35.900393    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff\": container with ID starting with c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff not found: ID does not exist" containerID="c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff"
Jul 21 15:30:35.900461 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.900419    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff"} err="failed to get container status \"c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff\": rpc error: code = NotFound desc = could not find container \"c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff\": container with ID starting with c72f89c1803ded5683c55c145bccbd9e08547ac73666dd27ab2954d3c64e4fff not found: ID does not exist"
Jul 21 15:30:35.914754 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.914714    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"]
Jul 21 15:30:35.916902 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:35.916874    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2f780905-7d6497897-gkf97"]
Jul 21 15:30:36.051602 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:36.051562    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c729a9-c8b4-441e-bb17-603b5c3715c4" path="/var/lib/kubelet/pods/f3c729a9-c8b4-441e-bb17-603b5c3715c4/volumes"
Jul 21 15:30:36.105854 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:36.105835    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:30:36.110411 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:36.110388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:30:39.794835 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:39.794801    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"]
Jul 21 15:30:39.795279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:39.795011    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy" containerID="cri-o://9b2860a1977092f6a1ab9c4940254cdbfac264b7e304b782caa06650f5ebf0e2" gracePeriod=30
Jul 21 15:30:40.788320 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.788287    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"]
Jul 21 15:30:40.788956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.788935    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c729a9-c8b4-441e-bb17-603b5c3715c4" containerName="maas-api"
Jul 21 15:30:40.788956 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.788954    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c729a9-c8b4-441e-bb17-603b5c3715c4" containerName="maas-api"
Jul 21 15:30:40.789132 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.789072    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c729a9-c8b4-441e-bb17-603b5c3715c4" containerName="maas-api"
Jul 21 15:30:40.792234 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.792215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.794877 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.794849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3972e309-gw-openshift-default-dockercfg-s4r4p\""
Jul 21 15:30:40.811324 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.811293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"]
Jul 21 15:30:40.964755 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.964717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-credential-socket\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.964920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.964839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvhd9\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-kube-api-access-vvhd9\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.964920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.964896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-token\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.964996 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.964929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-certs\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.964996 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.964980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-socket\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.965057 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.965013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-data\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.965093 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.965070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-envoy\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.965127 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.965109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-podinfo\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:40.965161 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:40.965136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istiod-ca-cert\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-certs\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-socket\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066651 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-data\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066651 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-envoy\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066651 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-podinfo\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istiod-ca-cert\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-credential-socket\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-socket\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-certs\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.066830 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-data\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.067090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvhd9\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-kube-api-access-vvhd9\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.067090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-token\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.067090 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.066989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-credential-socket\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.067421 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.067398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istiod-ca-cert\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.069092 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.069068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-envoy\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.069157 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.069134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-podinfo\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.075798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.075776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvhd9\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-kube-api-access-vvhd9\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.076240 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.076220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-token\") pod \"e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") " pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.103327 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.103303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:41.269988 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.269958    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"]
Jul 21 15:30:41.272277 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:30:41.272240    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101cefe9_2c3b_4c9c_bd6c_dced9a57a832.slice/crio-ca59e6dda5b58ad8285db1bb583b8891cb86514f83192aa6c29fdcc79d05dfa8 WatchSource:0}: Error finding container ca59e6dda5b58ad8285db1bb583b8891cb86514f83192aa6c29fdcc79d05dfa8: Status 404 returned error can't find the container with id ca59e6dda5b58ad8285db1bb583b8891cb86514f83192aa6c29fdcc79d05dfa8
Jul 21 15:30:41.274515 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.274470    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:41.274598 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.274567    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:41.274684 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.274629    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:41.925187 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.925151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" event={"ID":"101cefe9-2c3b-4c9c-bd6c-dced9a57a832","Type":"ContainerStarted","Data":"3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"}
Jul 21 15:30:41.925668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.925208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" event={"ID":"101cefe9-2c3b-4c9c-bd6c-dced9a57a832","Type":"ContainerStarted","Data":"ca59e6dda5b58ad8285db1bb583b8891cb86514f83192aa6c29fdcc79d05dfa8"}
Jul 21 15:30:41.952890 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:41.952842    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podStartSLOduration=1.952826785 podStartE2EDuration="1.952826785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:41.950420676 +0000 UTC m=+1806.385208497" watchObservedRunningTime="2026-07-21 15:30:41.952826785 +0000 UTC m=+1806.387614579"
Jul 21 15:30:42.104077 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:42.104047    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:42.109257 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:42.109233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:42.930186 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:42.930154    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:42.931277 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:42.931257    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:30:43.587625 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.587587    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"]
Jul 21 15:30:43.592000 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.591976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.594335 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.594311    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3972e309-serving-cert\""
Jul 21 15:30:43.610688 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.610663    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"]
Jul 21 15:30:43.693678 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.693624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.693870 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.693693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.693870 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.693744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8ndw\" (UniqueName: \"kubernetes.io/projected/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-kube-api-access-r8ndw\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.794525 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.794426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.794525 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.794485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.794802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.794542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8ndw\" (UniqueName: \"kubernetes.io/projected/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-kube-api-access-r8ndw\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.794802 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:30:43.794637    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-serving-cert: secret "maas-api-e2e-migrate-3972e309-serving-cert" not found
Jul 21 15:30:43.794802 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:30:43.794719    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls podName:bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1 nodeName:}" failed. No retries permitted until 2026-07-21 15:30:44.294696545 +0000 UTC m=+1808.729484321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls") pod "maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" (UID: "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1") : secret "maas-api-e2e-migrate-3972e309-serving-cert" not found
Jul 21 15:30:43.795580 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.795556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:43.805477 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:43.805453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8ndw\" (UniqueName: \"kubernetes.io/projected/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-kube-api-access-r8ndw\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:44.300706 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:44.300664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:44.301058 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:30:44.300818    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-serving-cert: secret "maas-api-e2e-migrate-3972e309-serving-cert" not found
Jul 21 15:30:44.301058 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:30:44.300886    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls podName:bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1 nodeName:}" failed. No retries permitted until 2026-07-21 15:30:45.300871209 +0000 UTC m=+1809.735658981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls") pod "maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" (UID: "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1") : secret "maas-api-e2e-migrate-3972e309-serving-cert" not found
Jul 21 15:30:44.943392 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:44.943345    2562 generic.go:356] "Generic (PLEG): container finished" podID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerID="9b2860a1977092f6a1ab9c4940254cdbfac264b7e304b782caa06650f5ebf0e2" exitCode=0
Jul 21 15:30:44.943555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:44.943385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" event={"ID":"a6375f71-9b40-4703-8b72-acfaef9864b9","Type":"ContainerDied","Data":"9b2860a1977092f6a1ab9c4940254cdbfac264b7e304b782caa06650f5ebf0e2"}
Jul 21 15:30:44.943555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:44.943461    2562 scope.go:117] "RemoveContainer" containerID="a19cebcc5957c10db21107faa5523be677f511cd0c636f12fbbcef4c4d736214"
Jul 21 15:30:45.057692 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.057624    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:45.217258 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217220    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-envoy\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-podinfo\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217318    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-data\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-socket\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217387    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-token\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217476    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwx7z\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-kube-api-access-bwx7z\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6375f71-9b40-4703-8b72-acfaef9864b9-istiod-ca-cert\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217660 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217648    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-credential-socket\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-certs\") pod \"a6375f71-9b40-4703-8b72-acfaef9864b9\" (UID: \"a6375f71-9b40-4703-8b72-acfaef9864b9\") "
Jul 21 15:30:45.217823 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217737    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:30:45.217939 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217896    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:30:45.217990 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.217953    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6375f71-9b40-4703-8b72-acfaef9864b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:30:45.218556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.218065    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:30:45.218556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.218343    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.218556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.218398    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6375f71-9b40-4703-8b72-acfaef9864b9-istiod-ca-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.218556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.218412    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-credential-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.218556 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.218426    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-workload-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.218891 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.218582    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:30:45.220106 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.220081    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:30:45.220221 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.220124    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:30:45.220328 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.220309    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-kube-api-access-bwx7z" (OuterVolumeSpecName: "kube-api-access-bwx7z") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "kube-api-access-bwx7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:30:45.220367 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.220339    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6375f71-9b40-4703-8b72-acfaef9864b9" (UID: "a6375f71-9b40-4703-8b72-acfaef9864b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 15:30:45.319269 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.319164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:45.319698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.319287    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwx7z\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-kube-api-access-bwx7z\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.319698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.319303    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-envoy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.319698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.319316    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-podinfo\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.319698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.319328    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-data\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.319698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.319343    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6375f71-9b40-4703-8b72-acfaef9864b9-istio-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:30:45.321728 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.321708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") pod \"maas-api-e2e-migrate-3972e309-698f56c879-dcxdn\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:45.402795 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.402765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:45.549798 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.549775    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"]
Jul 21 15:30:45.551974 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:30:45.551948    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbaf1d2e_5600_44f9_bf7f_52aac6ee57a1.slice/crio-f709f775e2a34c50e891483b781552c31efc98a89d8442e27511bd58a6caa8f9 WatchSource:0}: Error finding container f709f775e2a34c50e891483b781552c31efc98a89d8442e27511bd58a6caa8f9: Status 404 returned error can't find the container with id f709f775e2a34c50e891483b781552c31efc98a89d8442e27511bd58a6caa8f9
Jul 21 15:30:45.957148 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.957116    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"
Jul 21 15:30:45.957348 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.957139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8" event={"ID":"a6375f71-9b40-4703-8b72-acfaef9864b9","Type":"ContainerDied","Data":"96c6ef9c3c1111c9213f93593233ccb8644aef2798ff351cf759942837f5ce41"}
Jul 21 15:30:45.957348 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.957228    2562 scope.go:117] "RemoveContainer" containerID="9b2860a1977092f6a1ab9c4940254cdbfac264b7e304b782caa06650f5ebf0e2"
Jul 21 15:30:45.958636 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.958489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" event={"ID":"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1","Type":"ContainerStarted","Data":"f709f775e2a34c50e891483b781552c31efc98a89d8442e27511bd58a6caa8f9"}
Jul 21 15:30:45.984284 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.984250    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"]
Jul 21 15:30:45.986920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:45.986897    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2f780905-openshift-default-86d44d676f-pb9z8"]
Jul 21 15:30:46.045482 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:46.045449    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" path="/var/lib/kubelet/pods/a6375f71-9b40-4703-8b72-acfaef9864b9/volumes"
Jul 21 15:30:49.984771 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:49.984736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" event={"ID":"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1","Type":"ContainerStarted","Data":"c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f"}
Jul 21 15:30:49.985186 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:49.984883    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:50.006995 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:50.006948    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" podStartSLOduration=3.627055855 podStartE2EDuration="7.006932797s" totalImagesPullingTime="3.379876942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:50.004915813 +0000 UTC m=+1814.439703608" watchObservedRunningTime="2026-07-21 15:30:50.006932797 +0000 UTC m=+1814.441720592"
Jul 21 15:30:55.995324 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:55.995293    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:30:58.750515 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:58.749233    2562 patch_prober.go:28] interesting pod/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:42538->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Jul 21 15:30:58.750515 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:58.749303    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:42538->10.132.0.54:15021: read: connection reset by peer"
Jul 21 15:30:59.041144 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:59.041109    2562 generic.go:356] "Generic (PLEG): container finished" podID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerID="3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58" exitCode=0
Jul 21 15:30:59.041317 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:59.041178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" event={"ID":"101cefe9-2c3b-4c9c-bd6c-dced9a57a832","Type":"ContainerDied","Data":"3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"}
Jul 21 15:30:59.041588 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:59.041571    2562 scope.go:117] "RemoveContainer" containerID="3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"
Jul 21 15:30:59.042694 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:59.042664    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:59.042810 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:59.042751    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:30:59.042810 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:30:59.042786    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:00.047913 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:00.047871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" event={"ID":"101cefe9-2c3b-4c9c-bd6c-dced9a57a832","Type":"ContainerStarted","Data":"518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484"}
Jul 21 15:31:00.104509 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:00.104470    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:31:00.104877 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:00.104854    2562 patch_prober.go:28] interesting pod/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 21 15:31:00.104972 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:00.104909    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 21 15:31:01.104308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:01.104274    2562 patch_prober.go:28] interesting pod/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 21 15:31:01.104722 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:01.104337    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 21 15:31:02.103880 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:02.103843    2562 patch_prober.go:28] interesting pod/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 21 15:31:02.104074 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:02.103898    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 21 15:31:03.104568 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:03.104535    2562 patch_prober.go:28] interesting pod/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 21 15:31:03.104963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:03.104596    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 21 15:31:04.104033 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:04.103996    2562 patch_prober.go:28] interesting pod/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 21 15:31:04.104218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:04.104065    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 21 15:31:05.106992 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:05.106964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:31:05.107370 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:05.107239    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:31:05.107929 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:05.107911    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:31:18.843208 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:18.843171    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"]
Jul 21 15:31:18.843763 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:18.843423    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" podUID="bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" containerName="maas-api" containerID="cri-o://c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f" gracePeriod=30
Jul 21 15:31:19.103885 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.103826    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:31:19.148668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.148626    2562 generic.go:356] "Generic (PLEG): container finished" podID="bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" containerID="c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f" exitCode=0
Jul 21 15:31:19.148668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.148670    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"
Jul 21 15:31:19.148896 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.148704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" event={"ID":"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1","Type":"ContainerDied","Data":"c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f"}
Jul 21 15:31:19.148896 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.148762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn" event={"ID":"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1","Type":"ContainerDied","Data":"f709f775e2a34c50e891483b781552c31efc98a89d8442e27511bd58a6caa8f9"}
Jul 21 15:31:19.148896 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.148787    2562 scope.go:117] "RemoveContainer" containerID="c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f"
Jul 21 15:31:19.157569 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.157553    2562 scope.go:117] "RemoveContainer" containerID="c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f"
Jul 21 15:31:19.157929 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:31:19.157910    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f\": container with ID starting with c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f not found: ID does not exist" containerID="c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f"
Jul 21 15:31:19.157989 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.157938    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f"} err="failed to get container status \"c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f\": rpc error: code = NotFound desc = could not find container \"c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f\": container with ID starting with c7c659308580faaf6b4c4b2e191ce16826ba25e04d7eedb0333881c848b8c01f not found: ID does not exist"
Jul 21 15:31:19.249026 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.248984    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-openshift-service-ca\") pod \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") "
Jul 21 15:31:19.249149 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.249084    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8ndw\" (UniqueName: \"kubernetes.io/projected/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-kube-api-access-r8ndw\") pod \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") "
Jul 21 15:31:19.249149 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.249115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") pod \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\" (UID: \"bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1\") "
Jul 21 15:31:19.249390 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.249368    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" (UID: "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:31:19.251230 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.251203    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" (UID: "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:31:19.251357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.251334    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-kube-api-access-r8ndw" (OuterVolumeSpecName: "kube-api-access-r8ndw") pod "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" (UID: "bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1"). InnerVolumeSpecName "kube-api-access-r8ndw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:31:19.350582 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.350544    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8ndw\" (UniqueName: \"kubernetes.io/projected/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-kube-api-access-r8ndw\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:19.350582 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.350579    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-maas-api-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:19.350786 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.350592    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1-openshift-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:19.474124 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.474094    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"]
Jul 21 15:31:19.478394 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:19.478364    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3972e309-698f56c879-dcxdn"]
Jul 21 15:31:20.043560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:20.043524    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" path="/var/lib/kubelet/pods/bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1/volumes"
Jul 21 15:31:23.609552 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:23.609514    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"]
Jul 21 15:31:23.610164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:23.609821    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy" containerID="cri-o://518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484" gracePeriod=30
Jul 21 15:31:24.353970 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.353934    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"]
Jul 21 15:31:24.354471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354456    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" containerName="maas-api"
Jul 21 15:31:24.354540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354473    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" containerName="maas-api"
Jul 21 15:31:24.354540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354485    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy"
Jul 21 15:31:24.354540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354496    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy"
Jul 21 15:31:24.354540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354523    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy"
Jul 21 15:31:24.354540 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354529    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy"
Jul 21 15:31:24.354841 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354638    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbaf1d2e-5600-44f9-bf7f-52aac6ee57a1" containerName="maas-api"
Jul 21 15:31:24.354841 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354648    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy"
Jul 21 15:31:24.354841 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.354658    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6375f71-9b40-4703-8b72-acfaef9864b9" containerName="istio-proxy"
Jul 21 15:31:24.359191 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.359171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.361805 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.361785    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cb3fc6d5-openshift-default-dockercfg-szlcc\""
Jul 21 15:31:24.371354 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.371333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"]
Jul 21 15:31:24.402557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-socket\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-envoy\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-data\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-podinfo\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402700 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-certs\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402863 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-token\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402863 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-credential-socket\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402863 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istiod-ca-cert\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.402863 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.402835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66x5z\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-kube-api-access-66x5z\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504197 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-data\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-podinfo\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-certs\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-token\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-credential-socket\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istiod-ca-cert\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504716 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66x5z\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-kube-api-access-66x5z\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504716 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-socket\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504716 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-envoy\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-certs\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.504878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.504855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-socket\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.505111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.505087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-credential-socket\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.505177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.505161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istiod-ca-cert\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.505448 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.505430    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-data\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.506882 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.506864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-envoy\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.507438 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.507416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-podinfo\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.516312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.516289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66x5z\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-kube-api-access-66x5z\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.517555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.517535    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-token\") pod \"e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") " pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.671519 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.671436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:24.820860 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.820834    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"]
Jul 21 15:31:24.821714 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:31:24.821678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af89e1e_fb0c_41e2_b483_1d9ab5e053f7.slice/crio-c4655c1413b53a6c76f6944c33735d2377975b06e25dd820acb10ac3d79bc162 WatchSource:0}: Error finding container c4655c1413b53a6c76f6944c33735d2377975b06e25dd820acb10ac3d79bc162: Status 404 returned error can't find the container with id c4655c1413b53a6c76f6944c33735d2377975b06e25dd820acb10ac3d79bc162
Jul 21 15:31:24.823816 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.823788    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:24.823882 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.823852    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:24.823920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:24.823881    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:25.182521 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:25.182481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" event={"ID":"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7","Type":"ContainerStarted","Data":"89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"}
Jul 21 15:31:25.182719 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:25.182546    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" event={"ID":"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7","Type":"ContainerStarted","Data":"c4655c1413b53a6c76f6944c33735d2377975b06e25dd820acb10ac3d79bc162"}
Jul 21 15:31:25.203106 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:25.203057    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podStartSLOduration=1.2030417899999999 podStartE2EDuration="1.20304179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:31:25.202148104 +0000 UTC m=+1849.636935909" watchObservedRunningTime="2026-07-21 15:31:25.20304179 +0000 UTC m=+1849.637829586"
Jul 21 15:31:25.672381 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:25.672347    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:25.677257 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:25.677235    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:26.187753 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.187730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:26.188750 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.188734    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:26.787688 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.787657    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"]
Jul 21 15:31:26.792056 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.792033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.794442 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.794419    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cb3fc6d5-serving-cert\""
Jul 21 15:31:26.800131 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.800106    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"]
Jul 21 15:31:26.830063 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.830029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9fsf\" (UniqueName: \"kubernetes.io/projected/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-kube-api-access-x9fsf\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.830232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.830098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-openshift-service-ca\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.830232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.830202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.930982 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.930944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9fsf\" (UniqueName: \"kubernetes.io/projected/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-kube-api-access-x9fsf\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.931179 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.931041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-openshift-service-ca\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.931179 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.931100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.931317 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:31:26.931232    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-serving-cert: secret "maas-api-e2e-ait-cb3fc6d5-serving-cert" not found
Jul 21 15:31:26.931317 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:31:26.931305    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls podName:bc8af3df-2742-4ed7-966b-80f9f0dbdc17 nodeName:}" failed. No retries permitted until 2026-07-21 15:31:27.431279996 +0000 UTC m=+1851.866067769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls") pod "maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" (UID: "bc8af3df-2742-4ed7-966b-80f9f0dbdc17") : secret "maas-api-e2e-ait-cb3fc6d5-serving-cert" not found
Jul 21 15:31:26.931779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.931756    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-openshift-service-ca\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:26.946498 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:26.946474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9fsf\" (UniqueName: \"kubernetes.io/projected/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-kube-api-access-x9fsf\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:27.436124 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:27.436085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:27.438755 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:27.438730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls\") pod \"maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:27.706899 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:27.706822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:28.064872 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.064849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"]
Jul 21 15:31:28.066794 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:31:28.066761    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8af3df_2742_4ed7_966b_80f9f0dbdc17.slice/crio-47b975997d688eb6db2c3c5a9311f344159be2218f7c919971f4441abf0df5fb WatchSource:0}: Error finding container 47b975997d688eb6db2c3c5a9311f344159be2218f7c919971f4441abf0df5fb: Status 404 returned error can't find the container with id 47b975997d688eb6db2c3c5a9311f344159be2218f7c919971f4441abf0df5fb
Jul 21 15:31:28.199676 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.199639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" event={"ID":"bc8af3df-2742-4ed7-966b-80f9f0dbdc17","Type":"ContainerStarted","Data":"47b975997d688eb6db2c3c5a9311f344159be2218f7c919971f4441abf0df5fb"}
Jul 21 15:31:28.876728 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.876664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:31:28.952681 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952645    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvhd9\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-kube-api-access-vvhd9\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.952681 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istiod-ca-cert\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.952909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-token\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.952909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-credential-socket\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.952909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952813    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-socket\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.952909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-podinfo\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.952909 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952904    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-envoy\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.953167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.952936    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-certs\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.953167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:31:28.953167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953133    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:31:28.953167 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953153    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:31:28.953376 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-data\") pod \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\" (UID: \"101cefe9-2c3b-4c9c-bd6c-dced9a57a832\") "
Jul 21 15:31:28.953434 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953382    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:31:28.953773 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953718    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:28.953773 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953743    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-workload-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:28.953773 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953759    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istiod-ca-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:28.953773 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.953772    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-credential-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:28.954088 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.954071    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-data" (OuterVolumeSpecName: "istio-data") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:31:28.955177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.955147    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:31:28.955281 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.955174    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-token" (OuterVolumeSpecName: "istio-token") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:31:28.955539 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.955524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-kube-api-access-vvhd9" (OuterVolumeSpecName: "kube-api-access-vvhd9") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "kube-api-access-vvhd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:31:28.955581 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:28.955535    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "101cefe9-2c3b-4c9c-bd6c-dced9a57a832" (UID: "101cefe9-2c3b-4c9c-bd6c-dced9a57a832"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 15:31:29.054706 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.054676    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-podinfo\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:29.054706 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.054701    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-envoy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:29.054706 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.054711    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-data\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:29.054888 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.054720    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvhd9\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-kube-api-access-vvhd9\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:29.054888 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.054729    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/101cefe9-2c3b-4c9c-bd6c-dced9a57a832-istio-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:31:29.213951 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.213842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" event={"ID":"bc8af3df-2742-4ed7-966b-80f9f0dbdc17","Type":"ContainerStarted","Data":"d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb"}
Jul 21 15:31:29.214408 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.214088    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:29.215788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.215757    2562 generic.go:356] "Generic (PLEG): container finished" podID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerID="518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484" exitCode=0
Jul 21 15:31:29.215935 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.215804    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"
Jul 21 15:31:29.215935 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.215807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" event={"ID":"101cefe9-2c3b-4c9c-bd6c-dced9a57a832","Type":"ContainerDied","Data":"518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484"}
Jul 21 15:31:29.216052 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.215934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9" event={"ID":"101cefe9-2c3b-4c9c-bd6c-dced9a57a832","Type":"ContainerDied","Data":"ca59e6dda5b58ad8285db1bb583b8891cb86514f83192aa6c29fdcc79d05dfa8"}
Jul 21 15:31:29.216052 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.215966    2562 scope.go:117] "RemoveContainer" containerID="518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484"
Jul 21 15:31:29.226054 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.226034    2562 scope.go:117] "RemoveContainer" containerID="3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"
Jul 21 15:31:29.234521 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.234504    2562 scope.go:117] "RemoveContainer" containerID="518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484"
Jul 21 15:31:29.234833 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:31:29.234808    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484\": container with ID starting with 518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484 not found: ID does not exist" containerID="518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484"
Jul 21 15:31:29.235006 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.234843    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484"} err="failed to get container status \"518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484\": rpc error: code = NotFound desc = could not find container \"518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484\": container with ID starting with 518d6546fbd161d61d82bfa32c55830d3fb490cbc68d829edecd60f7e8a7e484 not found: ID does not exist"
Jul 21 15:31:29.235006 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.234867    2562 scope.go:117] "RemoveContainer" containerID="3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"
Jul 21 15:31:29.235560 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:31:29.235532    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58\": container with ID starting with 3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58 not found: ID does not exist" containerID="3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"
Jul 21 15:31:29.235681 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.235569    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58"} err="failed to get container status \"3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58\": rpc error: code = NotFound desc = could not find container \"3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58\": container with ID starting with 3e5a10bececa59e35f0314e2645a0b1053ed4821785a8f22b944fb8312318e58 not found: ID does not exist"
Jul 21 15:31:29.236483 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.236448    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" podStartSLOduration=2.657805487 podStartE2EDuration="3.236437353s" totalImagesPullingTime="578.631866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:31:29.234971675 +0000 UTC m=+1853.669759490" watchObservedRunningTime="2026-07-21 15:31:29.236437353 +0000 UTC m=+1853.671225147"
Jul 21 15:31:29.248387 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.248365    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"]
Jul 21 15:31:29.252266 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:29.252243    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3972e309-gw-openshift-default-6b4897c9-tm8p9"]
Jul 21 15:31:30.044416 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:30.044386    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" path="/var/lib/kubelet/pods/101cefe9-2c3b-4c9c-bd6c-dced9a57a832/volumes"
Jul 21 15:31:35.234968 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:35.234916    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:31:41.190139 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.190031    2562 patch_prober.go:28] interesting pod/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 21 15:31:41.190139 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.190090    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 21 15:31:41.286387 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.286356    2562 generic.go:356] "Generic (PLEG): container finished" podID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerID="89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8" exitCode=0
Jul 21 15:31:41.286582 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.286434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" event={"ID":"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7","Type":"ContainerDied","Data":"89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"}
Jul 21 15:31:41.286994 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.286965    2562 scope.go:117] "RemoveContainer" containerID="89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"
Jul 21 15:31:41.288004 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.287977    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:41.288088 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.288062    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:41.288149 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:41.288121    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:31:42.293957 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:42.293919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" event={"ID":"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7","Type":"ContainerStarted","Data":"1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d"}
Jul 21 15:31:42.672769 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:42.672673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:42.672945 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:42.672924    2562 patch_prober.go:28] interesting pod/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 21 15:31:42.673023 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:42.672982    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 21 15:31:43.672052 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:43.672014    2562 patch_prober.go:28] interesting pod/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 21 15:31:43.672462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:43.672074    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 21 15:31:44.672349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:44.672313    2562 patch_prober.go:28] interesting pod/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 21 15:31:44.672753 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:44.672365    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 21 15:31:45.672251 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:45.672217    2562 patch_prober.go:28] interesting pod/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 21 15:31:45.672408 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:45.672275    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 21 15:31:46.676218 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:46.676184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:46.676604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:46.676545    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:31:46.677232 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:31:46.677211    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:32:02.744657 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:02.744517    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"]
Jul 21 15:32:02.745100 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:02.744797    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" podUID="bc8af3df-2742-4ed7-966b-80f9f0dbdc17" containerName="maas-api" containerID="cri-o://d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb" gracePeriod=30
Jul 21 15:32:03.006000 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.005935    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:32:03.104720 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.104689    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9fsf\" (UniqueName: \"kubernetes.io/projected/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-kube-api-access-x9fsf\") pod \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") "
Jul 21 15:32:03.104891 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.104760    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls\") pod \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") "
Jul 21 15:32:03.104891 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.104821    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-openshift-service-ca\") pod \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\" (UID: \"bc8af3df-2742-4ed7-966b-80f9f0dbdc17\") "
Jul 21 15:32:03.105228 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.105194    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc8af3df-2742-4ed7-966b-80f9f0dbdc17" (UID: "bc8af3df-2742-4ed7-966b-80f9f0dbdc17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:32:03.107006 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.106982    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc8af3df-2742-4ed7-966b-80f9f0dbdc17" (UID: "bc8af3df-2742-4ed7-966b-80f9f0dbdc17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:32:03.107126 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.107050    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-kube-api-access-x9fsf" (OuterVolumeSpecName: "kube-api-access-x9fsf") pod "bc8af3df-2742-4ed7-966b-80f9f0dbdc17" (UID: "bc8af3df-2742-4ed7-966b-80f9f0dbdc17"). InnerVolumeSpecName "kube-api-access-x9fsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:32:03.205668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.205630    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9fsf\" (UniqueName: \"kubernetes.io/projected/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-kube-api-access-x9fsf\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:03.205668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.205665    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-maas-api-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:03.205668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.205674    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc8af3df-2742-4ed7-966b-80f9f0dbdc17-openshift-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:03.401482 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.401446    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc8af3df-2742-4ed7-966b-80f9f0dbdc17" containerID="d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb" exitCode=0
Jul 21 15:32:03.401713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.401493    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"
Jul 21 15:32:03.401713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.401526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" event={"ID":"bc8af3df-2742-4ed7-966b-80f9f0dbdc17","Type":"ContainerDied","Data":"d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb"}
Jul 21 15:32:03.401713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.401579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg" event={"ID":"bc8af3df-2742-4ed7-966b-80f9f0dbdc17","Type":"ContainerDied","Data":"47b975997d688eb6db2c3c5a9311f344159be2218f7c919971f4441abf0df5fb"}
Jul 21 15:32:03.401713 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.401602    2562 scope.go:117] "RemoveContainer" containerID="d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb"
Jul 21 15:32:03.411302 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.411264    2562 scope.go:117] "RemoveContainer" containerID="d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb"
Jul 21 15:32:03.411537 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:32:03.411516    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb\": container with ID starting with d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb not found: ID does not exist" containerID="d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb"
Jul 21 15:32:03.411586 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.411546    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb"} err="failed to get container status \"d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb\": rpc error: code = NotFound desc = could not find container \"d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb\": container with ID starting with d29b5c8612ab6229faf2e3a7ea4ec4a2da98330505435c3a044382d1cd59becb not found: ID does not exist"
Jul 21 15:32:03.423736 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.423707    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"]
Jul 21 15:32:03.427657 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:03.427634    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cb3fc6d5-5564ff99cb-26cfg"]
Jul 21 15:32:04.043568 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:04.043529    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc8af3df-2742-4ed7-966b-80f9f0dbdc17" path="/var/lib/kubelet/pods/bc8af3df-2742-4ed7-966b-80f9f0dbdc17/volumes"
Jul 21 15:32:09.454229 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:09.454195    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"]
Jul 21 15:32:09.454793 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:09.454459    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy" containerID="cri-o://1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d" gracePeriod=30
Jul 21 15:32:10.209938 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.209900    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"]
Jul 21 15:32:10.211012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.210983    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy"
Jul 21 15:32:10.211012 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.211015    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy"
Jul 21 15:32:10.211206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.211078    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc8af3df-2742-4ed7-966b-80f9f0dbdc17" containerName="maas-api"
Jul 21 15:32:10.211206 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.211088    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc8af3df-2742-4ed7-966b-80f9f0dbdc17" containerName="maas-api"
Jul 21 15:32:10.211327 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.211310    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc8af3df-2742-4ed7-966b-80f9f0dbdc17" containerName="maas-api"
Jul 21 15:32:10.211391 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.211335    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy"
Jul 21 15:32:10.211391 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.211358    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy"
Jul 21 15:32:10.226350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.226310    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"]
Jul 21 15:32:10.226506 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.226424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.229967 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.229314    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-abfd2548-openshift-default-dockercfg-zjrsb\""
Jul 21 15:32:10.276584 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22304dcf-4b64-481a-bc58-e65658f5ae86-istiod-ca-cert\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276584 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-envoy\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276817 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-podinfo\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276817 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-token\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276817 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-credential-socket\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276817 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-data\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxdrt\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-kube-api-access-sxdrt\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-socket\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.276963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.276873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-certs\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.377597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdrt\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-kube-api-access-sxdrt\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.377806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-socket\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.377806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-certs\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.377806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22304dcf-4b64-481a-bc58-e65658f5ae86-istiod-ca-cert\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.377806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-envoy\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.377806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-podinfo\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-token\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-credential-socket\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378084 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.377949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-data\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378210 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.378099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-socket\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378270 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.378257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-data\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378371 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.378340    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-certs\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378371 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.378366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-credential-socket\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.378742 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.378721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22304dcf-4b64-481a-bc58-e65658f5ae86-istiod-ca-cert\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.380554 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.380527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-envoy\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.380815 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.380794    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-podinfo\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.386096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.386071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-token\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.386460 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.386442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxdrt\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-kube-api-access-sxdrt\") pod \"e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") " pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.539775 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.539741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:10.719715 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.719690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"]
Jul 21 15:32:10.722333 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:32:10.722276    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22304dcf_4b64_481a_bc58_e65658f5ae86.slice/crio-cb2150e5ececc28e2452fbc17e92d44070d2e854ce7bd9dc7a7c13b89f6c3b97 WatchSource:0}: Error finding container cb2150e5ececc28e2452fbc17e92d44070d2e854ce7bd9dc7a7c13b89f6c3b97: Status 404 returned error can't find the container with id cb2150e5ececc28e2452fbc17e92d44070d2e854ce7bd9dc7a7c13b89f6c3b97
Jul 21 15:32:10.724806 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.724772    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:32:10.724894 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.724844    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:32:10.724894 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:10.724877    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:32:11.447952 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:11.447910    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" event={"ID":"22304dcf-4b64-481a-bc58-e65658f5ae86","Type":"ContainerStarted","Data":"e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"}
Jul 21 15:32:11.448158 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:11.447965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" event={"ID":"22304dcf-4b64-481a-bc58-e65658f5ae86","Type":"ContainerStarted","Data":"cb2150e5ececc28e2452fbc17e92d44070d2e854ce7bd9dc7a7c13b89f6c3b97"}
Jul 21 15:32:11.470587 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:11.470532    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podStartSLOduration=1.470517673 podStartE2EDuration="1.470517673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:32:11.46907919 +0000 UTC m=+1895.903867018" watchObservedRunningTime="2026-07-21 15:32:11.470517673 +0000 UTC m=+1895.905305467"
Jul 21 15:32:11.539885 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:11.539858    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:11.545121 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:11.545100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:12.453341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.453312    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:12.454214 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.454193    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:12.925433 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.925397    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"]
Jul 21 15:32:12.926505 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.926477    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy"
Jul 21 15:32:12.926600 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.926509    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="101cefe9-2c3b-4c9c-bd6c-dced9a57a832" containerName="istio-proxy"
Jul 21 15:32:12.929847 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.929822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:12.932227 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.932210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-abfd2548-serving-cert\""
Jul 21 15:32:12.939422 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:12.939400    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"]
Jul 21 15:32:13.006105 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.006059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80554f6a-ea29-410a-b7de-b2a1799101b4-openshift-service-ca\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.006276 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.006120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80554f6a-ea29-410a-b7de-b2a1799101b4-maas-api-tls\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.006276 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.006193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtk2b\" (UniqueName: \"kubernetes.io/projected/80554f6a-ea29-410a-b7de-b2a1799101b4-kube-api-access-mtk2b\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.107521 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.107488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtk2b\" (UniqueName: \"kubernetes.io/projected/80554f6a-ea29-410a-b7de-b2a1799101b4-kube-api-access-mtk2b\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.107746 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.107636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80554f6a-ea29-410a-b7de-b2a1799101b4-openshift-service-ca\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.107746 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.107674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80554f6a-ea29-410a-b7de-b2a1799101b4-maas-api-tls\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.108259 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.108237    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80554f6a-ea29-410a-b7de-b2a1799101b4-openshift-service-ca\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.110194 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.110172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80554f6a-ea29-410a-b7de-b2a1799101b4-maas-api-tls\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.117015 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.116986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtk2b\" (UniqueName: \"kubernetes.io/projected/80554f6a-ea29-410a-b7de-b2a1799101b4-kube-api-access-mtk2b\") pod \"maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.243900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.243823    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:13.401196 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.400968    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"]
Jul 21 15:32:13.404089 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:32:13.404046    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80554f6a_ea29_410a_b7de_b2a1799101b4.slice/crio-8769df7833c5c5eb4f87a8493fe8879e84885a03bec52958a51a525e70c00b76 WatchSource:0}: Error finding container 8769df7833c5c5eb4f87a8493fe8879e84885a03bec52958a51a525e70c00b76: Status 404 returned error can't find the container with id 8769df7833c5c5eb4f87a8493fe8879e84885a03bec52958a51a525e70c00b76
Jul 21 15:32:13.459603 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:13.459566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2" event={"ID":"80554f6a-ea29-410a-b7de-b2a1799101b4","Type":"ContainerStarted","Data":"8769df7833c5c5eb4f87a8493fe8879e84885a03bec52958a51a525e70c00b76"}
Jul 21 15:32:14.468284 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.468254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2" event={"ID":"80554f6a-ea29-410a-b7de-b2a1799101b4","Type":"ContainerStarted","Data":"1a0e60fd1672e81f4fd9b2d49382253dd1d511ab4dbcdf86564766b12adbcb61"}
Jul 21 15:32:14.468738 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.468352    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:14.489407 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.489368    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2" podStartSLOduration=2.137179697 podStartE2EDuration="2.489354196s" totalImagesPullingTime="352.174499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:32:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:32:14.488112575 +0000 UTC m=+1898.922900369" watchObservedRunningTime="2026-07-21 15:32:14.489354196 +0000 UTC m=+1898.924141990"
Jul 21 15:32:14.731530 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.731464    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:32:14.826866 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.826831    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66x5z\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-kube-api-access-66x5z\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.826874    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-credential-socket\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.826899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-socket\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.826937    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-envoy\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.826971    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-data\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.826991    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istiod-ca-cert\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827008    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-podinfo\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827048    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-token\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-certs\") pod \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\" (UID: \"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7\") "
Jul 21 15:32:14.827480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827189    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:14.827480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827231    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:14.827480 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827415    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:14.827905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827516    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.827905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827543    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-credential-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.827905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827560    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-workload-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.827905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827874    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:14.827905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.827891    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:32:14.829357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.829333    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:14.829438 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.829356    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-kube-api-access-66x5z" (OuterVolumeSpecName: "kube-api-access-66x5z") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "kube-api-access-66x5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:32:14.829859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.829839    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 15:32:14.829910 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.829833    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" (UID: "0af89e1e-fb0c-41e2-b483-1d9ab5e053f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:32:14.928073 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.928036    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66x5z\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-kube-api-access-66x5z\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.928073 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.928068    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-envoy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.928073 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.928077    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-data\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.928073 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.928084    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istiod-ca-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.928322 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.928092    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-podinfo\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:14.928322 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:14.928101    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7-istio-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:15.475954 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.475919    2562 generic.go:356] "Generic (PLEG): container finished" podID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerID="1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d" exitCode=0
Jul 21 15:32:15.476429 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.475975    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"
Jul 21 15:32:15.476429 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.476015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" event={"ID":"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7","Type":"ContainerDied","Data":"1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d"}
Jul 21 15:32:15.476429 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.476084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd" event={"ID":"0af89e1e-fb0c-41e2-b483-1d9ab5e053f7","Type":"ContainerDied","Data":"c4655c1413b53a6c76f6944c33735d2377975b06e25dd820acb10ac3d79bc162"}
Jul 21 15:32:15.476429 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.476119    2562 scope.go:117] "RemoveContainer" containerID="1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d"
Jul 21 15:32:15.486275 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.486261    2562 scope.go:117] "RemoveContainer" containerID="89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"
Jul 21 15:32:15.495424 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.495404    2562 scope.go:117] "RemoveContainer" containerID="1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d"
Jul 21 15:32:15.495702 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:32:15.495681    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d\": container with ID starting with 1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d not found: ID does not exist" containerID="1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d"
Jul 21 15:32:15.495789 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.495709    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d"} err="failed to get container status \"1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d\": rpc error: code = NotFound desc = could not find container \"1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d\": container with ID starting with 1964d60975d78b7ca841876e250cdf772c8471334e2b25e62a9e0e73ef816a0d not found: ID does not exist"
Jul 21 15:32:15.495789 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.495728    2562 scope.go:117] "RemoveContainer" containerID="89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"
Jul 21 15:32:15.495964 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:32:15.495946    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8\": container with ID starting with 89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8 not found: ID does not exist" containerID="89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"
Jul 21 15:32:15.496011 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.495972    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8"} err="failed to get container status \"89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8\": rpc error: code = NotFound desc = could not find container \"89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8\": container with ID starting with 89d39e33138217ba3627dce959296a256f703f2b8c5f607096fd378c742431c8 not found: ID does not exist"
Jul 21 15:32:15.500170 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.500150    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"]
Jul 21 15:32:15.503862 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:15.503835    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cb3fc6d5-openshift-default-9df67b679-2p6qd"]
Jul 21 15:32:16.043338 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:16.043302    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" path="/var/lib/kubelet/pods/0af89e1e-fb0c-41e2-b483-1d9ab5e053f7/volumes"
Jul 21 15:32:20.481520 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:20.481491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:27.987943 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:27.986579    2562 patch_prober.go:28] interesting pod/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:41908->10.132.0.58:15021: read: connection reset by peer" start-of-body=
Jul 21 15:32:27.987943 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:27.986680    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": read tcp 10.132.0.2:41908->10.132.0.58:15021: read: connection reset by peer"
Jul 21 15:32:28.556763 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:28.556731    2562 generic.go:356] "Generic (PLEG): container finished" podID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerID="e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768" exitCode=0
Jul 21 15:32:28.556932 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:28.556808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" event={"ID":"22304dcf-4b64-481a-bc58-e65658f5ae86","Type":"ContainerDied","Data":"e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"}
Jul 21 15:32:28.557235 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:28.557220    2562 scope.go:117] "RemoveContainer" containerID="e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"
Jul 21 15:32:28.558252 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:28.558226    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:32:28.558349 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:28.558315    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:32:28.558396 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:28.558353    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:32:29.564439 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:29.564405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" event={"ID":"22304dcf-4b64-481a-bc58-e65658f5ae86","Type":"ContainerStarted","Data":"f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e"}
Jul 21 15:32:30.540435 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:30.540388    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:30.540790 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:30.540772    2562 patch_prober.go:28] interesting pod/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 21 15:32:30.540869 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:30.540812    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 21 15:32:31.540753 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:31.540714    2562 patch_prober.go:28] interesting pod/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 21 15:32:31.541149 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:31.540771    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 21 15:32:32.540963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:32.540926    2562 patch_prober.go:28] interesting pod/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 21 15:32:32.541367 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:32.540981    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 21 15:32:33.541033 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:33.540986    2562 patch_prober.go:28] interesting pod/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 21 15:32:33.541451 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:33.541065    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 21 15:32:34.543853 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:34.543823    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:34.544295 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:34.544272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:34.544934 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:34.544914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:48.432470 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.432428    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"]
Jul 21 15:32:48.433080 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.432814    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2" podUID="80554f6a-ea29-410a-b7de-b2a1799101b4" containerName="maas-api" containerID="cri-o://1a0e60fd1672e81f4fd9b2d49382253dd1d511ab4dbcdf86564766b12adbcb61" gracePeriod=30
Jul 21 15:32:48.668887 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.668849    2562 generic.go:356] "Generic (PLEG): container finished" podID="80554f6a-ea29-410a-b7de-b2a1799101b4" containerID="1a0e60fd1672e81f4fd9b2d49382253dd1d511ab4dbcdf86564766b12adbcb61" exitCode=0
Jul 21 15:32:48.669096 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.668923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2" event={"ID":"80554f6a-ea29-410a-b7de-b2a1799101b4","Type":"ContainerDied","Data":"1a0e60fd1672e81f4fd9b2d49382253dd1d511ab4dbcdf86564766b12adbcb61"}
Jul 21 15:32:48.701475 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.701452    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:48.773976 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.773943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80554f6a-ea29-410a-b7de-b2a1799101b4-openshift-service-ca\") pod \"80554f6a-ea29-410a-b7de-b2a1799101b4\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") "
Jul 21 15:32:48.774177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.774006    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80554f6a-ea29-410a-b7de-b2a1799101b4-maas-api-tls\") pod \"80554f6a-ea29-410a-b7de-b2a1799101b4\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") "
Jul 21 15:32:48.774177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.774030    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtk2b\" (UniqueName: \"kubernetes.io/projected/80554f6a-ea29-410a-b7de-b2a1799101b4-kube-api-access-mtk2b\") pod \"80554f6a-ea29-410a-b7de-b2a1799101b4\" (UID: \"80554f6a-ea29-410a-b7de-b2a1799101b4\") "
Jul 21 15:32:48.774339 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.774314    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80554f6a-ea29-410a-b7de-b2a1799101b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80554f6a-ea29-410a-b7de-b2a1799101b4" (UID: "80554f6a-ea29-410a-b7de-b2a1799101b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:32:48.776400 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.776373    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80554f6a-ea29-410a-b7de-b2a1799101b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80554f6a-ea29-410a-b7de-b2a1799101b4" (UID: "80554f6a-ea29-410a-b7de-b2a1799101b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:32:48.776495 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.776399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80554f6a-ea29-410a-b7de-b2a1799101b4-kube-api-access-mtk2b" (OuterVolumeSpecName: "kube-api-access-mtk2b") pod "80554f6a-ea29-410a-b7de-b2a1799101b4" (UID: "80554f6a-ea29-410a-b7de-b2a1799101b4"). InnerVolumeSpecName "kube-api-access-mtk2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:32:48.875142 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.875105    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80554f6a-ea29-410a-b7de-b2a1799101b4-maas-api-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:48.875142 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.875137    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtk2b\" (UniqueName: \"kubernetes.io/projected/80554f6a-ea29-410a-b7de-b2a1799101b4-kube-api-access-mtk2b\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:48.875142 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:48.875150    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80554f6a-ea29-410a-b7de-b2a1799101b4-openshift-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:49.675976 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:49.675945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"
Jul 21 15:32:49.675976 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:49.675956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2" event={"ID":"80554f6a-ea29-410a-b7de-b2a1799101b4","Type":"ContainerDied","Data":"8769df7833c5c5eb4f87a8493fe8879e84885a03bec52958a51a525e70c00b76"}
Jul 21 15:32:49.676437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:49.676013    2562 scope.go:117] "RemoveContainer" containerID="1a0e60fd1672e81f4fd9b2d49382253dd1d511ab4dbcdf86564766b12adbcb61"
Jul 21 15:32:49.699111 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:49.699075    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"]
Jul 21 15:32:49.702549 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:49.702523    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-abfd2548-76dc5cf4b7-cf4p2"]
Jul 21 15:32:50.044471 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:50.044431    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80554f6a-ea29-410a-b7de-b2a1799101b4" path="/var/lib/kubelet/pods/80554f6a-ea29-410a-b7de-b2a1799101b4/volumes"
Jul 21 15:32:52.877222 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:52.877185    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"]
Jul 21 15:32:52.877727 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:52.877465    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy" containerID="cri-o://f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e" gracePeriod=30
Jul 21 15:32:58.144340 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.144274    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:58.265505 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265471    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22304dcf-4b64-481a-bc58-e65658f5ae86-istiod-ca-cert\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265723 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265521    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-podinfo\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265723 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265547    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-certs\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265723 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-credential-socket\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265723 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxdrt\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-kube-api-access-sxdrt\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265999 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-socket\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265999 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265763    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-data\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265999 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-token\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265999 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265835    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-envoy\") pod \"22304dcf-4b64-481a-bc58-e65658f5ae86\" (UID: \"22304dcf-4b64-481a-bc58-e65658f5ae86\") "
Jul 21 15:32:58.265999 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265919    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:58.266237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.265994    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:58.266237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.266028    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22304dcf-4b64-481a-bc58-e65658f5ae86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:32:58.266237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.266206    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22304dcf-4b64-481a-bc58-e65658f5ae86-istiod-ca-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.266237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.266224    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.266237 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.266237    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-credential-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.266678 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.266367    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:58.267022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.266989    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-data" (OuterVolumeSpecName: "istio-data") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:58.268106 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.268077    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 15:32:58.268213 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.268120    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:32:58.268213 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.268140    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-kube-api-access-sxdrt" (OuterVolumeSpecName: "kube-api-access-sxdrt") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "kube-api-access-sxdrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:32:58.268292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.268227    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-token" (OuterVolumeSpecName: "istio-token") pod "22304dcf-4b64-481a-bc58-e65658f5ae86" (UID: "22304dcf-4b64-481a-bc58-e65658f5ae86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:32:58.367655 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.367585    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxdrt\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-kube-api-access-sxdrt\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.367655 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.367645    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-workload-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.367655 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.367659    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-data\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.367907 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.367673    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.367907 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.367684    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-envoy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.367907 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.367697    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22304dcf-4b64-481a-bc58-e65658f5ae86-istio-podinfo\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:32:58.729285 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.729246    2562 generic.go:356] "Generic (PLEG): container finished" podID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerID="f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e" exitCode=0
Jul 21 15:32:58.729501 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.729303    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"
Jul 21 15:32:58.729501 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.729324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" event={"ID":"22304dcf-4b64-481a-bc58-e65658f5ae86","Type":"ContainerDied","Data":"f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e"}
Jul 21 15:32:58.729501 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.729379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2" event={"ID":"22304dcf-4b64-481a-bc58-e65658f5ae86","Type":"ContainerDied","Data":"cb2150e5ececc28e2452fbc17e92d44070d2e854ce7bd9dc7a7c13b89f6c3b97"}
Jul 21 15:32:58.729501 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.729402    2562 scope.go:117] "RemoveContainer" containerID="f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e"
Jul 21 15:32:58.739348 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.739331    2562 scope.go:117] "RemoveContainer" containerID="e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"
Jul 21 15:32:58.747840 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.747823    2562 scope.go:117] "RemoveContainer" containerID="f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e"
Jul 21 15:32:58.748100 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:32:58.748082    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e\": container with ID starting with f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e not found: ID does not exist" containerID="f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e"
Jul 21 15:32:58.748173 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.748114    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e"} err="failed to get container status \"f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e\": rpc error: code = NotFound desc = could not find container \"f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e\": container with ID starting with f4b051d434865175edbec8a602349c299021cac46e278e0956fce416b042190e not found: ID does not exist"
Jul 21 15:32:58.748173 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.748142    2562 scope.go:117] "RemoveContainer" containerID="e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"
Jul 21 15:32:58.748389 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:32:58.748372    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768\": container with ID starting with e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768 not found: ID does not exist" containerID="e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"
Jul 21 15:32:58.748428 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.748396    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768"} err="failed to get container status \"e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768\": rpc error: code = NotFound desc = could not find container \"e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768\": container with ID starting with e6a149705b9ab4b5b81b7962c4c0e51ee6df302852b93250ea006e3d190fa768 not found: ID does not exist"
Jul 21 15:32:58.756132 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.756100    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"]
Jul 21 15:32:58.761767 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:32:58.761742    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-abfd2548-openshift-default-775cbb6b47-462d2"]
Jul 21 15:33:00.043410 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:33:00.043377    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" path="/var/lib/kubelet/pods/22304dcf-4b64-481a-bc58-e65658f5ae86/volumes"
Jul 21 15:34:29.305318 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305288    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"]
Jul 21 15:34:29.305804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305746    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy"
Jul 21 15:34:29.305804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305760    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy"
Jul 21 15:34:29.305804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305769    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80554f6a-ea29-410a-b7de-b2a1799101b4" containerName="maas-api"
Jul 21 15:34:29.305804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305775    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="80554f6a-ea29-410a-b7de-b2a1799101b4" containerName="maas-api"
Jul 21 15:34:29.305804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305783    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy"
Jul 21 15:34:29.305804 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305788    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy"
Jul 21 15:34:29.306027 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305874    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy"
Jul 21 15:34:29.306027 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305886    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy"
Jul 21 15:34:29.306027 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305894    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="80554f6a-ea29-410a-b7de-b2a1799101b4" containerName="maas-api"
Jul 21 15:34:29.306027 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.305902    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy"
Jul 21 15:34:29.308853 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.308835    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.311356 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.311335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9365ce5e-openshift-default-dockercfg-qmlb5\""
Jul 21 15:34:29.334112 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.334083    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"]
Jul 21 15:34:29.340045 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-credential-socket\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-token\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7gb\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-kube-api-access-qz7gb\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-data\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340206    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-socket\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-podinfo\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340308 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc69e52b-0566-4511-bea2-2dfffc5bc677-istiod-ca-cert\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340692 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-certs\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.340692 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.340412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-envoy\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441026 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.440985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-data\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441026 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-socket\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-podinfo\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc69e52b-0566-4511-bea2-2dfffc5bc677-istiod-ca-cert\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-certs\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-envoy\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-credential-socket\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441292 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-token\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441656 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7gb\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-kube-api-access-qz7gb\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441656 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-socket\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441802 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-data\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441864 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-certs\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441940 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441922    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc69e52b-0566-4511-bea2-2dfffc5bc677-istiod-ca-cert\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.441996 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.441941    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-credential-socket\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.443702 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.443677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-envoy\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.443852 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.443835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-podinfo\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.449979 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.449957    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-token\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.450329 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.450309    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7gb\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-kube-api-access-qz7gb\") pod \"e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") " pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.619889 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.619790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:29.768523 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.768489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"]
Jul 21 15:34:29.772009 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:34:29.771981    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc69e52b_0566_4511_bea2_2dfffc5bc677.slice/crio-b6a5db2871c3e070cbb9bdba6e9a901974ad6a01f4c4db6bd8f3467ca6e532ba WatchSource:0}: Error finding container b6a5db2871c3e070cbb9bdba6e9a901974ad6a01f4c4db6bd8f3467ca6e532ba: Status 404 returned error can't find the container with id b6a5db2871c3e070cbb9bdba6e9a901974ad6a01f4c4db6bd8f3467ca6e532ba
Jul 21 15:34:29.774636 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.774574    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:34:29.774779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.774681    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:34:29.774779 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:29.774723    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:34:30.198517 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:30.198481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" event={"ID":"fc69e52b-0566-4511-bea2-2dfffc5bc677","Type":"ContainerStarted","Data":"c33d3d7fc6b475321f00fde4c877750c8e71fafd6cbcd56027ebaee54a27fb26"}
Jul 21 15:34:30.198714 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:30.198542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" event={"ID":"fc69e52b-0566-4511-bea2-2dfffc5bc677","Type":"ContainerStarted","Data":"b6a5db2871c3e070cbb9bdba6e9a901974ad6a01f4c4db6bd8f3467ca6e532ba"}
Jul 21 15:34:30.220833 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:30.220779    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" podStartSLOduration=1.220759253 podStartE2EDuration="1.220759253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:34:30.218550087 +0000 UTC m=+2034.653337882" watchObservedRunningTime="2026-07-21 15:34:30.220759253 +0000 UTC m=+2034.655547046"
Jul 21 15:34:30.620279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:30.620242    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:30.625269 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:30.625237    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:31.203577 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:31.203543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:31.204564 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:31.204547    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:32.236941 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.236908    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"]
Jul 21 15:34:32.237521 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.237500    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy"
Jul 21 15:34:32.237604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.237524    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy"
Jul 21 15:34:32.237604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.237581    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy"
Jul 21 15:34:32.237604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.237592    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af89e1e-fb0c-41e2-b483-1d9ab5e053f7" containerName="istio-proxy"
Jul 21 15:34:32.237788 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.237719    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="22304dcf-4b64-481a-bc58-e65658f5ae86" containerName="istio-proxy"
Jul 21 15:34:32.241143 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.241122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.244921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.244897    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9365ce5e-serving-cert\""
Jul 21 15:34:32.262921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.262900    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"]
Jul 21 15:34:32.267857 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.267829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-openshift-service-ca\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.267984 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.267910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cqwx\" (UniqueName: \"kubernetes.io/projected/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-kube-api-access-2cqwx\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.268155 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.268127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.369386 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.369346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-openshift-service-ca\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.369557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.369403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cqwx\" (UniqueName: \"kubernetes.io/projected/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-kube-api-access-2cqwx\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.369557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.369480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.369658 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:34:32.369582    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-serving-cert: secret "maas-api-e2e-mt-9365ce5e-serving-cert" not found
Jul 21 15:34:32.369707 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:34:32.369665    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls podName:9a1d1a7d-cf7c-4b58-9d83-5691893e2840 nodeName:}" failed. No retries permitted until 2026-07-21 15:34:32.869648633 +0000 UTC m=+2037.304436405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls") pod "maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" (UID: "9a1d1a7d-cf7c-4b58-9d83-5691893e2840") : secret "maas-api-e2e-mt-9365ce5e-serving-cert" not found
Jul 21 15:34:32.370270 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.370238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-openshift-service-ca\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.390021 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.389996    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cqwx\" (UniqueName: \"kubernetes.io/projected/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-kube-api-access-2cqwx\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.875019 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.874982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:32.877668 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:32.877646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls\") pod \"maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:33.153049 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:33.152962    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:33.300843 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:33.300816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"]
Jul 21 15:34:33.302545 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:34:33.302516    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1d1a7d_cf7c_4b58_9d83_5691893e2840.slice/crio-1fd185bbbd5e3ded7780b5b2bd169b9cfe1ea719d9468770692cab9c1f83c374 WatchSource:0}: Error finding container 1fd185bbbd5e3ded7780b5b2bd169b9cfe1ea719d9468770692cab9c1f83c374: Status 404 returned error can't find the container with id 1fd185bbbd5e3ded7780b5b2bd169b9cfe1ea719d9468770692cab9c1f83c374
Jul 21 15:34:34.220928 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:34.220892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" event={"ID":"9a1d1a7d-cf7c-4b58-9d83-5691893e2840","Type":"ContainerStarted","Data":"1fd185bbbd5e3ded7780b5b2bd169b9cfe1ea719d9468770692cab9c1f83c374"}
Jul 21 15:34:35.231253 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:35.231209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" event={"ID":"9a1d1a7d-cf7c-4b58-9d83-5691893e2840","Type":"ContainerStarted","Data":"9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1"}
Jul 21 15:34:35.232092 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:35.232062    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:35.259161 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:35.259114    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" podStartSLOduration=2.012160161 podStartE2EDuration="3.259098458s" totalImagesPullingTime="1.246938297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:34:35.257640868 +0000 UTC m=+2039.692428682" watchObservedRunningTime="2026-07-21 15:34:35.259098458 +0000 UTC m=+2039.693886252"
Jul 21 15:34:42.250697 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.250668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:42.275753 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.275720    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerID="c33d3d7fc6b475321f00fde4c877750c8e71fafd6cbcd56027ebaee54a27fb26" exitCode=0
Jul 21 15:34:42.275938 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.275765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" event={"ID":"fc69e52b-0566-4511-bea2-2dfffc5bc677","Type":"ContainerDied","Data":"c33d3d7fc6b475321f00fde4c877750c8e71fafd6cbcd56027ebaee54a27fb26"}
Jul 21 15:34:42.276265 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.276243    2562 scope.go:117] "RemoveContainer" containerID="c33d3d7fc6b475321f00fde4c877750c8e71fafd6cbcd56027ebaee54a27fb26"
Jul 21 15:34:42.277757 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.277721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:34:42.277886 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.277805    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:34:42.277886 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:42.277847    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 15:34:43.286543 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:43.286498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" event={"ID":"fc69e52b-0566-4511-bea2-2dfffc5bc677","Type":"ContainerStarted","Data":"a1dde8ef68903f673a975299c1d66abf4f152e4d3258194ec934397224fb604d"}
Jul 21 15:34:43.621816 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:43.621705    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:43.622003 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:43.621851    2562 patch_prober.go:28] interesting pod/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 21 15:34:43.622003 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:43.621916    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 21 15:34:44.621058 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:44.621019    2562 patch_prober.go:28] interesting pod/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 21 15:34:44.621694 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:44.621650    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 21 15:34:45.621560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:45.621077    2562 patch_prober.go:28] interesting pod/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 21 15:34:45.621560 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:45.621162    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 21 15:34:46.203913 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:46.203882    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:46.628178 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:46.628136    2562 patch_prober.go:28] interesting pod/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 21 15:34:46.628822 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:46.628785    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 21 15:34:47.625302 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:47.625272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:47.626373 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:47.626349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:34:54.353850 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.353816    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"]
Jul 21 15:34:54.354790 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.354578    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" podUID="9a1d1a7d-cf7c-4b58-9d83-5691893e2840" containerName="maas-api" containerID="cri-o://9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1" gracePeriod=30
Jul 21 15:34:54.616464 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.616396    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:54.710058 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.710022    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cqwx\" (UniqueName: \"kubernetes.io/projected/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-kube-api-access-2cqwx\") pod \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") "
Jul 21 15:34:54.710058 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.710067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls\") pod \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") "
Jul 21 15:34:54.710279 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.710156    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-openshift-service-ca\") pod \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\" (UID: \"9a1d1a7d-cf7c-4b58-9d83-5691893e2840\") "
Jul 21 15:34:54.710563 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.710535    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a1d1a7d-cf7c-4b58-9d83-5691893e2840" (UID: "9a1d1a7d-cf7c-4b58-9d83-5691893e2840"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:34:54.712289 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.712268    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a1d1a7d-cf7c-4b58-9d83-5691893e2840" (UID: "9a1d1a7d-cf7c-4b58-9d83-5691893e2840"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 15:34:54.712289 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.712274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-kube-api-access-2cqwx" (OuterVolumeSpecName: "kube-api-access-2cqwx") pod "9a1d1a7d-cf7c-4b58-9d83-5691893e2840" (UID: "9a1d1a7d-cf7c-4b58-9d83-5691893e2840"). InnerVolumeSpecName "kube-api-access-2cqwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:34:54.811004 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.810970    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cqwx\" (UniqueName: \"kubernetes.io/projected/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-kube-api-access-2cqwx\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:34:54.811004 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.811002    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-maas-api-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:34:54.811004 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:54.811011    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1d1a7d-cf7c-4b58-9d83-5691893e2840-openshift-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:34:55.356302 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.356268    2562 generic.go:356] "Generic (PLEG): container finished" podID="9a1d1a7d-cf7c-4b58-9d83-5691893e2840" containerID="9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1" exitCode=0
Jul 21 15:34:55.356752 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.356316    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"
Jul 21 15:34:55.356752 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.356360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" event={"ID":"9a1d1a7d-cf7c-4b58-9d83-5691893e2840","Type":"ContainerDied","Data":"9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1"}
Jul 21 15:34:55.356752 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.356418    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb" event={"ID":"9a1d1a7d-cf7c-4b58-9d83-5691893e2840","Type":"ContainerDied","Data":"1fd185bbbd5e3ded7780b5b2bd169b9cfe1ea719d9468770692cab9c1f83c374"}
Jul 21 15:34:55.356752 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.356446    2562 scope.go:117] "RemoveContainer" containerID="9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1"
Jul 21 15:34:55.366295 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.366274    2562 scope.go:117] "RemoveContainer" containerID="9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1"
Jul 21 15:34:55.366556 ip-10-0-128-244 kubenswrapper[2562]: E0721 15:34:55.366533    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1\": container with ID starting with 9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1 not found: ID does not exist" containerID="9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1"
Jul 21 15:34:55.366602 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.366566    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1"} err="failed to get container status \"9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1\": rpc error: code = NotFound desc = could not find container \"9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1\": container with ID starting with 9f791b6e2e9da76a2ab751e914848086ad0be49bb2346febcc2dfbc3bfc07bd1 not found: ID does not exist"
Jul 21 15:34:55.381892 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.381864    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"]
Jul 21 15:34:55.390897 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:55.389878    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9365ce5e-58bdcfcb9d-s9kjb"]
Jul 21 15:34:56.043604 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:34:56.043570    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1d1a7d-cf7c-4b58-9d83-5691893e2840" path="/var/lib/kubelet/pods/9a1d1a7d-cf7c-4b58-9d83-5691893e2840/volumes"
Jul 21 15:35:05.301516 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:05.301470    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"]
Jul 21 15:35:05.302170 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:05.301716    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy" containerID="cri-o://a1dde8ef68903f673a975299c1d66abf4f152e4d3258194ec934397224fb604d" gracePeriod=30
Jul 21 15:35:10.437530 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.437495    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerID="a1dde8ef68903f673a975299c1d66abf4f152e4d3258194ec934397224fb604d" exitCode=0
Jul 21 15:35:10.438011 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.437564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" event={"ID":"fc69e52b-0566-4511-bea2-2dfffc5bc677","Type":"ContainerDied","Data":"a1dde8ef68903f673a975299c1d66abf4f152e4d3258194ec934397224fb604d"}
Jul 21 15:35:10.438011 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.437649    2562 scope.go:117] "RemoveContainer" containerID="c33d3d7fc6b475321f00fde4c877750c8e71fafd6cbcd56027ebaee54a27fb26"
Jul 21 15:35:10.574572 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.574509    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:35:10.667133 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667099    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-credential-socket\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667142    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-socket\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667179    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-data\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667212    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc69e52b-0566-4511-bea2-2dfffc5bc677-istiod-ca-cert\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-certs\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667272    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-envoy\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667312 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667306    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-podinfo\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz7gb\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-kube-api-access-qz7gb\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.667698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667406    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:35:10.667698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:35:10.667698 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667666    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:35:10.667898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667718    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc69e52b-0566-4511-bea2-2dfffc5bc677-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 15:35:10.667898 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.667815    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-token\") pod \"fc69e52b-0566-4511-bea2-2dfffc5bc677\" (UID: \"fc69e52b-0566-4511-bea2-2dfffc5bc677\") "
Jul 21 15:35:10.668341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.668224    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:35:10.668341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.668234    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-credential-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.668341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.668281    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-socket\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.668341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.668300    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc69e52b-0566-4511-bea2-2dfffc5bc677-istiod-ca-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.668341 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.668313    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-workload-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.669861 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.669837    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 15:35:10.670016 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.669969    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:35:10.670161 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.670139    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 15:35:10.670222 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.670176    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-kube-api-access-qz7gb" (OuterVolumeSpecName: "kube-api-access-qz7gb") pod "fc69e52b-0566-4511-bea2-2dfffc5bc677" (UID: "fc69e52b-0566-4511-bea2-2dfffc5bc677"). InnerVolumeSpecName "kube-api-access-qz7gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 15:35:10.769672 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.769603    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-podinfo\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.769672 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.769668    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz7gb\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-kube-api-access-qz7gb\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.769672 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.769681    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.769905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.769688    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-data\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:10.769905 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:10.769698    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc69e52b-0566-4511-bea2-2dfffc5bc677-istio-envoy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\""
Jul 21 15:35:11.444035 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:11.443998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq" event={"ID":"fc69e52b-0566-4511-bea2-2dfffc5bc677","Type":"ContainerDied","Data":"b6a5db2871c3e070cbb9bdba6e9a901974ad6a01f4c4db6bd8f3467ca6e532ba"}
Jul 21 15:35:11.444466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:11.444054    2562 scope.go:117] "RemoveContainer" containerID="a1dde8ef68903f673a975299c1d66abf4f152e4d3258194ec934397224fb604d"
Jul 21 15:35:11.444466 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:11.444016    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"
Jul 21 15:35:11.466785 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:11.466758    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"]
Jul 21 15:35:11.470912 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:11.470888    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9365ce5e-openshift-default-9d998c94c-q5mqq"]
Jul 21 15:35:12.043503 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:12.043469    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" path="/var/lib/kubelet/pods/fc69e52b-0566-4511-bea2-2dfffc5bc677/volumes"
Jul 21 15:35:24.537405 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:24.537377    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9f676b784-hb7bd_8b2e9e49-b052-4149-8ce7-5091a0621b0f/manager/0.log"
Jul 21 15:35:25.019915 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:25.019835    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-lqw6h_f395b2ee-4244-4914-87fe-14a4bc9843d2/copy-manifests/0.log"
Jul 21 15:35:25.037276 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:25.037250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-lqw6h_f395b2ee-4244-4914-87fe-14a4bc9843d2/manager/0.log"
Jul 21 15:35:25.506104 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:25.506074    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5958b6998f-4b9gg_c2bbb78d-7b5f-4d64-a43d-9d1d0447739e/maas-api/0.log"
Jul 21 15:35:25.636760 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:25.636732    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744115-9xfmx_f3f8fdd5-80d3-4ff6-8ca9-04891e29dcc8/cleanup/0.log"
Jul 21 15:35:27.271143 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:27.271106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m46lk_6ffa5cef-bb08-42b3-b8ee-ab91dc811960/manager/0.log"
Jul 21 15:35:27.383145 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:27.383116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-226bl_fbc8a438-dafc-4a67-98a8-a986ce131367/manager/0.log"
Jul 21 15:35:27.603497 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:27.603469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5ddhp_13470c67-c9be-4330-a1f4-e2517db4330c/registry-server/0.log"
Jul 21 15:35:27.724900 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:27.724876    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nkm7w_d198f97f-80ad-4158-a7c9-a4be6ba52df0/manager/0.log"
Jul 21 15:35:28.296270 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:28.296243    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785gccn_b7cb7dc6-dd3a-49ea-8ccb-f6504393085a/istio-proxy/0.log"
Jul 21 15:35:28.756227 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:28.756149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/1.log"
Jul 21 15:35:28.873419 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:28.873388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-2ccqb_cc5b4c0b-269e-47cc-81da-14d86ccc9e71/payload-pre-processing/0.log"
Jul 21 15:35:28.987733 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:28.987698    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-frh4h_0eeaa77e-6745-4e3c-a231-5d264c9a06e4/payload-processing/0.log"
Jul 21 15:35:29.097164 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:29.097138    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dcbc69fb-d69xs_8bb34876-74c1-4c41-9f40-a9f9e59478e5/router/0.log"
Jul 21 15:35:29.664437 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:29.664408    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rdvjz_c9b1e9fa-2544-47cc-8e95-e5ebc8e3a8fc/main/0.log"
Jul 21 15:35:30.004462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:30.004379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-sxrrz_57f07dab-095f-46be-b1f7-e1d20d936f0f/main/0.log"
Jul 21 15:35:36.139879 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:36.139847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:35:36.144539 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:36.144511    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:35:38.643337 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:38.643311    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2dggs_1b0c880c-0774-45a5-bc7c-9332c58c0600/global-pull-secret-syncer/0.log"
Jul 21 15:35:38.811878 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:38.811846    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pthnf_a735d0c1-4141-4836-b532-1589d973eee1/konnectivity-agent/0.log"
Jul 21 15:35:38.872865 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:38.872833    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-244.ec2.internal_2b3614c0559335b078ab25aae1c59cdc/haproxy/0.log"
Jul 21 15:35:44.255331 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:44.255301    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m46lk_6ffa5cef-bb08-42b3-b8ee-ab91dc811960/manager/0.log"
Jul 21 15:35:44.283985 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:44.283956    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-226bl_fbc8a438-dafc-4a67-98a8-a986ce131367/manager/0.log"
Jul 21 15:35:44.361334 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:44.361254    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5ddhp_13470c67-c9be-4330-a1f4-e2517db4330c/registry-server/0.log"
Jul 21 15:35:44.460022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:44.459975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-nkm7w_d198f97f-80ad-4158-a7c9-a4be6ba52df0/manager/0.log"
Jul 21 15:35:46.122152 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.122124    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/alertmanager/0.log"
Jul 21 15:35:46.146810 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.146785    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/config-reloader/0.log"
Jul 21 15:35:46.173723 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.173694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/kube-rbac-proxy-web/0.log"
Jul 21 15:35:46.198747 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.198721    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/kube-rbac-proxy/0.log"
Jul 21 15:35:46.222858 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.222829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/kube-rbac-proxy-metric/0.log"
Jul 21 15:35:46.245177 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.245155    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/prom-label-proxy/0.log"
Jul 21 15:35:46.270919 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.270893    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fe49db42-e118-408f-9210-0d8a242338db/init-config-reloader/0.log"
Jul 21 15:35:46.308972 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.308947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-htn7r_bae090d7-7387-4e79-bd16-b249c31fe457/cluster-monitoring-operator/0.log"
Jul 21 15:35:46.583162 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.583134    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gr69l_3299c14c-b3cc-4ca3-9ac0-79575ff44f9b/node-exporter/0.log"
Jul 21 15:35:46.608557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.608531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gr69l_3299c14c-b3cc-4ca3-9ac0-79575ff44f9b/kube-rbac-proxy/0.log"
Jul 21 15:35:46.632395 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.632371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gr69l_3299c14c-b3cc-4ca3-9ac0-79575ff44f9b/init-textfile/0.log"
Jul 21 15:35:46.831669 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.831645    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/prometheus/0.log"
Jul 21 15:35:46.858198 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.858168    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/config-reloader/0.log"
Jul 21 15:35:46.887083 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.887057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/thanos-sidecar/0.log"
Jul 21 15:35:46.909778 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.909754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/kube-rbac-proxy-web/0.log"
Jul 21 15:35:46.938227 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.938194    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/kube-rbac-proxy/0.log"
Jul 21 15:35:46.960827 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.960804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/kube-rbac-proxy-thanos/0.log"
Jul 21 15:35:46.987411 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:46.987385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_867bf4de-a066-4f28-adc9-d1b660d6b662/init-config-reloader/0.log"
Jul 21 15:35:48.766492 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.766450    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"]
Jul 21 15:35:48.766928 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.766916    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy"
Jul 21 15:35:48.766982 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.766929    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy"
Jul 21 15:35:48.766982 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.766949    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1d1a7d-cf7c-4b58-9d83-5691893e2840" containerName="maas-api"
Jul 21 15:35:48.766982 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.766956    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1d1a7d-cf7c-4b58-9d83-5691893e2840" containerName="maas-api"
Jul 21 15:35:48.767101 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.767060    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy"
Jul 21 15:35:48.767101 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.767070    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1d1a7d-cf7c-4b58-9d83-5691893e2840" containerName="maas-api"
Jul 21 15:35:48.767101 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.767076    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc69e52b-0566-4511-bea2-2dfffc5bc677" containerName="istio-proxy"
Jul 21 15:35:48.770208 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.770190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.772719 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.772703    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2v9j\"/\"kube-root-ca.crt\""
Jul 21 15:35:48.773462 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.773449    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w2v9j\"/\"default-dockercfg-sbt7v\""
Jul 21 15:35:48.773553 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.773486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2v9j\"/\"openshift-service-ca.crt\""
Jul 21 15:35:48.779350 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.779331    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"]
Jul 21 15:35:48.847597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.847557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-lib-modules\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.847597 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.847602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-podres\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.847859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.847657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccck6\" (UniqueName: \"kubernetes.io/projected/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-kube-api-access-ccck6\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.847859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.847708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-sys\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.847859 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.847752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-proc\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948724 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-sys\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-proc\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-lib-modules\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-sys\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-podres\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-proc\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccck6\" (UniqueName: \"kubernetes.io/projected/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-kube-api-access-ccck6\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-podres\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.948921 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.948917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-lib-modules\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:48.958234 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:48.958210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccck6\" (UniqueName: \"kubernetes.io/projected/81d300cf-18bd-4a20-9fbc-0c0d246dbb51-kube-api-access-ccck6\") pod \"perf-node-gather-daemonset-jl5xc\" (UID: \"81d300cf-18bd-4a20-9fbc-0c0d246dbb51\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:49.080357 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.080319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:49.178192 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.178155    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/2.log"
Jul 21 15:35:49.183008 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.182981    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-bzh44_40e1eb9b-84a5-44a4-be8d-3dc969a932ca/console-operator/3.log"
Jul 21 15:35:49.223091 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.223066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"]
Jul 21 15:35:49.225818 ip-10-0-128-244 kubenswrapper[2562]: W0721 15:35:49.225793    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81d300cf_18bd_4a20_9fbc_0c0d246dbb51.slice/crio-1746b91ef1bbf026823bf737fdf203e6f6cfbe19ef0a3933c3aab1db8a3205f6 WatchSource:0}: Error finding container 1746b91ef1bbf026823bf737fdf203e6f6cfbe19ef0a3933c3aab1db8a3205f6: Status 404 returned error can't find the container with id 1746b91ef1bbf026823bf737fdf203e6f6cfbe19ef0a3933c3aab1db8a3205f6
Jul 21 15:35:49.638122 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.638086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc" event={"ID":"81d300cf-18bd-4a20-9fbc-0c0d246dbb51","Type":"ContainerStarted","Data":"7325bb0fb613d29ceee689bcc8d3c1c6bacaee696933592193b920846c863e74"}
Jul 21 15:35:49.638336 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.638136    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc" event={"ID":"81d300cf-18bd-4a20-9fbc-0c0d246dbb51","Type":"ContainerStarted","Data":"1746b91ef1bbf026823bf737fdf203e6f6cfbe19ef0a3933c3aab1db8a3205f6"}
Jul 21 15:35:49.638336 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.638186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:49.659402 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:49.659345    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc" podStartSLOduration=1.659330077 podStartE2EDuration="1.659330077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:35:49.657639304 +0000 UTC m=+2114.092427095" watchObservedRunningTime="2026-07-21 15:35:49.659330077 +0000 UTC m=+2114.094117870"
Jul 21 15:35:50.413726 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:50.413694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-gmhdn_fae03664-2a07-46dc-a0e3-554a5908a8f3/volume-data-source-validator/0.log"
Jul 21 15:35:51.437734 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:51.437708    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-54czh_b6249d0f-e876-45b8-853e-fe28e39497df/dns/0.log"
Jul 21 15:35:51.461139 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:51.461106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-54czh_b6249d0f-e876-45b8-853e-fe28e39497df/kube-rbac-proxy/0.log"
Jul 21 15:35:51.610562 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:51.610535    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ktv79_3a04a2cf-0be8-43a0-86a5-8943d0d692c4/dns-node-resolver/0.log"
Jul 21 15:35:52.242519 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:52.242485    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z9d8d_e9923942-bfbc-4a3c-82b0-20d1513f4f93/node-ca/0.log"
Jul 21 15:35:53.206356 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:53.206324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785gccn_b7cb7dc6-dd3a-49ea-8ccb-f6504393085a/istio-proxy/0.log"
Jul 21 15:35:53.370469 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:53.370441    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/0.log"
Jul 21 15:35:53.393963 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:53.393935    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/1.log"
Jul 21 15:35:53.424050 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:53.424013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-2ccqb_cc5b4c0b-269e-47cc-81da-14d86ccc9e71/payload-pre-processing/0.log"
Jul 21 15:35:53.454388 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:53.454360    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-frh4h_0eeaa77e-6745-4e3c-a231-5d264c9a06e4/payload-processing/0.log"
Jul 21 15:35:53.476319 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:53.476247    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dcbc69fb-d69xs_8bb34876-74c1-4c41-9f40-a9f9e59478e5/router/0.log"
Jul 21 15:35:54.137645 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:54.137604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7qztt_c56438d3-aab0-41cd-8a78-38873380840a/serve-healthcheck-canary/0.log"
Jul 21 15:35:54.647920 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:54.647891    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-s4ttv_db25418d-f0c1-4b5c-a987-67df911d1e61/insights-operator/0.log"
Jul 21 15:35:54.648834 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:54.648816    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-s4ttv_db25418d-f0c1-4b5c-a987-67df911d1e61/insights-operator/1.log"
Jul 21 15:35:54.669899 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:54.669869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6f5f9_de11b194-8ec8-4716-b0d7-67082a42a751/kube-rbac-proxy/0.log"
Jul 21 15:35:54.694022 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:54.693997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6f5f9_de11b194-8ec8-4716-b0d7-67082a42a751/exporter/0.log"
Jul 21 15:35:54.717273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:54.717248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6f5f9_de11b194-8ec8-4716-b0d7-67082a42a751/extractor/0.log"
Jul 21 15:35:55.653627 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:55.653585    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-jl5xc"
Jul 21 15:35:57.187052 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:57.187018    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9f676b784-hb7bd_8b2e9e49-b052-4149-8ce7-5091a0621b0f/manager/0.log"
Jul 21 15:35:57.407061 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:57.407034    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-lqw6h_f395b2ee-4244-4914-87fe-14a4bc9843d2/manager/0.log"
Jul 21 15:35:57.424952 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:57.424930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-lqw6h_f395b2ee-4244-4914-87fe-14a4bc9843d2/copy-manifests/0.log"
Jul 21 15:35:58.908439 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:58.908363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-795f7754-s5vk7_0219235e-5f01-4949-b1ee-7aa5d8fd54a8/manager/0.log"
Jul 21 15:35:59.329555 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:59.329517    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785gccn_b7cb7dc6-dd3a-49ea-8ccb-f6504393085a/istio-proxy/0.log"
Jul 21 15:35:59.437152 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:59.437117    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/0.log"
Jul 21 15:35:59.460869 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:59.460844    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/1.log"
Jul 21 15:35:59.479557 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:59.479533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-2ccqb_cc5b4c0b-269e-47cc-81da-14d86ccc9e71/payload-pre-processing/0.log"
Jul 21 15:35:59.500721 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:59.500693    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-frh4h_0eeaa77e-6745-4e3c-a231-5d264c9a06e4/payload-processing/0.log"
Jul 21 15:35:59.512398 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:35:59.512379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dcbc69fb-d69xs_8bb34876-74c1-4c41-9f40-a9f9e59478e5/router/0.log"
Jul 21 15:36:00.680550 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:00.680471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6785gccn_b7cb7dc6-dd3a-49ea-8ccb-f6504393085a/istio-proxy/0.log"
Jul 21 15:36:00.811026 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:00.810998    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/0.log"
Jul 21 15:36:00.835825 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:00.835796    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-llw7b_19e02434-3d35-4705-82df-6cbfbb463fb7/istio-proxy/1.log"
Jul 21 15:36:00.857094 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:00.857067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-2ccqb_cc5b4c0b-269e-47cc-81da-14d86ccc9e71/payload-pre-processing/0.log"
Jul 21 15:36:00.880953 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:00.880929    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-frh4h_0eeaa77e-6745-4e3c-a231-5d264c9a06e4/payload-processing/0.log"
Jul 21 15:36:00.899693 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:00.899670    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dcbc69fb-d69xs_8bb34876-74c1-4c41-9f40-a9f9e59478e5/router/0.log"
Jul 21 15:36:04.274801 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:04.274771    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gxzdv_f6c14c70-ca1d-45e2-9c77-80dd0d95ee49/kube-storage-version-migrator-operator/1.log"
Jul 21 15:36:04.275572 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:04.275551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-gxzdv_f6c14c70-ca1d-45e2-9c77-80dd0d95ee49/kube-storage-version-migrator-operator/0.log"
Jul 21 15:36:05.276054 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.276028    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/kube-multus-additional-cni-plugins/0.log"
Jul 21 15:36:05.298532 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.298503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/egress-router-binary-copy/0.log"
Jul 21 15:36:05.325262 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.325235    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/cni-plugins/0.log"
Jul 21 15:36:05.350273 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.350249    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/bond-cni-plugin/0.log"
Jul 21 15:36:05.374415 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.374390    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/routeoverride-cni/0.log"
Jul 21 15:36:05.397644 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.397592    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/whereabouts-cni-bincopy/0.log"
Jul 21 15:36:05.422156 ip-10-0-128-244 kubenswrapper[2562]: I0721 15:36:05.422124    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jq75n_fc346e1d-61bf-4f69-bfbc-cdec43de8993/whereabouts-cni/0.log"