Jul 12 08:06:43.089566 ip-10-0-128-71 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 08:06:43.533434 ip-10-0-128-71 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 08:06:43.533434 ip-10-0-128-71 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 08:06:43.533434 ip-10-0-128-71 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 08:06:43.533434 ip-10-0-128-71 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 08:06:43.533434 ip-10-0-128-71 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 08:06:43.535560 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.535466    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 08:06:43.542354 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542331    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:06:43.542354 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542349    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:06:43.542354 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542353    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:06:43.542354 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542358    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:06:43.542354 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542362    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542365    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542369    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542372    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542375    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542382    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542385    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542388    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542391    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542394    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542397    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542399    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542402    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542405    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542408    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542410    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542413    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542419    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542422    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542425    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:06:43.542546 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542428    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542431    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542435    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542440    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542443    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542446    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542449    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542452    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542454    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542459    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542462    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542465    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542468    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542470    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542474    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542477    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542480    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542482    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542486    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542488    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:06:43.543010 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542491    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542496    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542501    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542504    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542506    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542509    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542512    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542514    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542517    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542519    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542522    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542525    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542528    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542530    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542535    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542537    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542542    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542546    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542549    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:06:43.543521 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542554    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542557    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542560    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542564    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542566    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542569    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542574    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542578    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542581    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542584    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542587    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542589    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542593    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542595    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542598    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542601    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542604    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542606    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542609    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:06:43.543976 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542614    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542617    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542619    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542622    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542624    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542627    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542631    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542634    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542637    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542640    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542643    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542646    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542648    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542654    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542657    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542660    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.542663    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543802    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543809    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:06:43.544455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543812    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543816    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543819    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543822    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543825    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543828    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543831    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543834    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543840    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543842    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543845    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543847    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543850    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543852    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543855    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543858    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543861    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543863    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543866    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543869    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:06:43.544911 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543871    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543876    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543879    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543882    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543884    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543887    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543889    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543892    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543894    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543897    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543900    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543902    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543905    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543908    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543913    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543916    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543919    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543921    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543924    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543926    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:06:43.545567 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543929    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543932    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543934    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543937    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543939    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543942    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543947    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543949    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543952    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543954    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543957    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543960    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543963    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543966    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543968    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543971    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543973    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543976    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543983    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:06:43.546075 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543986    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543992    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.543996    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544000    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544003    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544006    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544009    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544012    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544015    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544018    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544021    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544026    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544030    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544032    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544036    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544040    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544042    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544045    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544048    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544051    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:06:43.546571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544053    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544056    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544059    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544064    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544066    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544069    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544071    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544073    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544076    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544079    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544081    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544084    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544086    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544091    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544093    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544098    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544101    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544105    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544717    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544722    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:06:43.547057 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544726    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544729    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544732    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544735    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544738    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544741    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544744    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544747    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544752    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544755    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544757    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544760    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544764    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544767    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544771    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544774    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544777    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544779    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544782    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:06:43.547592 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544785    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544790    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544793    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544796    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544799    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544803    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544806    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544809    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544811    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544814    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544816    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544819    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544822    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544827    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544830    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544832    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544835    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544838    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544840    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544843    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:06:43.548054 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544845    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544848    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544851    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544853    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544857    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544863    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544866    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544869    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544871    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544874    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544876    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544879    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544883    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544885    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544889    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544892    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544897    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544900    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544903    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:06:43.548568 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544905    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544908    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544911    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544914    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544917    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544919    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544922    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544925    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544928    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544930    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544935    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544938    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544940    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544943    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544946    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544948    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544951    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544953    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544956    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544958    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:06:43.549071 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544961    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544964    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544966    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544971    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544974    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544976    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544979    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544982    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544984    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544987    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544989    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544992    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544994    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.544997    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545002    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545004    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545009    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545011    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545014    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545290    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545311    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 08:06:43.549571 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545318    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545322    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545326    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545329    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545334    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545338    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545341    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545343    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545347    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545350    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545353    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545356    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545359    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545362    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545365    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545367    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545372    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545375    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545378    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545381    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545384    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545388    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545391    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 08:06:43.550114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545393    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545397    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545401    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545404    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545407    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545410    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545413    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545417    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545420    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545423    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545425    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545429    2558 flags.go:64] FLAG: --enable-server="true"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545431    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545438    2558 flags.go:64] FLAG: --event-burst="100"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545443    2558 flags.go:64] FLAG: --event-qps="50"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545445    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545449    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545452    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545458    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545462    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545465    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545467    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545470    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545472    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545475    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 08:06:43.550679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545478    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545480    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545483    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545486    2558 flags.go:64] FLAG: --feature-gates=""
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545490    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545492    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545496    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545499    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545503    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545507    2558 flags.go:64] FLAG: --help="false"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545510    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545513    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545516    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545519    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545522    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545526    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545529    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545532    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545535    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545538    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545541    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545543    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545546    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545549    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 08:06:43.551313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545551    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545554    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545557    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545560    2558 flags.go:64] FLAG: --lock-file=""
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545563    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545565    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545568    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545574    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545577    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545581    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545584    2558 flags.go:64] FLAG: --logging-format="text"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545587    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545590    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545593    2558 flags.go:64] FLAG: --manifest-url=""
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545597    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545613    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545616    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545621    2558 flags.go:64] FLAG: --max-pods="110"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545624    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545627    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545630    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545633    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545636    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545639    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545642    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 08:06:43.551899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545650    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545653    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545656    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545659    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545661    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545666    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545669    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545672    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545675    2558 flags.go:64] FLAG: --port="10250"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545678    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545680    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c19fc319f2ea7f47"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545683    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545686    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545689    2558 flags.go:64] FLAG: --register-node="true"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545692    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545695    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545699    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545702    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545705    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545708    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545711    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545714    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545719    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545721    2558 flags.go:64] FLAG: --runonce="false"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545725    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 08:06:43.552535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545728    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545731    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545733    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545736    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545739    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545742    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545744    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545747    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545750    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545753    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545755    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545758    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545761    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545764    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545770    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545772    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545775    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545779    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545781    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545784    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545787    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545790    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545792    2558 flags.go:64] FLAG: --v="2"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545796    2558 flags.go:64] FLAG: --version="false"
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545801    2558 flags.go:64] FLAG: --vmodule=""
Jul 12 08:06:43.553150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545804    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.545807    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545929    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545933    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545937    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545940    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545943    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545946    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545948    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545951    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545953    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545956    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545958    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545961    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545963    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545966    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545968    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545971    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545973    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545976    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:06:43.553828 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545978    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545981    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545984    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545986    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545989    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545991    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545994    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545996    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.545998    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546001    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546003    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546005    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546008    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546011    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546013    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546016    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546020    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546023    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546026    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546029    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:06:43.554346 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546031    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546034    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546036    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546039    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546041    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546044    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546046    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546048    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546051    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546053    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546055    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546058    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546062    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546065    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546068    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546071    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546075    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546079    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546082    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:06:43.554841 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546085    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546087    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546090    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546092    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546095    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546097    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546100    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546102    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546105    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546108    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546110    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546114    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546117    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546119    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546122    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546124    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546126    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546129    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546131    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546134    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:06:43.555319 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546136    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546138    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546141    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546143    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546146    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546148    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546150    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546153    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546156    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546158    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546160    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546163    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546165    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546167    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546170    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546174    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546177    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546180    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546182    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546186    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:06:43.555810 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546188    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.546192    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.546933    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.554210    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.554227    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.555188    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.555196    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555253    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555258    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555261    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555264    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555267    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555269    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555289    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555294    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:06:43.556311 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555298    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555302    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555306    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555310    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555313    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555315    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555318    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555321    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555324    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555326    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555329    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555332    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555334    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555337    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555340    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555343    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555345    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555348    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555351    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555353    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:06:43.556695 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555356    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555359    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555362    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555365    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555368    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555371    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555373    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555375    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555378    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555380    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555383    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555385    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555388    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555390    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555392    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555395    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555398    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555401    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555403    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:06:43.557174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555406    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555410    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555414    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555417    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555420    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555423    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555426    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555429    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555431    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555434    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555436    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555439    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555441    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555444    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555446    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555451    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555455    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555457    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555460    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:06:43.557665 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555463    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555465    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555468    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555470    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555474    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555477    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555479    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555482    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555484    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555486    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555489    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555491    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555494    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555496    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555499    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555501    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555504    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555506    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555509    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:06:43.558122 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555512    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555515    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555517    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555520    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555522    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555525    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555528    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555530    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555534    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555537    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555543    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555546    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555549    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555551    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.555556    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 08:06:43.558606 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555673    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555677    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555680    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555684    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555687    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555690    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555692    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555695    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555697    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555700    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555703    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555705    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555708    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555710    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555713    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555715    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555718    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555721    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555723    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555726    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 08:06:43.558975 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555728    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555731    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555733    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555735    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555738    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555742    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555746    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555749    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555752    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555755    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555758    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555762    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555764    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555766    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555769    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555771    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555774    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555776    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555779    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 08:06:43.559472 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555781    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555784    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555786    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555789    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555791    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555794    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555796    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555798    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555801    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555803    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555805    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555808    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555810    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555813    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555816    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555819    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555822    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555824    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555827    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 08:06:43.559921 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555830    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555832    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555835    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555837    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555840    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555843    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555845    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555848    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555851    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555853    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555856    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555858    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555860    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555863    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555865    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555868    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555870    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555872    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555874    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555877    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 08:06:43.560460 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555879    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555882    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555886    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555889    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555892    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555895    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555898    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555900    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555903    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555905    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555908    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555911    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555913    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555915    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555918    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555920    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555923    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555925    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555928    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 08:06:43.560927 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555931    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:43.555933    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.555938    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.556052    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.558581    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.560348    2558 server.go:1019] "Starting client certificate rotation"
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.560447    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 08:06:43.561383 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.560499    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 08:06:43.563082 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.563069    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 08:06:43.568165 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.568147    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 08:06:43.580496 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.580477    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 12 08:06:43.584456 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.584437    2558 log.go:25] "Validated CRI v1 image API"
Jul 12 08:06:43.588084 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.588062    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 08:06:43.588585 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.588570    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 08:06:43.591209 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.591181    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ab61a773-6719-40aa-b84e-8f8044e76692:/dev/nvme0n1p3 e8391d18-1b53-4741-85c6-67d5674075fc:/dev/nvme0n1p4]
Jul 12 08:06:43.591294 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.591206    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 08:06:43.596788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.596686    2558 manager.go:216] Machine: {Timestamp:2026-07-12 08:06:43.596175319 +0000 UTC m=+0.379175654 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100317 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2115b65f2d940854c22fb7edbcbe91 SystemUUID:ec2115b6-5f2d-9408-54c2-2fb7edbcbe91 BootID:7b2db1b7-0863-48a7-8609-6414409b6e2a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:d9:2c:d9:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:d9:2c:d9:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:ff:ee:1c:97:65 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 08:06:43.596788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.596783    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 08:06:43.596908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.596868    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 08:06:43.600472 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.600448    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 08:06:43.600611 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.600475    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 08:06:43.601306 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.601296    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 08:06:43.601345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.601309    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 08:06:43.601345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.601317    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 08:06:43.601345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.601332    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 08:06:43.603322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.603311    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 08:06:43.608009 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.607996    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 08:06:43.608135 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608126    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 08:06:43.608168 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608160    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 08:06:43.608198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608178    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 08:06:43.608198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608190    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 08:06:43.608247 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608200    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 12 08:06:43.608247 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608210    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 08:06:43.608623 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608609    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 08:06:43.608693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.608630    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 08:06:43.611142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.611122    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 08:06:43.613409 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613394    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 08:06:43.613480 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613425    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 08:06:43.613633 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613622    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 08:06:43.613672 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613638    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 08:06:43.613672 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613646    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 08:06:43.613672 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613655    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 08:06:43.613672 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613667    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 08:06:43.613672 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.613673    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 08:06:43.614257 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614246    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 08:06:43.614311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614259    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 08:06:43.614311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614267    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 08:06:43.614311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614290    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 08:06:43.614311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614301    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 08:06:43.614311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614309    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 08:06:43.614439 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614334    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 08:06:43.614439 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.614344    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 08:06:43.617847 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.617832    2558 server.go:1268] "Started kubelet"
Jul 12 08:06:43.617943 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.617917    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 08:06:43.618008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.617969    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 08:06:43.618225 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.618162    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 08:06:43.618791 ip-10-0-128-71 systemd[1]: Started Kubernetes Kubelet.
Jul 12 08:06:43.619147 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.619056    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 08:06:43.619147 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.619100    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 08:06:43.619295 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.619181    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 08:06:43.619537 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.619508    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 08:06:43.625002 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.624980    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 08:06:43.625487 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.625447    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 08:06:43.627874 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.626728    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-71.ec2.internal.18c17c4e687ddfea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-71.ec2.internal,UID:ip-10-0-128-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-71.ec2.internal,},FirstTimestamp:2026-07-12 08:06:43.61780017 +0000 UTC m=+0.400800505,LastTimestamp:2026-07-12 08:06:43.61780017 +0000 UTC m=+0.400800505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-71.ec2.internal,}"
Jul 12 08:06:43.629797 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.629780    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 08:06:43.629895 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.629797    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 08:06:43.629895 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.629858    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:43.630616 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.630599    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 08:06:43.630912 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.630895    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 08:06:43.631036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.630598    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 08:06:43.631036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.630613    2558 factory.go:55] Registering systemd factory
Jul 12 08:06:43.631036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631005    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 12 08:06:43.631036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631035    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 08:06:43.631193 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631043    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 08:06:43.631240 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631227    2558 factory.go:153] Registering CRI-O factory
Jul 12 08:06:43.631291 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631246    2558 factory.go:223] Registration of the crio container factory successfully
Jul 12 08:06:43.631332 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631319    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 08:06:43.631381 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631345    2558 factory.go:103] Registering Raw factory
Jul 12 08:06:43.631381 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631361    2558 manager.go:1196] Started watching for new ooms in manager
Jul 12 08:06:43.631991 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.631972    2558 manager.go:349] Starting recovery of all containers
Jul 12 08:06:43.633808 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.633785    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lgbvr"
Jul 12 08:06:43.634902 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.634878    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 08:06:43.634992 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.634970    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 08:06:43.641733 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.641236    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lgbvr"
Jul 12 08:06:43.643918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.643904    2558 manager.go:354] Recovery completed
Jul 12 08:06:43.647988 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.647975    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.650294 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.650258    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.650460 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.650445    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.650524 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.650468    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.651005 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.650990    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 08:06:43.651005 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.651002    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.651101 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.651004    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 08:06:43.651101 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.651069    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 08:06:43.651752 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.651733    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.651822 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.651761    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.651822 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.651775    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.651965 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.651891    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-71.ec2.internal.18c17c4e6a6f9355  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-71.ec2.internal,UID:ip-10-0-128-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-71.ec2.internal,},FirstTimestamp:2026-07-12 08:06:43.650417493 +0000 UTC m=+0.433417830,LastTimestamp:2026-07-12 08:06:43.650417493 +0000 UTC m=+0.433417830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-71.ec2.internal,}"
Jul 12 08:06:43.653188 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.653175    2558 policy_none.go:49] "None policy: Start"
Jul 12 08:06:43.653188 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.653191    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 08:06:43.653284 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.653201    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 08:06:43.655203 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.655193    2558 policy_none.go:47] "Start"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.701832    2558 manager.go:337] "Starting Device Plugin manager"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.701862    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.701872    2558 server.go:87] "Starting device plugin registration server"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.702118    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.702132    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.702244    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.702363    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.702373    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.702853    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 08:06:43.715795 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.702893    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:43.747787 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.747754    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 08:06:43.749020 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.749001    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 08:06:43.749134 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.749048    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 08:06:43.749134 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.749070    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 08:06:43.749134 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.749107    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 08:06:43.751380 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.751363    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:06:43.803212 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.803124    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.804298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.804261    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.804407 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.804306    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.804407 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.804318    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.804407 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.804342    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.812752 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.812730    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.812752 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.812754    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-71.ec2.internal\": node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:43.834496 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.834467    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:43.849803 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.849776    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"]
Jul 12 08:06:43.849878 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.849842    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.851390 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.851374    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.851465 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.851402    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.851465 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.851413    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.853860 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.853843    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.853969 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.853941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.854075 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.853983    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.854684 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.854668    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.854766 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.854697    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.854766 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.854709    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.854766 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.854760    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.854874 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.854779    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.854874 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.854788    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.857092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.857076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.857158 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.857110    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 08:06:43.857939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.857923    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 08:06:43.858008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.857965    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 08:06:43.858008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.857981    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeHasSufficientPID"
Jul 12 08:06:43.883233 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.883206    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-71.ec2.internal\" not found" node="ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.886608 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.886589    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-71.ec2.internal\" not found" node="ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.933542 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.933508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f62b47d48c505e45174394dfbbead6a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-71.ec2.internal\" (UID: \"2f62b47d48c505e45174394dfbbead6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.933542 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.933540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d7df46f4f885787e24f950064b8eefd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal\" (UID: \"8d7df46f4f885787e24f950064b8eefd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.933783 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:43.933559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d7df46f4f885787e24f950064b8eefd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal\" (UID: \"8d7df46f4f885787e24f950064b8eefd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:43.934552 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:43.934538    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.034102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.034071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f62b47d48c505e45174394dfbbead6a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-71.ec2.internal\" (UID: \"2f62b47d48c505e45174394dfbbead6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.034102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.034092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f62b47d48c505e45174394dfbbead6a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-71.ec2.internal\" (UID: \"2f62b47d48c505e45174394dfbbead6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.034224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.034129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d7df46f4f885787e24f950064b8eefd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal\" (UID: \"8d7df46f4f885787e24f950064b8eefd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.034224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.034146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d7df46f4f885787e24f950064b8eefd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal\" (UID: \"8d7df46f4f885787e24f950064b8eefd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.034224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.034174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d7df46f4f885787e24f950064b8eefd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal\" (UID: \"8d7df46f4f885787e24f950064b8eefd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.034224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.034216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d7df46f4f885787e24f950064b8eefd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal\" (UID: \"8d7df46f4f885787e24f950064b8eefd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.035083 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.035063    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.135948 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.135875    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.185093 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.185062    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.190319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.189930    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:44.236911 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.236877    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.337422 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.337395    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.437955 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.437884    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.538421 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.538391    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.559585 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.559557    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 08:06:44.559741 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.559723    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 08:06:44.638655 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.638622    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.646050 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.646018    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 08:01:44 +0000 UTC" deadline="2028-04-11 04:44:37.969162462 +0000 UTC"
Jul 12 08:06:44.646050 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.646051    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15332h37m53.323115718s"
Jul 12 08:06:44.652515 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.652485    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:06:44.738962 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.738890    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.754916 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:44.754874    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f62b47d48c505e45174394dfbbead6a.slice/crio-277966d78b8cc1d8752f6fa11caab4bb3534386aa4ba46ae6162ae635853dc0b WatchSource:0}: Error finding container 277966d78b8cc1d8752f6fa11caab4bb3534386aa4ba46ae6162ae635853dc0b: Status 404 returned error can't find the container with id 277966d78b8cc1d8752f6fa11caab4bb3534386aa4ba46ae6162ae635853dc0b
Jul 12 08:06:44.755145 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:44.755129    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7df46f4f885787e24f950064b8eefd.slice/crio-f001510b0ef8407f8d432b5095209fcc9cca3160ba3b79dbd6d96f0e97803b14 WatchSource:0}: Error finding container f001510b0ef8407f8d432b5095209fcc9cca3160ba3b79dbd6d96f0e97803b14: Status 404 returned error can't find the container with id f001510b0ef8407f8d432b5095209fcc9cca3160ba3b79dbd6d96f0e97803b14
Jul 12 08:06:44.759466 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:44.759451    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:06:44.839073 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.839039    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:44.939614 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:44.939578    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-71.ec2.internal\" not found"
Jul 12 08:06:45.032114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.032090    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:06:45.130695 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.130656    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:45.136381 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.136354    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:06:45.141253 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.141235    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 08:06:45.142178 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.142162    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"
Jul 12 08:06:45.156964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.156941    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 08:06:45.609445 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.609140    2558 apiserver.go:52] "Watching apiserver"
Jul 12 08:06:45.617449 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.617418    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 08:06:45.618445 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.618419    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 08:06:45.620859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.620823    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-x5xrc","openshift-network-operator/iptables-alerter-j2r28","openshift-ovn-kubernetes/ovnkube-node-fdd7m","kube-system/konnectivity-agent-ztwc8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b","openshift-cluster-node-tuning-operator/tuned-lm84t","openshift-image-registry/node-ca-9mggq","openshift-multus/multus-additional-cni-plugins-zxhsp","openshift-multus/network-metrics-daemon-bvx29","openshift-network-diagnostics/network-check-target-wrdms","kube-system/global-pull-secret-syncer-r6jrm","kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal","openshift-dns/node-resolver-jqm8v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal"]
Jul 12 08:06:45.623724 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.623703    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.626502 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.626469    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.627231 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.627192    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvfz4\""
Jul 12 08:06:45.627231 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.627204    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 08:06:45.627231 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.627226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 08:06:45.628908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.628416    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.628908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.628748    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q5qlv\""
Jul 12 08:06:45.629055 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.629039    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.629055 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.629047    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.630942 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.630920    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 08:06:45.631251 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.631228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.631797 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.631772    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.631901 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.631883    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 08:06:45.631968 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.631922    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 08:06:45.632028 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.631974    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 08:06:45.632508 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.632489    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.632876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.632855    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 08:06:45.633048 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.633033    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ngfpj\""
Jul 12 08:06:45.634155 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.634135    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.634537 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.634521    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 08:06:45.634628 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.634553    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6h94b\""
Jul 12 08:06:45.634755 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.634740    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.635069 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.635052    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.636378 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.636337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.636851 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.636831    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 08:06:45.637041 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.637023    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.637131 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.637078    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9lbgh\""
Jul 12 08:06:45.637535 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.637518    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.639862 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.639842    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2w5d\""
Jul 12 08:06:45.640018 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.639861    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.640018 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.640014    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.640155 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.639918    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.641868 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.641834    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 08:06:45.642154 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rnq6p\""
Jul 12 08:06:45.642262 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c40c28da-2de4-4ec8-b784-9c677149aa67-ovn-node-metrics-cert\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642377 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-device-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.642377 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-systemd-units\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642377 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-systemd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642552 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-etc-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642552 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642552 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-cni-bin\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642552 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642474    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.642781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642622    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 08:06:45.642781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642691    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 08:06:45.642781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-env-overrides\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85e5d712-8a13-4116-b27f-90ee36e4bcc3-serviceca\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-socket-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd4996a8-c882-42b8-a249-66d69834c4d5-agent-certs\") pod \"konnectivity-agent-ztwc8\" (UID: \"bd4996a8-c882-42b8-a249-66d69834c4d5\") " pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-cni-netd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-ovnkube-script-lib\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642905    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-node-log\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.642983 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85e5d712-8a13-4116-b27f-90ee36e4bcc3-host\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.642992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7lzd\" (UniqueName: \"kubernetes.io/projected/c40c28da-2de4-4ec8-b784-9c677149aa67-kube-api-access-m7lzd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3188ee17-e04d-4f46-be29-8cefefe19602-hosts-file\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhfh5\" (UniqueName: \"kubernetes.io/projected/3188ee17-e04d-4f46-be29-8cefefe19602-kube-api-access-jhfh5\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643089    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-kubelet\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-registration-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-ovnkube-config\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jldtw\" (UniqueName: \"kubernetes.io/projected/85e5d712-8a13-4116-b27f-90ee36e4bcc3-kube-api-access-jldtw\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6lwh\" (UniqueName: \"kubernetes.io/projected/a18243b1-9e15-4904-b64b-41ea35b8d2fa-kube-api-access-f6lwh\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd4996a8-c882-42b8-a249-66d69834c4d5-konnectivity-ca\") pod \"konnectivity-agent-ztwc8\" (UID: \"bd4996a8-c882-42b8-a249-66d69834c4d5\") " pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-run-netns\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-var-lib-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.643425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.643332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-slash\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.644228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.644228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-sys-fs\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.644228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3188ee17-e04d-4f46-be29-8cefefe19602-tmp-dir\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.644432 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-ovn\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.644432 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-log-socket\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.644432 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.645024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.644979    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.646471 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.646448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:45.646570 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.646535    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:45.647622 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.647601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 08:06:45.648463 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.648443    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgbsg\""
Jul 12 08:06:45.648649 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.647604    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 08:06:45.649516 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.649496    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:45.649685 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.649664    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:45.652197 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.652163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.652303 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.652249    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:45.655134 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.655114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.657540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.657515    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 08:06:45.657626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.657542    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xx94t\""
Jul 12 08:06:45.657746 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.657719    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 08:06:45.658034 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.658015    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:06:45.670616 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.668506    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmr5w"
Jul 12 08:06:45.676513 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.676490    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmr5w"
Jul 12 08:06:45.732103 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.732065    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 08:06:45.744792 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.744757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-run\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.744966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.744808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-k8s-cni-cncf-io\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.744966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.744839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cnibin\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.744966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.744867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.744966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.744916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.745142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.744984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-registration-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.745142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-systemd\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.745142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-host\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.745142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745083    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-registration-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.745142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecc40062-3d0b-4275-94d6-0c82a61be41c-tmp\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.745142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-cni-multus\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43681a57-c89a-4a78-be3e-d4193f14f14a-kubelet-config\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-var-lib-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-var-lib-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-slash\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745342    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-slash\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-sys-fs\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-lib-modules\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-multus-certs\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-sys-fs\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43681a57-c89a-4a78-be3e-d4193f14f14a-dbus\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.745520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdh4s\" (UniqueName: \"kubernetes.io/projected/ecc40062-3d0b-4275-94d6-0c82a61be41c-kube-api-access-rdh4s\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-system-cni-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-device-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-tuned\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-conf-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-device-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-modprobe-d\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745772    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysctl-d\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-etc-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-etc-kubernetes\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd4996a8-c882-42b8-a249-66d69834c4d5-agent-certs\") pod \"konnectivity-agent-ztwc8\" (UID: \"bd4996a8-c882-42b8-a249-66d69834c4d5\") " pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-etc-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-ovnkube-script-lib\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745927    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spgvr\" (UniqueName: \"kubernetes.io/projected/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-kube-api-access-spgvr\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-node-log\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.745988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysconfig\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-sys\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-cni-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746147    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-node-log\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-etc-selinux\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746197    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvbp\" (UniqueName: \"kubernetes.io/projected/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-kube-api-access-bxvbp\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746217    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-iptables-alerter-script\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7lzd\" (UniqueName: \"kubernetes.io/projected/c40c28da-2de4-4ec8-b784-9c677149aa67-kube-api-access-m7lzd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3188ee17-e04d-4f46-be29-8cefefe19602-hosts-file\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhfh5\" (UniqueName: \"kubernetes.io/projected/3188ee17-e04d-4f46-be29-8cefefe19602-kube-api-access-jhfh5\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-kubelet\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-var-lib-kubelet\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-cni-binary-copy\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-socket-dir-parent\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.746981 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746469    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3188ee17-e04d-4f46-be29-8cefefe19602-hosts-file\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-ovnkube-config\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-ovnkube-script-lib\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jldtw\" (UniqueName: \"kubernetes.io/projected/85e5d712-8a13-4116-b27f-90ee36e4bcc3-kube-api-access-jldtw\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6lwh\" (UniqueName: \"kubernetes.io/projected/a18243b1-9e15-4904-b64b-41ea35b8d2fa-kube-api-access-f6lwh\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746560    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-kubelet\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-cnibin\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-netns\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-cni-bin\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746764    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd4996a8-c882-42b8-a249-66d69834c4d5-konnectivity-ca\") pod \"konnectivity-agent-ztwc8\" (UID: \"bd4996a8-c882-42b8-a249-66d69834c4d5\") " pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-run-netns\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-run-netns\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlff6\" (UniqueName: \"kubernetes.io/projected/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-kube-api-access-vlff6\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.746975    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3188ee17-e04d-4f46-be29-8cefefe19602-tmp-dir\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.748008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-ovn\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-log-socket\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-ovn\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-ovnkube-config\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-log-socket\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c40c28da-2de4-4ec8-b784-9c677149aa67-ovn-node-metrics-cert\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3188ee17-e04d-4f46-be29-8cefefe19602-tmp-dir\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747393    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd4996a8-c882-42b8-a249-66d69834c4d5-konnectivity-ca\") pod \"konnectivity-agent-ztwc8\" (UID: \"bd4996a8-c882-42b8-a249-66d69834c4d5\") " pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysctl-conf\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-os-release\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-os-release\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747502    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-systemd-units\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-systemd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-systemd-units\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.748879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747631    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-cni-bin\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-openvswitch\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-cni-bin\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-run-systemd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-env-overrides\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85e5d712-8a13-4116-b27f-90ee36e4bcc3-serviceca\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-socket-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-cni-netd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-kubelet\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-hostroot\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.747984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-daemon-config\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c40c28da-2de4-4ec8-b784-9c677149aa67-host-cni-netd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748009    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-system-cni-dir\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-host-slash\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8krp\" (UniqueName: \"kubernetes.io/projected/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-kube-api-access-r8krp\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85e5d712-8a13-4116-b27f-90ee36e4bcc3-host\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.749757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a18243b1-9e15-4904-b64b-41ea35b8d2fa-socket-dir\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.750697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-kubernetes\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.750697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85e5d712-8a13-4116-b27f-90ee36e4bcc3-host\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.750697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c40c28da-2de4-4ec8-b784-9c677149aa67-env-overrides\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.750697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.748286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85e5d712-8a13-4116-b27f-90ee36e4bcc3-serviceca\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.750697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.750028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd4996a8-c882-42b8-a249-66d69834c4d5-agent-certs\") pod \"konnectivity-agent-ztwc8\" (UID: \"bd4996a8-c882-42b8-a249-66d69834c4d5\") " pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.752370 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.752293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c40c28da-2de4-4ec8-b784-9c677149aa67-ovn-node-metrics-cert\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.756133 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.756065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhfh5\" (UniqueName: \"kubernetes.io/projected/3188ee17-e04d-4f46-be29-8cefefe19602-kube-api-access-jhfh5\") pod \"node-resolver-jqm8v\" (UID: \"3188ee17-e04d-4f46-be29-8cefefe19602\") " pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.756133 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.756069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal" event={"ID":"8d7df46f4f885787e24f950064b8eefd","Type":"ContainerStarted","Data":"f001510b0ef8407f8d432b5095209fcc9cca3160ba3b79dbd6d96f0e97803b14"}
Jul 12 08:06:45.757026 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.757004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7lzd\" (UniqueName: \"kubernetes.io/projected/c40c28da-2de4-4ec8-b784-9c677149aa67-kube-api-access-m7lzd\") pod \"ovnkube-node-fdd7m\" (UID: \"c40c28da-2de4-4ec8-b784-9c677149aa67\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.757902 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.757749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal" event={"ID":"2f62b47d48c505e45174394dfbbead6a","Type":"ContainerStarted","Data":"277966d78b8cc1d8752f6fa11caab4bb3534386aa4ba46ae6162ae635853dc0b"}
Jul 12 08:06:45.759280 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.759240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jldtw\" (UniqueName: \"kubernetes.io/projected/85e5d712-8a13-4116-b27f-90ee36e4bcc3-kube-api-access-jldtw\") pod \"node-ca-9mggq\" (UID: \"85e5d712-8a13-4116-b27f-90ee36e4bcc3\") " pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.760933 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.760906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6lwh\" (UniqueName: \"kubernetes.io/projected/a18243b1-9e15-4904-b64b-41ea35b8d2fa-kube-api-access-f6lwh\") pod \"aws-ebs-csi-driver-node-c6r5b\" (UID: \"a18243b1-9e15-4904-b64b-41ea35b8d2fa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.848543 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.848543 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlff6\" (UniqueName: \"kubernetes.io/projected/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-kube-api-access-vlff6\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.848819 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysctl-conf\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.848819 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-os-release\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.848819 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-os-release\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.848819 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-os-release\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysctl-conf\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-os-release\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:45.849024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.848991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-kubelet\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-hostroot\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-daemon-config\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-system-cni-dir\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-host-slash\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8krp\" (UniqueName: \"kubernetes.io/projected/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-kube-api-access-r8krp\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-kubernetes\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-run\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-k8s-cni-cncf-io\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cnibin\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-systemd\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849315    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-kubernetes\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-host\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-system-cni-dir\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecc40062-3d0b-4275-94d6-0c82a61be41c-tmp\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-cni-multus\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-host-slash\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-kubelet\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-cni-multus\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-host\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43681a57-c89a-4a78-be3e-d4193f14f14a-kubelet-config\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-hostroot\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-k8s-cni-cncf-io\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-lib-modules\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43681a57-c89a-4a78-be3e-d4193f14f14a-kubelet-config\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849608    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-run\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cnibin\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.849856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-multus-certs\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-daemon-config\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43681a57-c89a-4a78-be3e-d4193f14f14a-dbus\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-systemd\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdh4s\" (UniqueName: \"kubernetes.io/projected/ecc40062-3d0b-4275-94d6-0c82a61be41c-kube-api-access-rdh4s\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-multus-certs\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-lib-modules\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-system-cni-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-system-cni-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43681a57-c89a-4a78-be3e-d4193f14f14a-dbus\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-tuned\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-conf-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-modprobe-d\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cni-binary-copy\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysctl-d\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-etc-kubernetes\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.849997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-conf-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.850987 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spgvr\" (UniqueName: \"kubernetes.io/projected/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-kube-api-access-spgvr\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysconfig\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.850050    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-sys\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysctl-d\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.850133    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:06:46.350107636 +0000 UTC m=+3.133107963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850171    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-sysconfig\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-sys\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-cni-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvbp\" (UniqueName: \"kubernetes.io/projected/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-kube-api-access-bxvbp\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-iptables-alerter-script\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850173    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-modprobe-d\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850134    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-etc-kubernetes\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-cni-dir\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-var-lib-kubelet\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-cni-binary-copy\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.851876 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-socket-dir-parent\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc40062-3d0b-4275-94d6-0c82a61be41c-var-lib-kubelet\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-cnibin\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850512    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-netns\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.850518    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-cni-bin\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.850573    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:46.350551628 +0000 UTC m=+3.133551972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-var-lib-cni-bin\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850637    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-cnibin\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-multus-socket-dir-parent\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-host-run-netns\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.850925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-iptables-alerter-script\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.851036    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-cni-binary-copy\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.852531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecc40062-3d0b-4275-94d6-0c82a61be41c-etc-tuned\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.852791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.852745    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecc40062-3d0b-4275-94d6-0c82a61be41c-tmp\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.856288 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.856243    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:06:45.856288 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.856269    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:06:45.856476 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.856300    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:45.856476 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:45.856366    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:06:46.356349653 +0000 UTC m=+3.139349980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:45.858468 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.858442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdh4s\" (UniqueName: \"kubernetes.io/projected/ecc40062-3d0b-4275-94d6-0c82a61be41c-kube-api-access-rdh4s\") pod \"tuned-lm84t\" (UID: \"ecc40062-3d0b-4275-94d6-0c82a61be41c\") " pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.859225 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.859195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlff6\" (UniqueName: \"kubernetes.io/projected/25a2e3c4-3dbd-415f-bd66-1c3b96adfba4-kube-api-access-vlff6\") pod \"multus-additional-cni-plugins-zxhsp\" (UID: \"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4\") " pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:45.859676 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.859621    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvbp\" (UniqueName: \"kubernetes.io/projected/21f9b64e-f7a3-472f-b3b9-50aa3dbfc330-kube-api-access-bxvbp\") pod \"multus-x5xrc\" (UID: \"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330\") " pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:45.860043 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.860008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spgvr\" (UniqueName: \"kubernetes.io/projected/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-kube-api-access-spgvr\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:45.861179 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.861158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8krp\" (UniqueName: \"kubernetes.io/projected/9a0b9b37-9d82-4f7b-b76e-caa39b4698a7-kube-api-access-r8krp\") pod \"iptables-alerter-j2r28\" (UID: \"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7\") " pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:45.940017 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.939702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:06:45.948684 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.948653    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jqm8v"
Jul 12 08:06:45.959100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.959071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:06:45.966248 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.966220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9mggq"
Jul 12 08:06:45.978287 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.978249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b"
Jul 12 08:06:45.986311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.986275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lm84t"
Jul 12 08:06:45.994318 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:45.994299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x5xrc"
Jul 12 08:06:46.004177 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.004158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zxhsp"
Jul 12 08:06:46.012095 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.012076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j2r28"
Jul 12 08:06:46.354296 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.354250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:46.354487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.354336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:46.354487 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.354452    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:46.354487 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.354479    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:46.354649 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.354532    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:06:47.354508654 +0000 UTC m=+4.137508978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:46.354649 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.354555    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:47.354544321 +0000 UTC m=+4.137544646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:46.455443 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.455408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:46.455611 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.455549    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:06:46.455611 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.455567    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:06:46.455611 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.455580    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:46.455722 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.455643    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:06:47.455627262 +0000 UTC m=+4.238627587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:46.680570 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.680436    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 08:01:46 +0000 UTC" deadline="2028-02-25 21:24:29.145533635 +0000 UTC"
Jul 12 08:06:46.680570 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.680506    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14245h17m42.465040315s"
Jul 12 08:06:46.750231 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:46.750196    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:46.750418 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:46.750359    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:46.869149 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.869007    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e5d712_8a13_4116_b27f_90ee36e4bcc3.slice/crio-69d604131e31554e4768de3dfa40a0a44711d09007cb5e0d255f3e6bc66cee3e WatchSource:0}: Error finding container 69d604131e31554e4768de3dfa40a0a44711d09007cb5e0d255f3e6bc66cee3e: Status 404 returned error can't find the container with id 69d604131e31554e4768de3dfa40a0a44711d09007cb5e0d255f3e6bc66cee3e
Jul 12 08:06:46.869894 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.869866    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40c28da_2de4_4ec8_b784_9c677149aa67.slice/crio-ca0114b61ff90858c9c5fa8a0de951c0f92e536ec160986a5d8968c749e457e7 WatchSource:0}: Error finding container ca0114b61ff90858c9c5fa8a0de951c0f92e536ec160986a5d8968c749e457e7: Status 404 returned error can't find the container with id ca0114b61ff90858c9c5fa8a0de951c0f92e536ec160986a5d8968c749e457e7
Jul 12 08:06:46.873808 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.873620    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc40062_3d0b_4275_94d6_0c82a61be41c.slice/crio-3ba424d2c07bca42dd1ebc680ba4ca5a4564340a5cd252d2189bd57b7b15d6ff WatchSource:0}: Error finding container 3ba424d2c07bca42dd1ebc680ba4ca5a4564340a5cd252d2189bd57b7b15d6ff: Status 404 returned error can't find the container with id 3ba424d2c07bca42dd1ebc680ba4ca5a4564340a5cd252d2189bd57b7b15d6ff
Jul 12 08:06:46.876446 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.876412    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3188ee17_e04d_4f46_be29_8cefefe19602.slice/crio-7eba646a817f70dd012692069e05c4a3c5e1e7af02bf4615036dcc93b25ce18f WatchSource:0}: Error finding container 7eba646a817f70dd012692069e05c4a3c5e1e7af02bf4615036dcc93b25ce18f: Status 404 returned error can't find the container with id 7eba646a817f70dd012692069e05c4a3c5e1e7af02bf4615036dcc93b25ce18f
Jul 12 08:06:46.898174 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.898149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4996a8_c882_42b8_a249_66d69834c4d5.slice/crio-5c7d0f8a517f5964490b6dcd4ebb80ea30b39e22544321ca8c799f24d2ce9da8 WatchSource:0}: Error finding container 5c7d0f8a517f5964490b6dcd4ebb80ea30b39e22544321ca8c799f24d2ce9da8: Status 404 returned error can't find the container with id 5c7d0f8a517f5964490b6dcd4ebb80ea30b39e22544321ca8c799f24d2ce9da8
Jul 12 08:06:46.899676 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.899576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a2e3c4_3dbd_415f_bd66_1c3b96adfba4.slice/crio-0418115c1bf2e2a6c3f18b87b5e7718ffd14241a56288cd9c1461f13f7b0921c WatchSource:0}: Error finding container 0418115c1bf2e2a6c3f18b87b5e7718ffd14241a56288cd9c1461f13f7b0921c: Status 404 returned error can't find the container with id 0418115c1bf2e2a6c3f18b87b5e7718ffd14241a56288cd9c1461f13f7b0921c
Jul 12 08:06:46.900770 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.900608    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18243b1_9e15_4904_b64b_41ea35b8d2fa.slice/crio-ebe95d2af967a96267028aeee328f0ea1fc7fe66698edf67652ba796cfb48ee3 WatchSource:0}: Error finding container ebe95d2af967a96267028aeee328f0ea1fc7fe66698edf67652ba796cfb48ee3: Status 404 returned error can't find the container with id ebe95d2af967a96267028aeee328f0ea1fc7fe66698edf67652ba796cfb48ee3
Jul 12 08:06:46.901480 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.901303    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f9b64e_f7a3_472f_b3b9_50aa3dbfc330.slice/crio-22921072a274f17749aa00cde4be2bbf4c2b39e92b609cff5074d354a900a5d8 WatchSource:0}: Error finding container 22921072a274f17749aa00cde4be2bbf4c2b39e92b609cff5074d354a900a5d8: Status 404 returned error can't find the container with id 22921072a274f17749aa00cde4be2bbf4c2b39e92b609cff5074d354a900a5d8
Jul 12 08:06:46.902873 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:06:46.902832    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0b9b37_9d82_4f7b_b76e_caa39b4698a7.slice/crio-a598db14937283a2d088ea8f91d48968e0016558a5c317a378988fc85b90549e WatchSource:0}: Error finding container a598db14937283a2d088ea8f91d48968e0016558a5c317a378988fc85b90549e: Status 404 returned error can't find the container with id a598db14937283a2d088ea8f91d48968e0016558a5c317a378988fc85b90549e
Jul 12 08:06:47.364450 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.364177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:47.364646 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.364543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:47.364715 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.364689    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:47.364777 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.364765    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:06:49.364737602 +0000 UTC m=+6.147737930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:47.365237 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.365210    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:47.365393 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.365288    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:49.365270166 +0000 UTC m=+6.148270495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:47.465338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.465103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:47.466269 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.465651    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:06:47.466269 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.465682    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:06:47.466269 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.465697    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:47.466269 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.465776    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:06:49.465740182 +0000 UTC m=+6.248740532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:47.681485 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.681406    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 08:01:46 +0000 UTC" deadline="2027-12-22 11:20:41.463057267 +0000 UTC"
Jul 12 08:06:47.681485 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.681484    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12675h13m53.781578019s"
Jul 12 08:06:47.753734 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.752958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:47.753734 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.753105    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:47.753734 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.753564    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:47.753734 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:47.753667    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:47.777163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.777026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x5xrc" event={"ID":"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330","Type":"ContainerStarted","Data":"22921072a274f17749aa00cde4be2bbf4c2b39e92b609cff5074d354a900a5d8"}
Jul 12 08:06:47.780732 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.780696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b" event={"ID":"a18243b1-9e15-4904-b64b-41ea35b8d2fa","Type":"ContainerStarted","Data":"ebe95d2af967a96267028aeee328f0ea1fc7fe66698edf67652ba796cfb48ee3"}
Jul 12 08:06:47.794566 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.794491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ztwc8" event={"ID":"bd4996a8-c882-42b8-a249-66d69834c4d5","Type":"ContainerStarted","Data":"5c7d0f8a517f5964490b6dcd4ebb80ea30b39e22544321ca8c799f24d2ce9da8"}
Jul 12 08:06:47.816859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.816815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lm84t" event={"ID":"ecc40062-3d0b-4275-94d6-0c82a61be41c","Type":"ContainerStarted","Data":"3ba424d2c07bca42dd1ebc680ba4ca5a4564340a5cd252d2189bd57b7b15d6ff"}
Jul 12 08:06:47.829139 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.829105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"ca0114b61ff90858c9c5fa8a0de951c0f92e536ec160986a5d8968c749e457e7"}
Jul 12 08:06:47.848373 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.848294    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d7df46f4f885787e24f950064b8eefd" containerID="aaf4e388b22d0fe60fbde79f33b3698ff2fd500004c1332634bd980d1564d74b" exitCode=0
Jul 12 08:06:47.848548 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.848433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal" event={"ID":"8d7df46f4f885787e24f950064b8eefd","Type":"ContainerDied","Data":"aaf4e388b22d0fe60fbde79f33b3698ff2fd500004c1332634bd980d1564d74b"}
Jul 12 08:06:47.871873 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.871767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j2r28" event={"ID":"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7","Type":"ContainerStarted","Data":"a598db14937283a2d088ea8f91d48968e0016558a5c317a378988fc85b90549e"}
Jul 12 08:06:47.887413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.887376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerStarted","Data":"0418115c1bf2e2a6c3f18b87b5e7718ffd14241a56288cd9c1461f13f7b0921c"}
Jul 12 08:06:47.904961 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.904912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqm8v" event={"ID":"3188ee17-e04d-4f46-be29-8cefefe19602","Type":"ContainerStarted","Data":"7eba646a817f70dd012692069e05c4a3c5e1e7af02bf4615036dcc93b25ce18f"}
Jul 12 08:06:47.917060 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.916960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9mggq" event={"ID":"85e5d712-8a13-4116-b27f-90ee36e4bcc3","Type":"ContainerStarted","Data":"69d604131e31554e4768de3dfa40a0a44711d09007cb5e0d255f3e6bc66cee3e"}
Jul 12 08:06:47.947268 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:47.947179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal" event={"ID":"2f62b47d48c505e45174394dfbbead6a","Type":"ContainerStarted","Data":"fa71bef2ee23edd15bf3cf5018c08eb295da38a9e0825d7cbb74fb45744b5d6b"}
Jul 12 08:06:48.750075 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:48.750037    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:48.750529 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:48.750185    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:48.962497 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:48.962377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal" event={"ID":"8d7df46f4f885787e24f950064b8eefd","Type":"ContainerStarted","Data":"652915832a6a6c12fab78835ad97e0cfdf605139ddb850a18cb2ef55c88efbb1"}
Jul 12 08:06:48.977774 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:48.977696    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-71.ec2.internal" podStartSLOduration=2.977671155 podStartE2EDuration="2.977671155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:06:47.962454816 +0000 UTC m=+4.745455165" watchObservedRunningTime="2026-07-12 08:06:48.977671155 +0000 UTC m=+5.760671497"
Jul 12 08:06:49.382322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:49.382264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:49.382532 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:49.382388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:49.382532 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.382520    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:49.382666 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.382587    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:06:53.382568148 +0000 UTC m=+10.165568473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:49.383021 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.382997    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:49.383108 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.383057    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:53.383039829 +0000 UTC m=+10.166040153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:49.484299 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:49.483571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:49.484299 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.483800    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:06:49.484299 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.483823    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:06:49.484299 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.483838    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:49.484299 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.483899    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:06:53.483879507 +0000 UTC m=+10.266879847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:49.750501 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:49.750413    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:49.751042 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.750558    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:49.751042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:49.750906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:49.751042 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:49.750976    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:50.750492 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:50.749841    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:50.750492 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:50.749988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:51.751136 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:51.750520    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:51.751136 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:51.750702    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:51.751136 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:51.750781    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:51.751136 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:51.750922    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:52.749751 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:52.749716    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:52.749937 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:52.749874    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:53.420622 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:53.420580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:53.421108 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:53.420698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:53.421108 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.420843    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:53.421108 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.420909    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:07:01.420888275 +0000 UTC m=+18.203888606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:06:53.421352 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.421327    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:53.421499 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.421406    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:01.421388463 +0000 UTC m=+18.204388788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:06:53.521894 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:53.521826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:53.522199 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.522180    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:06:53.522302 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.522206    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:06:53.522302 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.522219    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:53.522302 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.522277    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:07:01.522257284 +0000 UTC m=+18.305257623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:06:53.752038 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:53.751444    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:53.752038 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.751601    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:53.752038 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:53.751666    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:53.752038 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:53.751795    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:54.749604 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:54.749571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:54.750171 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:54.749740    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:55.753547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:55.753507    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:55.753994 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:55.753517    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:55.753994 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:55.753629    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:55.753994 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:55.753745    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:56.750027 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:56.749503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:56.750027 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:56.749655    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:57.753198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:57.753170    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:57.753719 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:57.753273    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:06:57.753788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:57.753735    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:57.753903 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:57.753833    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:58.750072 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:58.749988    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:06:58.750228 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:58.750101    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:06:59.750040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:59.749997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:06:59.750523 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:59.750144    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:06:59.750523 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:06:59.750202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:06:59.750523 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:06:59.750331    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:00.750158 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:00.750117    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:00.750674 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:00.750241    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:01.489003 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:01.488968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:01.489270 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:01.489049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:01.489270 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.489152    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:07:01.489270 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.489162    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:07:01.489270 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.489221    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:07:17.489206821 +0000 UTC m=+34.272207142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:07:01.489270 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.489234    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:17.489227274 +0000 UTC m=+34.272227596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:07:01.589641 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:01.589598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:01.589812 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.589781    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:07:01.589812 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.589804    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:07:01.589930 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.589818    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:07:01.589930 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.589876    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:07:17.589863359 +0000 UTC m=+34.372863681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:07:01.749627 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:01.749533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:01.749801 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:01.749542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:01.749801 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.749676    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:01.749801 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:01.749741    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:02.750057 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:02.749971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:02.750524 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:02.750120    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:03.751342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:03.751292    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:03.751342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:03.751335    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:03.751865 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:03.751435    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:03.751950 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:03.751915    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:04.750198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:04.750167    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:04.750418 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:04.750305    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:05.750338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:05.750306    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:05.750793 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:05.750310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:05.750793 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:05.750423    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:05.750793 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:05.750517    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:06.754505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:06.754474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:06.754977 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:06.754607    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:07.006888 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.006852    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x5xrc" event={"ID":"21f9b64e-f7a3-472f-b3b9-50aa3dbfc330","Type":"ContainerStarted","Data":"4e604bacd1f58426aa0f87bf1e0edf72eb5c8b1ac90bcbed1220c96aac62d764"}
Jul 12 08:07:07.008248 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.008221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b" event={"ID":"a18243b1-9e15-4904-b64b-41ea35b8d2fa","Type":"ContainerStarted","Data":"1771f5f0228f37095e1ccae19835495db530f524a9cab02f12a0a370f778e415"}
Jul 12 08:07:07.009694 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.009667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ztwc8" event={"ID":"bd4996a8-c882-42b8-a249-66d69834c4d5","Type":"ContainerStarted","Data":"7c7c73532b818d5bc6def8dba3490997b8db5bdc4edcd824056de96601a5c1ae"}
Jul 12 08:07:07.011600 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.011382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lm84t" event={"ID":"ecc40062-3d0b-4275-94d6-0c82a61be41c","Type":"ContainerStarted","Data":"761b5b88d5b85b7ef74f7609831a1bb1de3fd066f4b6c2ffef1d9102c650cba2"}
Jul 12 08:07:07.013580 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.013561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"d5cfef279b78e92026b1d3fb31e6d972b96b7ad4ca2bfe138586aa279eec3f3f"}
Jul 12 08:07:07.015215 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.015193    2558 generic.go:356] "Generic (PLEG): container finished" podID="25a2e3c4-3dbd-415f-bd66-1c3b96adfba4" containerID="0b4fc48580132c1e8cb43ca8141974be9e42a0b8c021de3bbd0410e665b566a5" exitCode=0
Jul 12 08:07:07.015351 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.015254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerDied","Data":"0b4fc48580132c1e8cb43ca8141974be9e42a0b8c021de3bbd0410e665b566a5"}
Jul 12 08:07:07.017581 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.017556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jqm8v" event={"ID":"3188ee17-e04d-4f46-be29-8cefefe19602","Type":"ContainerStarted","Data":"8d1323a1f3895d97424e9c38d89c59b25878a84d9e41ceca91e298aa455b0841"}
Jul 12 08:07:07.019456 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.019431    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9mggq" event={"ID":"85e5d712-8a13-4116-b27f-90ee36e4bcc3","Type":"ContainerStarted","Data":"d061fadfc185b25766f5e1e1ee960d2890465f16bb7cd4ffa04cf05cb361fc88"}
Jul 12 08:07:07.022101 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.022066    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x5xrc" podStartSLOduration=2.168920315 podStartE2EDuration="22.022038548s" totalImagesPullingTime="19.853118233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:07.021999335 +0000 UTC m=+23.804999681" watchObservedRunningTime="2026-07-12 08:07:07.022038548 +0000 UTC m=+23.805038885"
Jul 12 08:07:07.022788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.022751    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-71.ec2.internal" podStartSLOduration=21.022739307 podStartE2EDuration="21.022739307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:06:48.978107776 +0000 UTC m=+5.761108125" watchObservedRunningTime="2026-07-12 08:07:07.022739307 +0000 UTC m=+23.805739651"
Jul 12 08:07:07.039641 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.039595    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jqm8v" podStartSLOduration=3.223444304 podStartE2EDuration="23.039579268s" totalImagesPullingTime="19.816134964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:07.039056152 +0000 UTC m=+23.822056495" watchObservedRunningTime="2026-07-12 08:07:07.039579268 +0000 UTC m=+23.822579612"
Jul 12 08:07:07.051957 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.051914    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ztwc8" podStartSLOduration=7.633234559 podStartE2EDuration="23.051898871s" totalImagesPullingTime="15.418664312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:07.051227403 +0000 UTC m=+23.834227746" watchObservedRunningTime="2026-07-12 08:07:07.051898871 +0000 UTC m=+23.834899215"
Jul 12 08:07:07.064106 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.064049    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9mggq" podStartSLOduration=2.225096907 podStartE2EDuration="22.064033386s" totalImagesPullingTime="19.838936479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:07.063576082 +0000 UTC m=+23.846576426" watchObservedRunningTime="2026-07-12 08:07:07.064033386 +0000 UTC m=+23.847033731"
Jul 12 08:07:07.083228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.083174    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lm84t" podStartSLOduration=2.232887283 podStartE2EDuration="22.083152194s" totalImagesPullingTime="19.850264911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:07.082650678 +0000 UTC m=+23.865651023" watchObservedRunningTime="2026-07-12 08:07:07.083152194 +0000 UTC m=+23.866152538"
Jul 12 08:07:07.749690 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.749493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:07.749903 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:07.749551    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:07.749903 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:07.749768    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:07.749903 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:07.749822    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:08.024867 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.024825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:07:08.025776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.025211    2558 generic.go:356] "Generic (PLEG): container finished" podID="c40c28da-2de4-4ec8-b784-9c677149aa67" containerID="49a603320e248a69558b44197d7910c378d5128022301272e955b58c6e63aa54" exitCode=1
Jul 12 08:07:08.025776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.025246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"f9b4732855fbfe5433012a8b0a0952168a7a6797151e3bb431f77b4db398d665"}
Jul 12 08:07:08.025776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.025357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"63b85cc1798c1c26882c648daf2d23e2f659fdce2b101da2a56952036a2f0be0"}
Jul 12 08:07:08.025776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.025418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"fd3bb034d826da547d98a50d0976a28fb88e366ac6ecdd0b570cd6d1f1e3ac7d"}
Jul 12 08:07:08.025776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.025460    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"f7cf7a0eca4e0c72d8883a1ae6713dd3ccd586b2995a64587f7137f19f874f95"}
Jul 12 08:07:08.025776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.025490    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerDied","Data":"49a603320e248a69558b44197d7910c378d5128022301272e955b58c6e63aa54"}
Jul 12 08:07:08.456324 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.456296    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 08:07:08.718990 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.718831    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T08:07:08.456318681Z","UUID":"65ca964d-3c65-4652-8f81-2ef965d45e1e","Handler":null,"Name":"","Endpoint":""}
Jul 12 08:07:08.720592 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.720566    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 08:07:08.720726 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.720609    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 08:07:08.749803 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:08.749771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:08.749954 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:08.749912    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:09.030506 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:09.030224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j2r28" event={"ID":"9a0b9b37-9d82-4f7b-b76e-caa39b4698a7","Type":"ContainerStarted","Data":"ed7a80ea3fb356afa3be8f7f75969c4d5d9222d7aa35bad58d96140ce25916dc"}
Jul 12 08:07:09.032682 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:09.032622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b" event={"ID":"a18243b1-9e15-4904-b64b-41ea35b8d2fa","Type":"ContainerStarted","Data":"35a1d40accd883d92b7cb456f169fbf182546211ce0913b2e7a625a13c29b989"}
Jul 12 08:07:09.043797 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:09.043748    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j2r28" podStartSLOduration=4.237144691 podStartE2EDuration="24.0437313s" totalImagesPullingTime="19.806586609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:09.043343295 +0000 UTC m=+25.826343640" watchObservedRunningTime="2026-07-12 08:07:09.0437313 +0000 UTC m=+25.826731647"
Jul 12 08:07:09.634627 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:09.634374    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:07:09.749857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:09.749828    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:09.750010 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:09.749833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:09.750010 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:09.749936    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:09.750138 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:09.750058    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:10.038423 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:10.038401    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:07:10.038821 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:10.038755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"3bdfa143d5b1b341c3d61e9e1a2760d28118d3a9fb84945587370b24a45735f7"}
Jul 12 08:07:10.040693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:10.040662    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b" event={"ID":"a18243b1-9e15-4904-b64b-41ea35b8d2fa","Type":"ContainerStarted","Data":"00ea0b5af679239925db32df4d99953c4f05b7cddd0dbd2e192cfc13b51b7d91"}
Jul 12 08:07:10.750198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:10.750164    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:10.750398 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:10.750311    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:11.246673 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:11.246635    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:07:11.247348 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:11.247268    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:07:11.260767 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:11.260719    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c6r5b" podStartSLOduration=3.870374184 podStartE2EDuration="26.260702239s" totalImagesPullingTime="22.390328055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:10.056617549 +0000 UTC m=+26.839617896" watchObservedRunningTime="2026-07-12 08:07:11.260702239 +0000 UTC m=+28.043702583"
Jul 12 08:07:11.749623 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:11.749591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:11.749812 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:11.749732    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:11.749812 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:11.749797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:11.749944 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:11.749914    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:12.048600 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.048426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:07:12.049008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.048974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"3775f3a7dbc513368860e803cac1f10afe9a80f4e85a431ecfa7f7acc83a8fa7"}
Jul 12 08:07:12.049238 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.049212    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:07:12.049338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.049315    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:07:12.049399 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.049353    2558 scope.go:117] "RemoveContainer" containerID="49a603320e248a69558b44197d7910c378d5128022301272e955b58c6e63aa54"
Jul 12 08:07:12.050475 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.050456    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ztwc8"
Jul 12 08:07:12.065942 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.065912    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:07:12.749920 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:12.749892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:12.750505 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:12.749983    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:13.058443 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.058413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:07:13.058895 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.058859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" event={"ID":"c40c28da-2de4-4ec8-b784-9c677149aa67","Type":"ContainerStarted","Data":"90b7f2a8ecc36c0dd43a2140311ae1c2b71987ffe407934ccd798425604a612f"}
Jul 12 08:07:13.059184 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.059162    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:07:13.061358 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.061336    2558 generic.go:356] "Generic (PLEG): container finished" podID="25a2e3c4-3dbd-415f-bd66-1c3b96adfba4" containerID="6ba50f615583d64b5300eb535e9446f4d75fe162c57128e51b64157cd4429975" exitCode=0
Jul 12 08:07:13.062132 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.062109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerDied","Data":"6ba50f615583d64b5300eb535e9446f4d75fe162c57128e51b64157cd4429975"}
Jul 12 08:07:13.077571 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.077545    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:07:13.085684 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.085624    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m" podStartSLOduration=9.125381416 podStartE2EDuration="29.085590959s" totalImagesPullingTime="19.960209543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:13.084123321 +0000 UTC m=+29.867123678" watchObservedRunningTime="2026-07-12 08:07:13.085590959 +0000 UTC m=+29.868591307"
Jul 12 08:07:13.750353 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.750317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:13.750353 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:13.750352    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:13.751010 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:13.750454    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:13.751010 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:13.750591    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:14.078004 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:14.077762    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrdms"]
Jul 12 08:07:14.078158 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:14.078102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:14.078261 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:14.078241    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:14.080795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:14.080739    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r6jrm"]
Jul 12 08:07:14.080886 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:14.080857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:14.080983 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:14.080963    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:14.081487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:14.081463    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bvx29"]
Jul 12 08:07:14.081606 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:14.081593    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:14.081732 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:14.081711    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:15.067616 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:15.067582    2558 generic.go:356] "Generic (PLEG): container finished" podID="25a2e3c4-3dbd-415f-bd66-1c3b96adfba4" containerID="5af37cf24d1008c55c34b6870c7271c46e5105d123daa91624d735da311b79fe" exitCode=0
Jul 12 08:07:15.068049 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:15.067626    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerDied","Data":"5af37cf24d1008c55c34b6870c7271c46e5105d123daa91624d735da311b79fe"}
Jul 12 08:07:15.749700 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:15.749659    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:15.749867 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:15.749721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:15.749867 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:15.749658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:15.749867 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:15.749806    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:15.750036 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:15.749907    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:15.750036 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:15.749988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:17.074570 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.074530    2558 generic.go:356] "Generic (PLEG): container finished" podID="25a2e3c4-3dbd-415f-bd66-1c3b96adfba4" containerID="3b3e467c4202d1a0405d77c6428ecfc9e29e454fda308691b14a23ab3cd846b5" exitCode=0
Jul 12 08:07:17.075146 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.074592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerDied","Data":"3b3e467c4202d1a0405d77c6428ecfc9e29e454fda308691b14a23ab3cd846b5"}
Jul 12 08:07:17.510351 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.510308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:17.510525 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.510374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:17.510525 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.510461    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 08:07:17.510525 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.510470    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:07:17.510525 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.510514    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret podName:43681a57-c89a-4a78-be3e-d4193f14f14a nodeName:}" failed. No retries permitted until 2026-07-12 08:07:49.510501022 +0000 UTC m=+66.293501344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret") pod "global-pull-secret-syncer-r6jrm" (UID: "43681a57-c89a-4a78-be3e-d4193f14f14a") : object "kube-system"/"original-pull-secret" not registered
Jul 12 08:07:17.510704 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.510530    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs podName:50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:49.510520801 +0000 UTC m=+66.293521122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs") pod "network-metrics-daemon-bvx29" (UID: "50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 08:07:17.610925 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.610881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:17.611111 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.611039    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 08:07:17.611111 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.611057    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 08:07:17.611111 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.611068    2558 projected.go:196] Error preparing data for projected volume kube-api-access-qq9rf for pod openshift-network-diagnostics/network-check-target-wrdms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:07:17.611300 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.611128    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf podName:8109fe9c-461d-45d5-99d9-39c632d05dbb nodeName:}" failed. No retries permitted until 2026-07-12 08:07:49.611114409 +0000 UTC m=+66.394114731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qq9rf" (UniqueName: "kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf") pod "network-check-target-wrdms" (UID: "8109fe9c-461d-45d5-99d9-39c632d05dbb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 08:07:17.749590 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.749504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:17.749590 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.749505    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:17.749780 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:17.749636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:17.749780 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.749640    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvx29" podUID="50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46"
Jul 12 08:07:17.749780 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.749743    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r6jrm" podUID="43681a57-c89a-4a78-be3e-d4193f14f14a"
Jul 12 08:07:17.749895 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:17.749826    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrdms" podUID="8109fe9c-461d-45d5-99d9-39c632d05dbb"
Jul 12 08:07:19.565466 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.565432    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-71.ec2.internal" event="NodeReady"
Jul 12 08:07:19.566082 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.565590    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 08:07:19.598548 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.598511    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67564454dd-krx2r"]
Jul 12 08:07:19.602036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.602013    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"]
Jul 12 08:07:19.602156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.602139    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.604236 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.604214    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 08:07:19.604430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.604411    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 08:07:19.604515 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.604455    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 08:07:19.604734 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.604715    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vj6z7\""
Jul 12 08:07:19.605712 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.605692    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-kflgs"]
Jul 12 08:07:19.605855 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.605827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"
Jul 12 08:07:19.607775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.607756    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.608054 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.608028    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.608224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.608181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zcrgd\""
Jul 12 08:07:19.609750 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.609730    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.610473 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.610455    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 08:07:19.611926 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.611897    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6cnzn\""
Jul 12 08:07:19.611926 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.611911    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.611926 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.611897    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.612167 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.612155    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 12 08:07:19.612213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.612183    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 12 08:07:19.614019 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.613810    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bc544f466-pw5ml"]
Jul 12 08:07:19.618968 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.618935    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"]
Jul 12 08:07:19.619614 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.619163    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 12 08:07:19.619614 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.619184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.621897 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.621724    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 12 08:07:19.621897 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.621811    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 12 08:07:19.621897 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.621833    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 12 08:07:19.621897 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.621868    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.622158 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.622146    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 12 08:07:19.622368 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.622351    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.622368 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.622372    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8bm57\""
Jul 12 08:07:19.623391 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.623372    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"]
Jul 12 08:07:19.623484 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.623409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-kflgs"]
Jul 12 08:07:19.623484 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.623432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67564454dd-krx2r"]
Jul 12 08:07:19.623591 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.623522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.625686 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.625667    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.625793 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.625718    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.625793 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.625754    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 12 08:07:19.625913 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.625824    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 12 08:07:19.625965 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.625908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fcdtn\""
Jul 12 08:07:19.636086 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.636059    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qnlwb"]
Jul 12 08:07:19.640119 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.640098    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"]
Jul 12 08:07:19.640389 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.640372    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.643156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.643136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lhqtd\""
Jul 12 08:07:19.643463 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.643446    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 08:07:19.643553 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.643479    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 08:07:19.645140 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.645119    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"]
Jul 12 08:07:19.645314 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.645232    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.648660 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.648642    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-x42kf"]
Jul 12 08:07:19.649202 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.648892    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.649202 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.648910    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-djfpv\""
Jul 12 08:07:19.649202 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.648973    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.649202 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.649006    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:19.650059 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.650037    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 12 08:07:19.650157 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.650138    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 12 08:07:19.651151 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.651130    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 12 08:07:19.651602 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.651584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s2jp6\""
Jul 12 08:07:19.651871 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.651854    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.651945 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.651887    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"]
Jul 12 08:07:19.652185 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.652168    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.652301 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.652264    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.655720 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.655692    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 12 08:07:19.655944 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.655922    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.656078 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.656062    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 12 08:07:19.656163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.656070    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"]
Jul 12 08:07:19.656290 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.656254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.656379 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.656356    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8kps9\""
Jul 12 08:07:19.657387 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.657367    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.659162 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.659141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 12 08:07:19.659328 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.659254    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.659433 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.659379    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 12 08:07:19.659491 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.659386    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9f2lx\""
Jul 12 08:07:19.659767 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.659745    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mx7lg"]
Jul 12 08:07:19.659925 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.659908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:19.660185 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.660060    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.661655 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.661633    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 12 08:07:19.662839 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.662818    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xp7t8\""
Jul 12 08:07:19.663209 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.663189    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 12 08:07:19.663401 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.663385    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 12 08:07:19.663709 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.663594    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"]
Jul 12 08:07:19.663884 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.663656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.665959 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.665937    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mn9v7\""
Jul 12 08:07:19.666186 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.666171    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.666428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.666410    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.666560 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.666523    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 08:07:19.667228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667208    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"]
Jul 12 08:07:19.667338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667252    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bc544f466-pw5ml"]
Jul 12 08:07:19.667338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667302    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qnlwb"]
Jul 12 08:07:19.667338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667322    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"
Jul 12 08:07:19.667496 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"]
Jul 12 08:07:19.667689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667673    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"]
Jul 12 08:07:19.667964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667945    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"]
Jul 12 08:07:19.668112 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.667978    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"]
Jul 12 08:07:19.668112 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.668006    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-x42kf"]
Jul 12 08:07:19.668112 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.668028    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mx7lg"]
Jul 12 08:07:19.668112 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.668050    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"]
Jul 12 08:07:19.669813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.669796    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 08:07:19.669813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.669814    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wh4ss\""
Jul 12 08:07:19.670029 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.670013    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 08:07:19.727918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.727889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm2kg\" (UniqueName: \"kubernetes.io/projected/be0ebd2e-d226-485e-aea7-5e39cd02104f-kube-api-access-vm2kg\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.727918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.727919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33dc61bb-6dbf-44a8-a793-5882af9def06-tmp\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.728115 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.727948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.728115 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.727964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.728115 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.727998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9gb2\" (UniqueName: \"kubernetes.io/projected/33dc61bb-6dbf-44a8-a793-5882af9def06-kube-api-access-z9gb2\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.728115 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-bound-sa-token\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.728115 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-image-registry-private-configuration\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fp7v\" (UniqueName: \"kubernetes.io/projected/8215fe18-bcb5-4887-b124-3ea8f81e5e96-kube-api-access-4fp7v\") pod \"volume-data-source-validator-78495597f6-wjsd7\" (UID: \"8215fe18-bcb5-4887-b124-3ea8f81e5e96\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-config-volume\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33dc61bb-6dbf-44a8-a793-5882af9def06-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b5f887b-f46f-423c-bc98-ef1857715bb5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3003ddb7-f5e4-47c9-9493-181850171749-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdpjd\" (UniqueName: \"kubernetes.io/projected/0b5f887b-f46f-423c-bc98-ef1857715bb5-kube-api-access-gdpjd\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.728313 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-stats-auth\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-installation-pull-secrets\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-tmp-dir\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728419    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67537171-dbd5-41c1-b8a1-fd5193dedbe2-ca-trust-extracted\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs57l\" (UniqueName: \"kubernetes.io/projected/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-kube-api-access-gs57l\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm9lj\" (UniqueName: \"kubernetes.io/projected/a1bcbbfd-a0c2-478c-8eca-393cef50e520-kube-api-access-sm9lj\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33dc61bb-6dbf-44a8-a793-5882af9def06-serving-cert\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be0ebd2e-d226-485e-aea7-5e39cd02104f-config\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0ebd2e-d226-485e-aea7-5e39cd02104f-trusted-ca\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.728648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-trusted-ca\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6tv2\" (UniqueName: \"kubernetes.io/projected/3003ddb7-f5e4-47c9-9493-181850171749-kube-api-access-j6tv2\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7dqj\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-kube-api-access-b7dqj\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-default-certificate\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/33dc61bb-6dbf-44a8-a793-5882af9def06-snapshots\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be0ebd2e-d226-485e-aea7-5e39cd02104f-serving-cert\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-certificates\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3003ddb7-f5e4-47c9-9493-181850171749-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33dc61bb-6dbf-44a8-a793-5882af9def06-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.729040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.728867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdbz\" (UniqueName: \"kubernetes.io/projected/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-kube-api-access-6gdbz\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.749531 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.749498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:19.749736 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.749508    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:19.750148 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.749908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:19.751739 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.751715    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 08:07:19.751739 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.751731    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xxbfq\""
Jul 12 08:07:19.751961 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.751849    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 08:07:19.752070 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.752051    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rkfrj\""
Jul 12 08:07:19.829582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829504    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.829582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.829582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67537171-dbd5-41c1-b8a1-fd5193dedbe2-ca-trust-extracted\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs57l\" (UniqueName: \"kubernetes.io/projected/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-kube-api-access-gs57l\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.829679    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.329660959 +0000 UTC m=+37.112661310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : configmap references non-existent config key: service-ca.crt
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.829682    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.829699    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67564454dd-krx2r: secret "image-registry-tls" not found
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm9lj\" (UniqueName: \"kubernetes.io/projected/a1bcbbfd-a0c2-478c-8eca-393cef50e520-kube-api-access-sm9lj\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33dc61bb-6dbf-44a8-a793-5882af9def06-serving-cert\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.829752    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls podName:67537171-dbd5-41c1-b8a1-fd5193dedbe2 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.329739007 +0000 UTC m=+37.112739349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls") pod "image-registry-67564454dd-krx2r" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2") : secret "image-registry-tls" not found
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dv4g\" (UniqueName: \"kubernetes.io/projected/d3e80c24-675f-4c82-9dd4-45a2f5561f85-kube-api-access-2dv4g\") pod \"ingress-canary-mx7lg\" (UID: \"d3e80c24-675f-4c82-9dd4-45a2f5561f85\") " pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be0ebd2e-d226-485e-aea7-5e39cd02104f-config\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.829852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgxbs\" (UniqueName: \"kubernetes.io/projected/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-kube-api-access-zgxbs\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0ebd2e-d226-485e-aea7-5e39cd02104f-trusted-ca\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3e80c24-675f-4c82-9dd4-45a2f5561f85-cert\") pod \"ingress-canary-mx7lg\" (UID: \"d3e80c24-675f-4c82-9dd4-45a2f5561f85\") " pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-config\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-trusted-ca\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.829989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6tv2\" (UniqueName: \"kubernetes.io/projected/3003ddb7-f5e4-47c9-9493-181850171749-kube-api-access-j6tv2\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7dqj\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-kube-api-access-b7dqj\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-default-certificate\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67537171-dbd5-41c1-b8a1-fd5193dedbe2-ca-trust-extracted\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/33dc61bb-6dbf-44a8-a793-5882af9def06-snapshots\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be0ebd2e-d226-485e-aea7-5e39cd02104f-serving-cert\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-certificates\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3003ddb7-f5e4-47c9-9493-181850171749-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.830413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33dc61bb-6dbf-44a8-a793-5882af9def06-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdbz\" (UniqueName: \"kubernetes.io/projected/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-kube-api-access-6gdbz\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm2kg\" (UniqueName: \"kubernetes.io/projected/be0ebd2e-d226-485e-aea7-5e39cd02104f-kube-api-access-vm2kg\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33dc61bb-6dbf-44a8-a793-5882af9def06-tmp\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-nginx-conf\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9gb2\" (UniqueName: \"kubernetes.io/projected/33dc61bb-6dbf-44a8-a793-5882af9def06-kube-api-access-z9gb2\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mgts\" (UniqueName: \"kubernetes.io/projected/fdfadeba-25a9-4221-a4a0-02a0a0ba559f-kube-api-access-7mgts\") pod \"network-check-source-869dcfcdcd-hp7j6\" (UID: \"fdfadeba-25a9-4221-a4a0-02a0a0ba559f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-bound-sa-token\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-image-registry-private-configuration\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fp7v\" (UniqueName: \"kubernetes.io/projected/8215fe18-bcb5-4887-b124-3ea8f81e5e96-kube-api-access-4fp7v\") pod \"volume-data-source-validator-78495597f6-wjsd7\" (UID: \"8215fe18-bcb5-4887-b124-3ea8f81e5e96\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-config-volume\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33dc61bb-6dbf-44a8-a793-5882af9def06-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830602    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be0ebd2e-d226-485e-aea7-5e39cd02104f-config\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:19.831153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b5f887b-f46f-423c-bc98-ef1857715bb5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3003ddb7-f5e4-47c9-9493-181850171749-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdpjd\" (UniqueName: \"kubernetes.io/projected/0b5f887b-f46f-423c-bc98-ef1857715bb5-kube-api-access-gdpjd\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-stats-auth\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830829    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-certificates\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/be0ebd2e-d226-485e-aea7-5e39cd02104f-trusted-ca\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.831252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-trusted-ca\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.831679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b5f887b-f46f-423c-bc98-ef1857715bb5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.831776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33dc61bb-6dbf-44a8-a793-5882af9def06-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.831828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3003ddb7-f5e4-47c9-9493-181850171749-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.831919 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.831892    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 08:07:19.832600 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.832116    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.332098386 +0000 UTC m=+37.115098717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : secret "router-metrics-certs-default" not found
Jul 12 08:07:19.832600 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.830834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-installation-pull-secrets\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.832600 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.832156    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 08:07:19.832600 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.832168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-tmp-dir\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.832600 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.832203    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls podName:a1bcbbfd-a0c2-478c-8eca-393cef50e520 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.332189054 +0000 UTC m=+37.115189394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls") pod "cluster-samples-operator-65db858894-g6g4q" (UID: "a1bcbbfd-a0c2-478c-8eca-393cef50e520") : secret "samples-operator-tls" not found
Jul 12 08:07:19.832600 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.832515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-tmp-dir\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.832956 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.832608    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33dc61bb-6dbf-44a8-a793-5882af9def06-tmp\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.832956 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.832694    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 08:07:19.832956 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.832747    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls podName:8cb1f0a8-8440-45f6-9f00-ac7624c693d7 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.332732031 +0000 UTC m=+37.115732355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls") pod "dns-default-qnlwb" (UID: "8cb1f0a8-8440-45f6-9f00-ac7624c693d7") : secret "dns-default-metrics-tls" not found
Jul 12 08:07:19.833103 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.833018    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/33dc61bb-6dbf-44a8-a793-5882af9def06-snapshots\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.833103 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.833044    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:19.833103 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.833102    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls podName:0b5f887b-f46f-423c-bc98-ef1857715bb5 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.333087822 +0000 UTC m=+37.116088168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-trcrn" (UID: "0b5f887b-f46f-423c-bc98-ef1857715bb5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:19.833257 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.833196    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-config-volume\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.834118 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.833923    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33dc61bb-6dbf-44a8-a793-5882af9def06-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.835301 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.835234    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-installation-pull-secrets\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.835581 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.835563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33dc61bb-6dbf-44a8-a793-5882af9def06-serving-cert\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.835813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.835795    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-stats-auth\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.836257 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.836214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be0ebd2e-d226-485e-aea7-5e39cd02104f-serving-cert\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.836775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.836749    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-default-certificate\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.836848 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.836824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3003ddb7-f5e4-47c9-9493-181850171749-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.838144 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.838126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-image-registry-private-configuration\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.845715 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.844854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm9lj\" (UniqueName: \"kubernetes.io/projected/a1bcbbfd-a0c2-478c-8eca-393cef50e520-kube-api-access-sm9lj\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:19.846998 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.846226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6tv2\" (UniqueName: \"kubernetes.io/projected/3003ddb7-f5e4-47c9-9493-181850171749-kube-api-access-j6tv2\") pod \"kube-storage-version-migrator-operator-799cb7f958-6dc9m\" (UID: \"3003ddb7-f5e4-47c9-9493-181850171749\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.846998 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.846659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs57l\" (UniqueName: \"kubernetes.io/projected/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-kube-api-access-gs57l\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:19.848239 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.848211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fp7v\" (UniqueName: \"kubernetes.io/projected/8215fe18-bcb5-4887-b124-3ea8f81e5e96-kube-api-access-4fp7v\") pod \"volume-data-source-validator-78495597f6-wjsd7\" (UID: \"8215fe18-bcb5-4887-b124-3ea8f81e5e96\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"
Jul 12 08:07:19.848594 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.848573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdbz\" (UniqueName: \"kubernetes.io/projected/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-kube-api-access-6gdbz\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:19.848924 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.848902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7dqj\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-kube-api-access-b7dqj\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.849745 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.849728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdpjd\" (UniqueName: \"kubernetes.io/projected/0b5f887b-f46f-423c-bc98-ef1857715bb5-kube-api-access-gdpjd\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:19.849861 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.849839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-bound-sa-token\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:19.850410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.850388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm2kg\" (UniqueName: \"kubernetes.io/projected/be0ebd2e-d226-485e-aea7-5e39cd02104f-kube-api-access-vm2kg\") pod \"console-operator-7866497494-x42kf\" (UID: \"be0ebd2e-d226-485e-aea7-5e39cd02104f\") " pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:19.851453 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.851430    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9gb2\" (UniqueName: \"kubernetes.io/projected/33dc61bb-6dbf-44a8-a793-5882af9def06-kube-api-access-z9gb2\") pod \"insights-operator-68d9dd94cf-kflgs\" (UID: \"33dc61bb-6dbf-44a8-a793-5882af9def06\") " pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.925771 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.925719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"
Jul 12 08:07:19.933089 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.932858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.933188 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dv4g\" (UniqueName: \"kubernetes.io/projected/d3e80c24-675f-4c82-9dd4-45a2f5561f85-kube-api-access-2dv4g\") pod \"ingress-canary-mx7lg\" (UID: \"d3e80c24-675f-4c82-9dd4-45a2f5561f85\") " pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.933234 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgxbs\" (UniqueName: \"kubernetes.io/projected/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-kube-api-access-zgxbs\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.933298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933232    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3e80c24-675f-4c82-9dd4-45a2f5561f85-cert\") pod \"ingress-canary-mx7lg\" (UID: \"d3e80c24-675f-4c82-9dd4-45a2f5561f85\") " pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.933298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:19.933403 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-config\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.933714 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-nginx-conf\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:19.933815 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mgts\" (UniqueName: \"kubernetes.io/projected/fdfadeba-25a9-4221-a4a0-02a0a0ba559f-kube-api-access-7mgts\") pod \"network-check-source-869dcfcdcd-hp7j6\" (UID: \"fdfadeba-25a9-4221-a4a0-02a0a0ba559f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"
Jul 12 08:07:19.933880 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.933824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-config\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.933933 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.933906    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 08:07:19.934024 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:19.934010    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert podName:a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca nodeName:}" failed. No retries permitted until 2026-07-12 08:07:20.433991547 +0000 UTC m=+37.216991877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l8zwc" (UID: "a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca") : secret "networking-console-plugin-cert" not found
Jul 12 08:07:19.934568 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.934544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-nginx-conf\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:19.936104 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.936077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.936353 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.936335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3e80c24-675f-4c82-9dd4-45a2f5561f85-cert\") pod \"ingress-canary-mx7lg\" (UID: \"d3e80c24-675f-4c82-9dd4-45a2f5561f85\") " pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.941390 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.941366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs"
Jul 12 08:07:19.944807 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.944760    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgxbs\" (UniqueName: \"kubernetes.io/projected/7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3-kube-api-access-zgxbs\") pod \"service-ca-operator-7695fc6c8c-l5vxj\" (UID: \"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:19.945174 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.945151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mgts\" (UniqueName: \"kubernetes.io/projected/fdfadeba-25a9-4221-a4a0-02a0a0ba559f-kube-api-access-7mgts\") pod \"network-check-source-869dcfcdcd-hp7j6\" (UID: \"fdfadeba-25a9-4221-a4a0-02a0a0ba559f\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"
Jul 12 08:07:19.949972 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.949951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dv4g\" (UniqueName: \"kubernetes.io/projected/d3e80c24-675f-4c82-9dd4-45a2f5561f85-kube-api-access-2dv4g\") pod \"ingress-canary-mx7lg\" (UID: \"d3e80c24-675f-4c82-9dd4-45a2f5561f85\") " pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.966068 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.966038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"
Jul 12 08:07:19.981000 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.980969    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mx7lg"
Jul 12 08:07:19.999437 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:19.999399    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:20.008542 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.008461    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"
Jul 12 08:07:20.017043 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.016664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"
Jul 12 08:07:20.158744 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.158634    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7"]
Jul 12 08:07:20.176755 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.172131    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-kflgs"]
Jul 12 08:07:20.247266 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.244980    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m"]
Jul 12 08:07:20.271782 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.271747    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mx7lg"]
Jul 12 08:07:20.275605 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.275445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-x42kf"]
Jul 12 08:07:20.276550 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:20.276528    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e80c24_675f_4c82_9dd4_45a2f5561f85.slice/crio-0320fcf437c7bf5b2f748928f1c294b80d54ef92b2fed2038c84df6ec4f5bd32 WatchSource:0}: Error finding container 0320fcf437c7bf5b2f748928f1c294b80d54ef92b2fed2038c84df6ec4f5bd32: Status 404 returned error can't find the container with id 0320fcf437c7bf5b2f748928f1c294b80d54ef92b2fed2038c84df6ec4f5bd32
Jul 12 08:07:20.277759 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:20.277740    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0ebd2e_d226_485e_aea7_5e39cd02104f.slice/crio-998d065e3716f2513aea53688e86d275bff3da2c2e02338a44520c23930daea3 WatchSource:0}: Error finding container 998d065e3716f2513aea53688e86d275bff3da2c2e02338a44520c23930daea3: Status 404 returned error can't find the container with id 998d065e3716f2513aea53688e86d275bff3da2c2e02338a44520c23930daea3
Jul 12 08:07:20.284041 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.284017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj"]
Jul 12 08:07:20.287361 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.287328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6"]
Jul 12 08:07:20.290539 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:20.290512    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4ffdcf_04fc_43cd_9296_eca6ef7f41a3.slice/crio-afe56bd942387cdba9b839a6ed2f54f544aee3a24ad122651e5595fecb09174a WatchSource:0}: Error finding container afe56bd942387cdba9b839a6ed2f54f544aee3a24ad122651e5595fecb09174a: Status 404 returned error can't find the container with id afe56bd942387cdba9b839a6ed2f54f544aee3a24ad122651e5595fecb09174a
Jul 12 08:07:20.291724 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:20.291694    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfadeba_25a9_4221_a4a0_02a0a0ba559f.slice/crio-edbc8ddbb091bdf6931acaaec2f004c73c849a67fbe43191d8afd3ed718229d1 WatchSource:0}: Error finding container edbc8ddbb091bdf6931acaaec2f004c73c849a67fbe43191d8afd3ed718229d1: Status 404 returned error can't find the container with id edbc8ddbb091bdf6931acaaec2f004c73c849a67fbe43191d8afd3ed718229d1
Jul 12 08:07:20.337650 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.337566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:20.337650 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.337620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337718    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337724    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.337748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337772    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls podName:8cb1f0a8-8440-45f6-9f00-ac7624c693d7 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.337755992 +0000 UTC m=+38.120756336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls") pod "dns-default-qnlwb" (UID: "8cb1f0a8-8440-45f6-9f00-ac7624c693d7") : secret "dns-default-metrics-tls" not found
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337789    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls podName:0b5f887b-f46f-423c-bc98-ef1857715bb5 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.337783331 +0000 UTC m=+38.120783653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-trcrn" (UID: "0b5f887b-f46f-423c-bc98-ef1857715bb5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337820    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.337834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:20.337866 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337862    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.337849443 +0000 UTC m=+38.120849764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : secret "router-metrics-certs-default" not found
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337895    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.337898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337927    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls podName:a1bcbbfd-a0c2-478c-8eca-393cef50e520 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.337917607 +0000 UTC m=+38.120917972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls") pod "cluster-samples-operator-65db858894-g6g4q" (UID: "a1bcbbfd-a0c2-478c-8eca-393cef50e520") : secret "samples-operator-tls" not found
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.337940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337954    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337962    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67564454dd-krx2r: secret "image-registry-tls" not found
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.337993    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls podName:67537171-dbd5-41c1-b8a1-fd5193dedbe2 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.337983815 +0000 UTC m=+38.120984139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls") pod "image-registry-67564454dd-krx2r" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2") : secret "image-registry-tls" not found
Jul 12 08:07:20.338220 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.338037    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.338027624 +0000 UTC m=+38.121027946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : configmap references non-existent config key: service-ca.crt
Jul 12 08:07:20.439052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:20.439005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:20.439243 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.439155    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 08:07:20.439243 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:20.439221    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert podName:a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca nodeName:}" failed. No retries permitted until 2026-07-12 08:07:21.439204534 +0000 UTC m=+38.222204871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l8zwc" (UID: "a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca") : secret "networking-console-plugin-cert" not found
Jul 12 08:07:21.089114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.089068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mx7lg" event={"ID":"d3e80c24-675f-4c82-9dd4-45a2f5561f85","Type":"ContainerStarted","Data":"0320fcf437c7bf5b2f748928f1c294b80d54ef92b2fed2038c84df6ec4f5bd32"}
Jul 12 08:07:21.090331 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.090253    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6" event={"ID":"fdfadeba-25a9-4221-a4a0-02a0a0ba559f","Type":"ContainerStarted","Data":"edbc8ddbb091bdf6931acaaec2f004c73c849a67fbe43191d8afd3ed718229d1"}
Jul 12 08:07:21.091597 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.091569    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj" event={"ID":"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3","Type":"ContainerStarted","Data":"afe56bd942387cdba9b839a6ed2f54f544aee3a24ad122651e5595fecb09174a"}
Jul 12 08:07:21.092851 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.092825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs" event={"ID":"33dc61bb-6dbf-44a8-a793-5882af9def06","Type":"ContainerStarted","Data":"14465cc059ddc2eda75282f7889f52a7e4dff55057659bc273cfbd624db67253"}
Jul 12 08:07:21.094154 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.094094    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7" event={"ID":"8215fe18-bcb5-4887-b124-3ea8f81e5e96","Type":"ContainerStarted","Data":"65bf47c3b0832f0cd9f23deb513fd1820e77008059d3219344e596e67f9605cc"}
Jul 12 08:07:21.095327 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.095299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x42kf" event={"ID":"be0ebd2e-d226-485e-aea7-5e39cd02104f","Type":"ContainerStarted","Data":"998d065e3716f2513aea53688e86d275bff3da2c2e02338a44520c23930daea3"}
Jul 12 08:07:21.096362 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.096339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m" event={"ID":"3003ddb7-f5e4-47c9-9493-181850171749","Type":"ContainerStarted","Data":"132851df2505e43825230b2c8ca79a08655e4956da63dda67dbb1acad8fedf65"}
Jul 12 08:07:21.349577 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.349493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:21.349577 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.349555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.349584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.349654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349675    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.349693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.349711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349726    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349740    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67564454dd-krx2r: secret "image-registry-tls" not found
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349751    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls podName:a1bcbbfd-a0c2-478c-8eca-393cef50e520 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.349731218 +0000 UTC m=+40.132731553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls") pod "cluster-samples-operator-65db858894-g6g4q" (UID: "a1bcbbfd-a0c2-478c-8eca-393cef50e520") : secret "samples-operator-tls" not found
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349784    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls podName:67537171-dbd5-41c1-b8a1-fd5193dedbe2 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.349772477 +0000 UTC m=+40.132772802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls") pod "image-registry-67564454dd-krx2r" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2") : secret "image-registry-tls" not found
Jul 12 08:07:21.349810 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349806    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 08:07:21.350225 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349833    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:21.350225 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349846    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.349833361 +0000 UTC m=+40.132833695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : secret "router-metrics-certs-default" not found
Jul 12 08:07:21.350225 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349866    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls podName:0b5f887b-f46f-423c-bc98-ef1857715bb5 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.349857543 +0000 UTC m=+40.132857866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-trcrn" (UID: "0b5f887b-f46f-423c-bc98-ef1857715bb5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:21.350225 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349893    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 08:07:21.350225 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349913    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls podName:8cb1f0a8-8440-45f6-9f00-ac7624c693d7 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.349906832 +0000 UTC m=+40.132907158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls") pod "dns-default-qnlwb" (UID: "8cb1f0a8-8440-45f6-9f00-ac7624c693d7") : secret "dns-default-metrics-tls" not found
Jul 12 08:07:21.350225 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.349927    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.349917473 +0000 UTC m=+40.132917811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : configmap references non-existent config key: service-ca.crt
Jul 12 08:07:21.450975 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:21.450929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:21.451134 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.451084    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 08:07:21.451203 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:21.451159    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert podName:a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca nodeName:}" failed. No retries permitted until 2026-07-12 08:07:23.451137308 +0000 UTC m=+40.234137636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l8zwc" (UID: "a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca") : secret "networking-console-plugin-cert" not found
Jul 12 08:07:22.102163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:22.101995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerStarted","Data":"16a424e73b4ed6ec95769d1f2dc3c065bf06b3be75b8c208a8c7480bcd724571"}
Jul 12 08:07:23.114607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.113458    2558 generic.go:356] "Generic (PLEG): container finished" podID="25a2e3c4-3dbd-415f-bd66-1c3b96adfba4" containerID="16a424e73b4ed6ec95769d1f2dc3c065bf06b3be75b8c208a8c7480bcd724571" exitCode=0
Jul 12 08:07:23.114607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.113513    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerDied","Data":"16a424e73b4ed6ec95769d1f2dc3c065bf06b3be75b8c208a8c7480bcd724571"}
Jul 12 08:07:23.371642 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.371559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:23.371642 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.371623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:23.371881 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.371648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:23.371881 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371726    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 08:07:23.371881 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371802    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls podName:a1bcbbfd-a0c2-478c-8eca-393cef50e520 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.371780053 +0000 UTC m=+44.154780375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls") pod "cluster-samples-operator-65db858894-g6g4q" (UID: "a1bcbbfd-a0c2-478c-8eca-393cef50e520") : secret "samples-operator-tls" not found
Jul 12 08:07:23.371881 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371813    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:23.371881 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371866    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls podName:0b5f887b-f46f-423c-bc98-ef1857715bb5 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.371850677 +0000 UTC m=+44.154851022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-trcrn" (UID: "0b5f887b-f46f-423c-bc98-ef1857715bb5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:23.371881 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371884    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371896    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67564454dd-krx2r: secret "image-registry-tls" not found
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.371732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371933    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls podName:67537171-dbd5-41c1-b8a1-fd5193dedbe2 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.371921816 +0000 UTC m=+44.154922144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls") pod "image-registry-67564454dd-krx2r" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2") : secret "image-registry-tls" not found
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.371962    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.371951635 +0000 UTC m=+44.154951962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : configmap references non-existent config key: service-ca.crt
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.372017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.372046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.372144    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.372182    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.372170527 +0000 UTC m=+44.155170851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : secret "router-metrics-certs-default" not found
Jul 12 08:07:23.372239 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.372237    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 08:07:23.372746 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.372266    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls podName:8cb1f0a8-8440-45f6-9f00-ac7624c693d7 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.37225622 +0000 UTC m=+44.155256548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls") pod "dns-default-qnlwb" (UID: "8cb1f0a8-8440-45f6-9f00-ac7624c693d7") : secret "dns-default-metrics-tls" not found
Jul 12 08:07:23.472729 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:23.472596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:23.473407 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.472893    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 08:07:23.473407 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:23.472969    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert podName:a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca nodeName:}" failed. No retries permitted until 2026-07-12 08:07:27.472948657 +0000 UTC m=+44.255948987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l8zwc" (UID: "a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca") : secret "networking-console-plugin-cert" not found
Jul 12 08:07:24.121995 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:24.121948    2558 generic.go:356] "Generic (PLEG): container finished" podID="25a2e3c4-3dbd-415f-bd66-1c3b96adfba4" containerID="932192c03a607e5126ec5f79c570fdb102e895228632b5f32ec74dcc93cc3afd" exitCode=0
Jul 12 08:07:24.122749 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:24.122085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerDied","Data":"932192c03a607e5126ec5f79c570fdb102e895228632b5f32ec74dcc93cc3afd"}
Jul 12 08:07:24.126231 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:24.125633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7" event={"ID":"8215fe18-bcb5-4887-b124-3ea8f81e5e96","Type":"ContainerStarted","Data":"88aa7c80ff86a39ba4252d4ee382bc38412506e61dcd0afd08fa45e9eb4b4ee8"}
Jul 12 08:07:24.161475 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:24.161011    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wjsd7" podStartSLOduration=8.72422053 podStartE2EDuration="12.160990836s" totalImagesPullingTime="3.436770306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:24.160684795 +0000 UTC m=+40.943685139" watchObservedRunningTime="2026-07-12 08:07:24.160990836 +0000 UTC m=+40.943991182"
Jul 12 08:07:27.412821 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.412782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.412843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.412870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.412925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.412940    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.412965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.412990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413005    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413008    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls podName:0b5f887b-f46f-423c-bc98-ef1857715bb5 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.412988001 +0000 UTC m=+52.195988336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-trcrn" (UID: "0b5f887b-f46f-423c-bc98-ef1857715bb5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413072    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413075    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413097    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67564454dd-krx2r: secret "image-registry-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413006    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413075    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls podName:8cb1f0a8-8440-45f6-9f00-ac7624c693d7 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.413061567 +0000 UTC m=+52.196061890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls") pod "dns-default-qnlwb" (UID: "8cb1f0a8-8440-45f6-9f00-ac7624c693d7") : secret "dns-default-metrics-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413145    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.413128945 +0000 UTC m=+52.196129271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : configmap references non-existent config key: service-ca.crt
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413162    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls podName:a1bcbbfd-a0c2-478c-8eca-393cef50e520 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.413152265 +0000 UTC m=+52.196152588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls") pod "cluster-samples-operator-65db858894-g6g4q" (UID: "a1bcbbfd-a0c2-478c-8eca-393cef50e520") : secret "samples-operator-tls" not found
Jul 12 08:07:27.413260 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413181    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls podName:67537171-dbd5-41c1-b8a1-fd5193dedbe2 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.413174305 +0000 UTC m=+52.196174627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls") pod "image-registry-67564454dd-krx2r" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2") : secret "image-registry-tls" not found
Jul 12 08:07:27.413967 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.413199    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.413190989 +0000 UTC m=+52.196191311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : secret "router-metrics-certs-default" not found
Jul 12 08:07:27.513989 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:27.513940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:27.514181 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.514092    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 08:07:27.514181 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:27.514166    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert podName:a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.514148645 +0000 UTC m=+52.297149154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l8zwc" (UID: "a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca") : secret "networking-console-plugin-cert" not found
Jul 12 08:07:30.146436 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.146299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" event={"ID":"25a2e3c4-3dbd-415f-bd66-1c3b96adfba4","Type":"ContainerStarted","Data":"2e5a0bf770bf950cbfb9642636c74b5ae42d22a0baffe57034f71f4063202ba5"}
Jul 12 08:07:30.148121 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.148061    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mx7lg" event={"ID":"d3e80c24-675f-4c82-9dd4-45a2f5561f85","Type":"ContainerStarted","Data":"4b3406257d89a4ccfba0673440e12a52b1697bb9af9f603d9584a415b6a7487a"}
Jul 12 08:07:30.150071 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.150048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6" event={"ID":"fdfadeba-25a9-4221-a4a0-02a0a0ba559f","Type":"ContainerStarted","Data":"71f2103abc8d5bf4cb557ac0f7a66c7335ccab2f4e7e36b52d7d2f2402d244d0"}
Jul 12 08:07:30.153461 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.153438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj" event={"ID":"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3","Type":"ContainerStarted","Data":"cc697905c3e104faca9e32dc4e317f8704fceb798e306bc3257e6478088e2fe9"}
Jul 12 08:07:30.155526 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.155492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs" event={"ID":"33dc61bb-6dbf-44a8-a793-5882af9def06","Type":"ContainerStarted","Data":"8a8be0fee671c4df40bb4ed7276dfec9cfdba887121f5dce2d001c62f90b9208"}
Jul 12 08:07:30.157314 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.157269    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/0.log"
Jul 12 08:07:30.157422 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.157334    2558 generic.go:356] "Generic (PLEG): container finished" podID="be0ebd2e-d226-485e-aea7-5e39cd02104f" containerID="4bd75940ef713a7445d4d312f1ad6a7e517ed16038944a4c769a1e05cb1e62b1" exitCode=255
Jul 12 08:07:30.157422 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.157406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x42kf" event={"ID":"be0ebd2e-d226-485e-aea7-5e39cd02104f","Type":"ContainerDied","Data":"4bd75940ef713a7445d4d312f1ad6a7e517ed16038944a4c769a1e05cb1e62b1"}
Jul 12 08:07:30.157582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.157565    2558 scope.go:117] "RemoveContainer" containerID="4bd75940ef713a7445d4d312f1ad6a7e517ed16038944a4c769a1e05cb1e62b1"
Jul 12 08:07:30.159851 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.159812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m" event={"ID":"3003ddb7-f5e4-47c9-9493-181850171749","Type":"ContainerStarted","Data":"4283a40259ee030ee8651c746d1f002a5d4eb3344039664e1f1f27eeea5c3961"}
Jul 12 08:07:30.168314 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.168252    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zxhsp" podStartSLOduration=13.599883788 podStartE2EDuration="45.168236376s" totalImagesPullingTime="31.568352588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:30.166633154 +0000 UTC m=+46.949633502" watchObservedRunningTime="2026-07-12 08:07:30.168236376 +0000 UTC m=+46.951236726"
Jul 12 08:07:30.182307 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.182235    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs" podStartSLOduration=8.660049484 podStartE2EDuration="18.182213465s" totalImagesPullingTime="9.522163981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:30.181130228 +0000 UTC m=+46.964130573" watchObservedRunningTime="2026-07-12 08:07:30.182213465 +0000 UTC m=+46.965213810"
Jul 12 08:07:30.241182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.241120    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mx7lg" podStartSLOduration=1.805058534 podStartE2EDuration="11.241099269s" totalImagesPullingTime="9.436040735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:30.219680498 +0000 UTC m=+47.002680845" watchObservedRunningTime="2026-07-12 08:07:30.241099269 +0000 UTC m=+47.024099615"
Jul 12 08:07:30.242127 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.242085    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-hp7j6" podStartSLOduration=7.829172476 podStartE2EDuration="17.242076385s" totalImagesPullingTime="9.412903909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:30.237592001 +0000 UTC m=+47.020592344" watchObservedRunningTime="2026-07-12 08:07:30.242076385 +0000 UTC m=+47.025076758"
Jul 12 08:07:30.272991 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.271820    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj" podStartSLOduration=7.858436433 podStartE2EDuration="17.271799899s" totalImagesPullingTime="9.413363466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:30.253418264 +0000 UTC m=+47.036418588" watchObservedRunningTime="2026-07-12 08:07:30.271799899 +0000 UTC m=+47.054800246"
Jul 12 08:07:30.272991 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:30.272042    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m" podStartSLOduration=8.814760802 podStartE2EDuration="18.272034592s" totalImagesPullingTime="9.45727379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:30.271002964 +0000 UTC m=+47.054003309" watchObservedRunningTime="2026-07-12 08:07:30.272034592 +0000 UTC m=+47.055034938"
Jul 12 08:07:31.167816 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.167789    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:07:31.168310 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.168265    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/0.log"
Jul 12 08:07:31.168382 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.168336    2558 generic.go:356] "Generic (PLEG): container finished" podID="be0ebd2e-d226-485e-aea7-5e39cd02104f" containerID="95a54c73134e8bf1ac167aac893a2a006bce134f50c9573dd575aea5d8bb6fb2" exitCode=255
Jul 12 08:07:31.168482 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.168446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x42kf" event={"ID":"be0ebd2e-d226-485e-aea7-5e39cd02104f","Type":"ContainerDied","Data":"95a54c73134e8bf1ac167aac893a2a006bce134f50c9573dd575aea5d8bb6fb2"}
Jul 12 08:07:31.168597 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.168547    2558 scope.go:117] "RemoveContainer" containerID="4bd75940ef713a7445d4d312f1ad6a7e517ed16038944a4c769a1e05cb1e62b1"
Jul 12 08:07:31.168696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.168680    2558 scope.go:117] "RemoveContainer" containerID="95a54c73134e8bf1ac167aac893a2a006bce134f50c9573dd575aea5d8bb6fb2"
Jul 12 08:07:31.168884 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.168861    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-x42kf_openshift-console-operator(be0ebd2e-d226-485e-aea7-5e39cd02104f)\"" pod="openshift-console-operator/console-operator-7866497494-x42kf" podUID="be0ebd2e-d226-485e-aea7-5e39cd02104f"
Jul 12 08:07:31.217400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.217368    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7npxg"]
Jul 12 08:07:31.250711 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.250672    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.251610 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.251579    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7npxg"]
Jul 12 08:07:31.253042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.253023    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmv4g\""
Jul 12 08:07:31.253393 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.253368    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 08:07:31.253520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.253303    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 08:07:31.350036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.349999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kn9g\" (UniqueName: \"kubernetes.io/projected/391fb1b0-580e-490d-9968-92b46c392c05-kube-api-access-7kn9g\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.350184 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.350068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/391fb1b0-580e-490d-9968-92b46c392c05-data-volume\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.350184 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.350090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.350285 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.350181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/391fb1b0-580e-490d-9968-92b46c392c05-crio-socket\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.350285 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.350241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.451689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.451607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/391fb1b0-580e-490d-9968-92b46c392c05-crio-socket\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.451842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.451696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.451842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.451750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn9g\" (UniqueName: \"kubernetes.io/projected/391fb1b0-580e-490d-9968-92b46c392c05-kube-api-access-7kn9g\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.451842 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.451770    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 08:07:31.451842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.451801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/391fb1b0-580e-490d-9968-92b46c392c05-data-volume\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.451842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.451828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/391fb1b0-580e-490d-9968-92b46c392c05-crio-socket\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.452077 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.451857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.452077 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.451960    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:31.951936962 +0000 UTC m=+48.734937295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : configmap "kube-rbac-proxy" not found
Jul 12 08:07:31.452077 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.451962    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:31.452077 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.452017    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:31.952001646 +0000 UTC m=+48.735001990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:31.452293 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.452263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/391fb1b0-580e-490d-9968-92b46c392c05-data-volume\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.463666 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.463628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kn9g\" (UniqueName: \"kubernetes.io/projected/391fb1b0-580e-490d-9968-92b46c392c05-kube-api-access-7kn9g\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.956614 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.956566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.956834 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:31.956659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:31.956834 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.956701    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 08:07:31.956834 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.956787    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:32.956767046 +0000 UTC m=+49.739767368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : configmap "kube-rbac-proxy" not found
Jul 12 08:07:31.956834 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.956805    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:31.957044 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:31.956850    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:32.956838417 +0000 UTC m=+49.739838740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:32.173788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:32.173758    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:07:32.174240 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:32.174072    2558 scope.go:117] "RemoveContainer" containerID="95a54c73134e8bf1ac167aac893a2a006bce134f50c9573dd575aea5d8bb6fb2"
Jul 12 08:07:32.174240 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:32.174224    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-x42kf_openshift-console-operator(be0ebd2e-d226-485e-aea7-5e39cd02104f)\"" pod="openshift-console-operator/console-operator-7866497494-x42kf" podUID="be0ebd2e-d226-485e-aea7-5e39cd02104f"
Jul 12 08:07:32.966265 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:32.966207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:32.966489 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:32.966329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:32.966489 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:32.966351    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 08:07:32.966489 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:32.966428    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:34.966411939 +0000 UTC m=+51.749412286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : configmap "kube-rbac-proxy" not found
Jul 12 08:07:32.966671 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:32.966502    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:32.966671 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:32.966582    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:34.966564622 +0000 UTC m=+51.749564949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:33.022366 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:33.022323    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqm8v_3188ee17-e04d-4f46-be29-8cefefe19602/dns-node-resolver/0.log"
Jul 12 08:07:34.022410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:34.022380    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9mggq_85e5d712-8a13-4116-b27f-90ee36e4bcc3/node-ca/0.log"
Jul 12 08:07:34.984912 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:34.984868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:34.985121 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:34.984989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:34.985121 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:34.985045    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:34.985121 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:34.985079    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 08:07:34.985247 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:34.985127    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:38.985113139 +0000 UTC m=+55.768113461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : configmap "kube-rbac-proxy" not found
Jul 12 08:07:34.985247 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:34.985140    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:38.985133767 +0000 UTC m=+55.768134089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:35.022038 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.022012    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx7lg_d3e80c24-675f-4c82-9dd4-45a2f5561f85/serve-healthcheck-canary/0.log"
Jul 12 08:07:35.489896 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.489852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:35.489896 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.489895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490017    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.490004555 +0000 UTC m=+68.273004877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : configmap references non-existent config key: service-ca.crt
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490031    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490055    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67564454dd-krx2r: secret "image-registry-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.490105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490115    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls podName:67537171-dbd5-41c1-b8a1-fd5193dedbe2 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.490097776 +0000 UTC m=+68.273098112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls") pod "image-registry-67564454dd-krx2r" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2") : secret "image-registry-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.490177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.490205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490225    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.490295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490306    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls podName:0b5f887b-f46f-423c-bc98-ef1857715bb5 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.490267244 +0000 UTC m=+68.273267566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-trcrn" (UID: "0b5f887b-f46f-423c-bc98-ef1857715bb5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490347    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490350    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490367    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490381    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs podName:4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.490371905 +0000 UTC m=+68.273372226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs") pod "router-default-6bc544f466-pw5ml" (UID: "4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357") : secret "router-metrics-certs-default" not found
Jul 12 08:07:35.490438 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490397    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls podName:8cb1f0a8-8440-45f6-9f00-ac7624c693d7 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.490385663 +0000 UTC m=+68.273386005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls") pod "dns-default-qnlwb" (UID: "8cb1f0a8-8440-45f6-9f00-ac7624c693d7") : secret "dns-default-metrics-tls" not found
Jul 12 08:07:35.490898 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.490418    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls podName:a1bcbbfd-a0c2-478c-8eca-393cef50e520 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.490406841 +0000 UTC m=+68.273407163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls") pod "cluster-samples-operator-65db858894-g6g4q" (UID: "a1bcbbfd-a0c2-478c-8eca-393cef50e520") : secret "samples-operator-tls" not found
Jul 12 08:07:35.590654 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:35.590613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:35.590834 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.590753    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 12 08:07:35.590834 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:35.590815    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert podName:a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca nodeName:}" failed. No retries permitted until 2026-07-12 08:07:51.590799741 +0000 UTC m=+68.373800063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-l8zwc" (UID: "a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca") : secret "networking-console-plugin-cert" not found
Jul 12 08:07:39.022142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:39.022090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:39.022762 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:39.022206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:39.022762 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:39.022371    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:39.022762 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:39.022437    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls podName:391fb1b0-580e-490d-9968-92b46c392c05 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:47.022421417 +0000 UTC m=+63.805421739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7npxg" (UID: "391fb1b0-580e-490d-9968-92b46c392c05") : secret "insights-runtime-extractor-tls" not found
Jul 12 08:07:39.022762 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:39.022671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/391fb1b0-580e-490d-9968-92b46c392c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:39.999954 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:39.999904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:39.999954 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:39.999975    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:40.000352 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:40.000338    2558 scope.go:117] "RemoveContainer" containerID="95a54c73134e8bf1ac167aac893a2a006bce134f50c9573dd575aea5d8bb6fb2"
Jul 12 08:07:40.000520 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:40.000487    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-x42kf_openshift-console-operator(be0ebd2e-d226-485e-aea7-5e39cd02104f)\"" pod="openshift-console-operator/console-operator-7866497494-x42kf" podUID="be0ebd2e-d226-485e-aea7-5e39cd02104f"
Jul 12 08:07:45.088287 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:45.088248    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdd7m"
Jul 12 08:07:47.101224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:47.101176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:47.103607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:47.103576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/391fb1b0-580e-490d-9968-92b46c392c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7npxg\" (UID: \"391fb1b0-580e-490d-9968-92b46c392c05\") " pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:47.165012 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:47.164984    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmv4g\""
Jul 12 08:07:47.173842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:47.173806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7npxg"
Jul 12 08:07:47.300927 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:47.300890    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7npxg"]
Jul 12 08:07:47.303944 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:47.303919    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391fb1b0_580e_490d_9968_92b46c392c05.slice/crio-d1b238f8eee58e2820df0de4df8728b912d59cefe39892dcfeb48962f6f8f695 WatchSource:0}: Error finding container d1b238f8eee58e2820df0de4df8728b912d59cefe39892dcfeb48962f6f8f695: Status 404 returned error can't find the container with id d1b238f8eee58e2820df0de4df8728b912d59cefe39892dcfeb48962f6f8f695
Jul 12 08:07:48.224523 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:48.224429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7npxg" event={"ID":"391fb1b0-580e-490d-9968-92b46c392c05","Type":"ContainerStarted","Data":"d1b238f8eee58e2820df0de4df8728b912d59cefe39892dcfeb48962f6f8f695"}
Jul 12 08:07:49.524058 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.524002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:49.524510 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.524160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:49.526429 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.526395    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 08:07:49.527238 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.527216    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 08:07:49.537698 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.537667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43681a57-c89a-4a78-be3e-d4193f14f14a-original-pull-secret\") pod \"global-pull-secret-syncer-r6jrm\" (UID: \"43681a57-c89a-4a78-be3e-d4193f14f14a\") " pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:49.537807 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.537717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46-metrics-certs\") pod \"network-metrics-daemon-bvx29\" (UID: \"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46\") " pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:49.625344 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.625247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:49.628456 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.628427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9rf\" (UniqueName: \"kubernetes.io/projected/8109fe9c-461d-45d5-99d9-39c632d05dbb-kube-api-access-qq9rf\") pod \"network-check-target-wrdms\" (UID: \"8109fe9c-461d-45d5-99d9-39c632d05dbb\") " pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:49.761964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.761931    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xxbfq\""
Jul 12 08:07:49.766865 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.766827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r6jrm"
Jul 12 08:07:49.770946 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.770916    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:49.774195 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.774117    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rkfrj\""
Jul 12 08:07:49.782993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:49.782957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvx29"
Jul 12 08:07:51.260843 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.260804    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r6jrm"]
Jul 12 08:07:51.266390 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:51.266361    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43681a57_c89a_4a78_be3e_d4193f14f14a.slice/crio-1e5e3a54204e726f3e804a63b57ddf17d2001be62a44d098a62371c0afd434dd WatchSource:0}: Error finding container 1e5e3a54204e726f3e804a63b57ddf17d2001be62a44d098a62371c0afd434dd: Status 404 returned error can't find the container with id 1e5e3a54204e726f3e804a63b57ddf17d2001be62a44d098a62371c0afd434dd
Jul 12 08:07:51.486091 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.486066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrdms"]
Jul 12 08:07:51.488626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.488600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bvx29"]
Jul 12 08:07:51.489060 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:51.488915    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8109fe9c_461d_45d5_99d9_39c632d05dbb.slice/crio-b29f75c54147f4033f2982033e228242fcafed8a82c6d1f6ac7180b3e9efb811 WatchSource:0}: Error finding container b29f75c54147f4033f2982033e228242fcafed8a82c6d1f6ac7180b3e9efb811: Status 404 returned error can't find the container with id b29f75c54147f4033f2982033e228242fcafed8a82c6d1f6ac7180b3e9efb811
Jul 12 08:07:51.491367 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:51.491345    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cb95ab_0dbe_4f5f_9a85_5d89fccc6a46.slice/crio-633ccedaf48725d2ddddb186ab1f9545edb891e71473ab2c3c36ed327a0b2622 WatchSource:0}: Error finding container 633ccedaf48725d2ddddb186ab1f9545edb891e71473ab2c3c36ed327a0b2622: Status 404 returned error can't find the container with id 633ccedaf48725d2ddddb186ab1f9545edb891e71473ab2c3c36ed327a0b2622
Jul 12 08:07:51.543811 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.543744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:51.543811 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.543776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:51.543941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.543821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:51.543941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.543847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:51.543941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.543864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:51.543941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.543905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:51.544792 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.544764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-service-ca-bundle\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:51.546405 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.546385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8cb1f0a8-8440-45f6-9f00-ac7624c693d7-metrics-tls\") pod \"dns-default-qnlwb\" (UID: \"8cb1f0a8-8440-45f6-9f00-ac7624c693d7\") " pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:51.546656 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.546632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"image-registry-67564454dd-krx2r\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") " pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:51.546875 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.546856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1bcbbfd-a0c2-478c-8eca-393cef50e520-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g6g4q\" (UID: \"a1bcbbfd-a0c2-478c-8eca-393cef50e520\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:51.547004 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.546986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b5f887b-f46f-423c-bc98-ef1857715bb5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-trcrn\" (UID: \"0b5f887b-f46f-423c-bc98-ef1857715bb5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:51.547078 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.547057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357-metrics-certs\") pod \"router-default-6bc544f466-pw5ml\" (UID: \"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357\") " pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:51.645404 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.645365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:51.647933 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.647911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-l8zwc\" (UID: \"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:51.717311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.717262    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vj6z7\""
Jul 12 08:07:51.725151 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.725123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:51.755619 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.753228    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8bm57\""
Jul 12 08:07:51.761316 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.761065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:51.775371 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.775345    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lhqtd\""
Jul 12 08:07:51.783566 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.783105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:51.788608 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.788414    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-djfpv\""
Jul 12 08:07:51.796944 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.796921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"
Jul 12 08:07:51.797795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.797776    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s2jp6\""
Jul 12 08:07:51.804721 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.804576    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"
Jul 12 08:07:51.814021 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.813806    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xp7t8\""
Jul 12 08:07:51.822219 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.822000    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"
Jul 12 08:07:51.906735 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:51.903843    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67564454dd-krx2r"]
Jul 12 08:07:52.003615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.000873    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bc544f466-pw5ml"]
Jul 12 08:07:52.020597 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.019972    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn"]
Jul 12 08:07:52.031538 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.031505    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qnlwb"]
Jul 12 08:07:52.050728 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.050698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q"]
Jul 12 08:07:52.117700 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:52.117653    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9809bc_4b01_4cbe_8c43_ae4e0a3cf357.slice/crio-bf73e3719b10f91770493617fdd0e849f54757d979bca3db16150d65f101b95f WatchSource:0}: Error finding container bf73e3719b10f91770493617fdd0e849f54757d979bca3db16150d65f101b95f: Status 404 returned error can't find the container with id bf73e3719b10f91770493617fdd0e849f54757d979bca3db16150d65f101b95f
Jul 12 08:07:52.119247 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:52.119218    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5f887b_f46f_423c_bc98_ef1857715bb5.slice/crio-68f51f67acd0ba149d54e1afbecedd23378a54ba433d2bdf833ac87cb1ff7f56 WatchSource:0}: Error finding container 68f51f67acd0ba149d54e1afbecedd23378a54ba433d2bdf833ac87cb1ff7f56: Status 404 returned error can't find the container with id 68f51f67acd0ba149d54e1afbecedd23378a54ba433d2bdf833ac87cb1ff7f56
Jul 12 08:07:52.120120 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:52.120092    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67537171_dbd5_41c1_b8a1_fd5193dedbe2.slice/crio-5d5397c059c91dabc9eb6384f5e3607ee280cda50b24ccc38d88892038c9b732 WatchSource:0}: Error finding container 5d5397c059c91dabc9eb6384f5e3607ee280cda50b24ccc38d88892038c9b732: Status 404 returned error can't find the container with id 5d5397c059c91dabc9eb6384f5e3607ee280cda50b24ccc38d88892038c9b732
Jul 12 08:07:52.121159 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:52.121131    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb1f0a8_8440_45f6_9f00_ac7624c693d7.slice/crio-d8cf977d618f84449c161341f1ec3b05d4ca8cf27b233bc0b51e2b0a90a2a149 WatchSource:0}: Error finding container d8cf977d618f84449c161341f1ec3b05d4ca8cf27b233bc0b51e2b0a90a2a149: Status 404 returned error can't find the container with id d8cf977d618f84449c161341f1ec3b05d4ca8cf27b233bc0b51e2b0a90a2a149
Jul 12 08:07:52.242212 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.242184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67564454dd-krx2r" event={"ID":"67537171-dbd5-41c1-b8a1-fd5193dedbe2","Type":"ContainerStarted","Data":"5d5397c059c91dabc9eb6384f5e3607ee280cda50b24ccc38d88892038c9b732"}
Jul 12 08:07:52.244219 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.244189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrdms" event={"ID":"8109fe9c-461d-45d5-99d9-39c632d05dbb","Type":"ContainerStarted","Data":"eebc5f1bcc9fc9117a8956c3657c2c062ec5ff66317aef99ba5b322c00ce19ea"}
Jul 12 08:07:52.244349 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.244246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrdms" event={"ID":"8109fe9c-461d-45d5-99d9-39c632d05dbb","Type":"ContainerStarted","Data":"b29f75c54147f4033f2982033e228242fcafed8a82c6d1f6ac7180b3e9efb811"}
Jul 12 08:07:52.244349 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.244316    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:07:52.245669 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.245640    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q" event={"ID":"a1bcbbfd-a0c2-478c-8eca-393cef50e520","Type":"ContainerStarted","Data":"b24248020518d263c468331565effc5021cb5812e7c1a69d8899c831696c436d"}
Jul 12 08:07:52.247394 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.247344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn" event={"ID":"0b5f887b-f46f-423c-bc98-ef1857715bb5","Type":"ContainerStarted","Data":"68f51f67acd0ba149d54e1afbecedd23378a54ba433d2bdf833ac87cb1ff7f56"}
Jul 12 08:07:52.248640 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.248617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnlwb" event={"ID":"8cb1f0a8-8440-45f6-9f00-ac7624c693d7","Type":"ContainerStarted","Data":"d8cf977d618f84449c161341f1ec3b05d4ca8cf27b233bc0b51e2b0a90a2a149"}
Jul 12 08:07:52.250331 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.250307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7npxg" event={"ID":"391fb1b0-580e-490d-9968-92b46c392c05","Type":"ContainerStarted","Data":"19dd945bc7996e8d7c02d3ca6b72c10e14f143d8e40a12ec48a7d12e0dafba30"}
Jul 12 08:07:52.251483 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.251459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bc544f466-pw5ml" event={"ID":"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357","Type":"ContainerStarted","Data":"bf73e3719b10f91770493617fdd0e849f54757d979bca3db16150d65f101b95f"}
Jul 12 08:07:52.252811 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.252774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvx29" event={"ID":"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46","Type":"ContainerStarted","Data":"633ccedaf48725d2ddddb186ab1f9545edb891e71473ab2c3c36ed327a0b2622"}
Jul 12 08:07:52.254044 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.254021    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r6jrm" event={"ID":"43681a57-c89a-4a78-be3e-d4193f14f14a","Type":"ContainerStarted","Data":"1e5e3a54204e726f3e804a63b57ddf17d2001be62a44d098a62371c0afd434dd"}
Jul 12 08:07:52.259711 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.259164    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrdms" podStartSLOduration=67.259128558 podStartE2EDuration="1m7.259128558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:52.259051056 +0000 UTC m=+69.042051400" watchObservedRunningTime="2026-07-12 08:07:52.259128558 +0000 UTC m=+69.042128880"
Jul 12 08:07:52.263632 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:52.262897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-l8zwc"]
Jul 12 08:07:52.266870 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:07:52.266828    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c2761b_44b7_40d6_a7a5_bfc5abadd3ca.slice/crio-fcf67668b3aef4982a61b533c70e38417251144d48e41de28cdd9457412152b5 WatchSource:0}: Error finding container fcf67668b3aef4982a61b533c70e38417251144d48e41de28cdd9457412152b5: Status 404 returned error can't find the container with id fcf67668b3aef4982a61b533c70e38417251144d48e41de28cdd9457412152b5
Jul 12 08:07:53.264338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.263705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67564454dd-krx2r" event={"ID":"67537171-dbd5-41c1-b8a1-fd5193dedbe2","Type":"ContainerStarted","Data":"b74017f37f54157f916ded4d050d4e42811d6f7be97fdb31bcae1036ce39cb9f"}
Jul 12 08:07:53.264338 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.264419    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:07:53.269894 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.269860    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc" event={"ID":"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca","Type":"ContainerStarted","Data":"fcf67668b3aef4982a61b533c70e38417251144d48e41de28cdd9457412152b5"}
Jul 12 08:07:53.275584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.275486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7npxg" event={"ID":"391fb1b0-580e-490d-9968-92b46c392c05","Type":"ContainerStarted","Data":"62960ba04f43a700b415681befa73784f85db3b8f51a69e8182f19981b38d307"}
Jul 12 08:07:53.282046 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.281536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bc544f466-pw5ml" event={"ID":"4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357","Type":"ContainerStarted","Data":"2cb128d73a3dc318dc1f8d72f8327f7ddb00fa80eeac29fd53200c26226c7170"}
Jul 12 08:07:53.284850 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.284684    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67564454dd-krx2r" podStartSLOduration=68.284663376 podStartE2EDuration="1m8.284663376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:53.283265094 +0000 UTC m=+70.066265438" watchObservedRunningTime="2026-07-12 08:07:53.284663376 +0000 UTC m=+70.067663721"
Jul 12 08:07:53.301574 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.301045    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bc544f466-pw5ml" podStartSLOduration=41.301025755 podStartE2EDuration="41.301025755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:53.299184128 +0000 UTC m=+70.082184473" watchObservedRunningTime="2026-07-12 08:07:53.301025755 +0000 UTC m=+70.084026102"
Jul 12 08:07:53.761827 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.761792    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:53.765020 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:53.764799    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:54.287528 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:54.287500    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:54.288853 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:54.288826    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bc544f466-pw5ml"
Jul 12 08:07:54.750796 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:54.750365    2558 scope.go:117] "RemoveContainer" containerID="95a54c73134e8bf1ac167aac893a2a006bce134f50c9573dd575aea5d8bb6fb2"
Jul 12 08:07:59.010220 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.010136    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"]
Jul 12 08:07:59.013363 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.013340    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:07:59.016702 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.016679    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 12 08:07:59.016831 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.016699    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-59x76\""
Jul 12 08:07:59.021978 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.021923    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"]
Jul 12 08:07:59.114309 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.114261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bvr8j\" (UID: \"7e19f4c5-0592-4af2-bab6-34a2e7a3e877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:07:59.215661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.215613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bvr8j\" (UID: \"7e19f4c5-0592-4af2-bab6-34a2e7a3e877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:07:59.215843 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:59.215777    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 12 08:07:59.215891 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:59.215848    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates podName:7e19f4c5-0592-4af2-bab6-34a2e7a3e877 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:59.715830319 +0000 UTC m=+76.498830642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-bvr8j" (UID: "7e19f4c5-0592-4af2-bab6-34a2e7a3e877") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 12 08:07:59.311440 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.311400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc" event={"ID":"a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca","Type":"ContainerStarted","Data":"76f816059971e113f1586c281286853fa59ca9c5fe93434810d020db8122e2fd"}
Jul 12 08:07:59.313205 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.313178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q" event={"ID":"a1bcbbfd-a0c2-478c-8eca-393cef50e520","Type":"ContainerStarted","Data":"b2a6444ee30d6897c873d30aa26fadf8063c50b1fccbf7db70db6d6ad6ab09d3"}
Jul 12 08:07:59.313358 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.313229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q" event={"ID":"a1bcbbfd-a0c2-478c-8eca-393cef50e520","Type":"ContainerStarted","Data":"5fedde411e5803489e64d702eed2e21631bd329217bd815cc083300e1b5f05b3"}
Jul 12 08:07:59.314832 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.314803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn" event={"ID":"0b5f887b-f46f-423c-bc98-ef1857715bb5","Type":"ContainerStarted","Data":"aa3538c4007ac72e848ae278d0153427fca65bc7775409edc05bea295bc5c83f"}
Jul 12 08:07:59.316707 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.316685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnlwb" event={"ID":"8cb1f0a8-8440-45f6-9f00-ac7624c693d7","Type":"ContainerStarted","Data":"ab873de32d42417da9715c3fd5ea8dd55b0e7b65b94a36f3dabc6d3d8199ccd6"}
Jul 12 08:07:59.316781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.316723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnlwb" event={"ID":"8cb1f0a8-8440-45f6-9f00-ac7624c693d7","Type":"ContainerStarted","Data":"1c6e075d67d075a52a3d32b2d4fe98b79005339e2c7d7f3d698144e4c84b83bb"}
Jul 12 08:07:59.316781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.316749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:07:59.318487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.318469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:07:59.318572 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.318553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x42kf" event={"ID":"be0ebd2e-d226-485e-aea7-5e39cd02104f","Type":"ContainerStarted","Data":"eb76faa4e1be5f5720ba67e7dd0ac5e12d35de2335bd461b1674daadb7bef7d2"}
Jul 12 08:07:59.318821 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.318799    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:59.320843 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.320821    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7npxg" event={"ID":"391fb1b0-580e-490d-9968-92b46c392c05","Type":"ContainerStarted","Data":"9225d0a011d00203ea967e8b4669da1117d0783c065ab2719ec7180d9a265429"}
Jul 12 08:07:59.322584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.322564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvx29" event={"ID":"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46","Type":"ContainerStarted","Data":"efa1dcc13a04c5483979361220fb9682571b196c781b0ee248d50d1c6c725b22"}
Jul 12 08:07:59.322667 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.322605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvx29" event={"ID":"50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46","Type":"ContainerStarted","Data":"1320545f48d78beda920add07e01f80ea3389b884e055c1115bec124c7e33622"}
Jul 12 08:07:59.324022 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.324003    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r6jrm" event={"ID":"43681a57-c89a-4a78-be3e-d4193f14f14a","Type":"ContainerStarted","Data":"53bfd7ec44afecb7decf9d5c2a68e7b8006e4315a91b824a514c401484bbcc2c"}
Jul 12 08:07:59.326329 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.326263    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-l8zwc" podStartSLOduration=39.223327549 podStartE2EDuration="45.326248906s" totalImagesPullingTime="6.102921357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.325557086 +0000 UTC m=+76.108557429" watchObservedRunningTime="2026-07-12 08:07:59.326248906 +0000 UTC m=+76.109249248"
Jul 12 08:07:59.344097 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.344036    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-x42kf" podStartSLOduration=36.916818587 podStartE2EDuration="46.344015658s" totalImagesPullingTime="9.427197071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.342507869 +0000 UTC m=+76.125508215" watchObservedRunningTime="2026-07-12 08:07:59.344015658 +0000 UTC m=+76.127015983"
Jul 12 08:07:59.356053 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.356003    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r6jrm" podStartSLOduration=67.229276842 podStartE2EDuration="1m14.355987783s" totalImagesPullingTime="7.126710941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.354996729 +0000 UTC m=+76.137997074" watchObservedRunningTime="2026-07-12 08:07:59.355987783 +0000 UTC m=+76.138988127"
Jul 12 08:07:59.370988 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.370925    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7npxg" podStartSLOduration=17.469207495 podStartE2EDuration="28.370908903s" totalImagesPullingTime="10.901701408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:07:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.37000131 +0000 UTC m=+76.153001652" watchObservedRunningTime="2026-07-12 08:07:59.370908903 +0000 UTC m=+76.153909246"
Jul 12 08:07:59.383653 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.383323    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bvx29" podStartSLOduration=67.516197298 podStartE2EDuration="1m14.383301011s" totalImagesPullingTime="6.867103713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.382690658 +0000 UTC m=+76.165691014" watchObservedRunningTime="2026-07-12 08:07:59.383301011 +0000 UTC m=+76.166301348"
Jul 12 08:07:59.387950 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.387923    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-x42kf"
Jul 12 08:07:59.398581 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.398537    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g6g4q" podStartSLOduration=40.25617759 podStartE2EDuration="46.398520781s" totalImagesPullingTime="6.142343191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.397193122 +0000 UTC m=+76.180193467" watchObservedRunningTime="2026-07-12 08:07:59.398520781 +0000 UTC m=+76.181521126"
Jul 12 08:07:59.422381 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.420806    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qnlwb" podStartSLOduration=34.168336136 podStartE2EDuration="40.420785156s" totalImagesPullingTime="6.25244902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.41976752 +0000 UTC m=+76.202767864" watchObservedRunningTime="2026-07-12 08:07:59.420785156 +0000 UTC m=+76.203785501"
Jul 12 08:07:59.443425 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.439761    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-trcrn" podStartSLOduration=40.184859813 podStartE2EDuration="46.439740487s" totalImagesPullingTime="6.254880674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:59.437685521 +0000 UTC m=+76.220685863" watchObservedRunningTime="2026-07-12 08:07:59.439740487 +0000 UTC m=+76.222740832"
Jul 12 08:07:59.720337 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:07:59.720225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bvr8j\" (UID: \"7e19f4c5-0592-4af2-bab6-34a2e7a3e877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:07:59.720484 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:59.720400    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 12 08:07:59.720484 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:07:59.720469    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates podName:7e19f4c5-0592-4af2-bab6-34a2e7a3e877 nodeName:}" failed. No retries permitted until 2026-07-12 08:08:00.720453446 +0000 UTC m=+77.503453767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-bvr8j" (UID: "7e19f4c5-0592-4af2-bab6-34a2e7a3e877") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 12 08:08:00.731256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:00.731217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bvr8j\" (UID: \"7e19f4c5-0592-4af2-bab6-34a2e7a3e877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:08:00.733718 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:00.733691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e19f4c5-0592-4af2-bab6-34a2e7a3e877-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bvr8j\" (UID: \"7e19f4c5-0592-4af2-bab6-34a2e7a3e877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:08:00.823758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:00.823717    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:08:00.985710 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:00.985684    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"]
Jul 12 08:08:00.988150 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:08:00.988121    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e19f4c5_0592_4af2_bab6_34a2e7a3e877.slice/crio-235753fedb0136bbf5316d7ab8af9b960b41e359ca422c8381e597a37853767b WatchSource:0}: Error finding container 235753fedb0136bbf5316d7ab8af9b960b41e359ca422c8381e597a37853767b: Status 404 returned error can't find the container with id 235753fedb0136bbf5316d7ab8af9b960b41e359ca422c8381e597a37853767b
Jul 12 08:08:01.333652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:01.333616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j" event={"ID":"7e19f4c5-0592-4af2-bab6-34a2e7a3e877","Type":"ContainerStarted","Data":"235753fedb0136bbf5316d7ab8af9b960b41e359ca422c8381e597a37853767b"}
Jul 12 08:08:03.342427 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:03.342386    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j" event={"ID":"7e19f4c5-0592-4af2-bab6-34a2e7a3e877","Type":"ContainerStarted","Data":"9780433f98e42490e28bc794c13f6608e31641fde32ab7a46dd79457a3b8dbe6"}
Jul 12 08:08:03.342848 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:03.342601    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:08:03.347494 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:03.347467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j"
Jul 12 08:08:03.358052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:03.358006    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bvr8j" podStartSLOduration=3.710397173 podStartE2EDuration="5.357993669s" totalImagesPullingTime="1.647596496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:03.357391828 +0000 UTC m=+80.140392173" watchObservedRunningTime="2026-07-12 08:08:03.357993669 +0000 UTC m=+80.140994012"
Jul 12 08:08:09.330696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:09.330559    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qnlwb"
Jul 12 08:08:10.456429 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.456388    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xdfjb"]
Jul 12 08:08:10.460887 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.460870    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.463072 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.463047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 08:08:10.463246 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.463226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 08:08:10.463359 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.463343    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jwfft\""
Jul 12 08:08:10.463431 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.463368    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 08:08:10.464199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.464180    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 08:08:10.608979 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.608943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-root\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.608979 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.608981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-sys\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d071e0cf-676f-4b50-a629-49761c12fe6d-metrics-client-ca\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z78t6\" (UniqueName: \"kubernetes.io/projected/d071e0cf-676f-4b50-a629-49761c12fe6d-kube-api-access-z78t6\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-wtmp\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-textfile\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.609213 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.609205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-tls\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.709964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.709871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-root\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.709964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.709909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-sys\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.709964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.709929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d071e0cf-676f-4b50-a629-49761c12fe6d-metrics-client-ca\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.709964 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.709948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z78t6\" (UniqueName: \"kubernetes.io/projected/d071e0cf-676f-4b50-a629-49761c12fe6d-kube-api-access-z78t6\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.709981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-wtmp\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-root\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-textfile\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-wtmp\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d071e0cf-676f-4b50-a629-49761c12fe6d-sys\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-tls\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710734 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-textfile\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710734 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-accelerators-collector-config\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.710734 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.710707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d071e0cf-676f-4b50-a629-49761c12fe6d-metrics-client-ca\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.712693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.712661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-tls\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.712693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.712687    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d071e0cf-676f-4b50-a629-49761c12fe6d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.717239 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.717217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z78t6\" (UniqueName: \"kubernetes.io/projected/d071e0cf-676f-4b50-a629-49761c12fe6d-kube-api-access-z78t6\") pod \"node-exporter-xdfjb\" (UID: \"d071e0cf-676f-4b50-a629-49761c12fe6d\") " pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.769973 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:10.769931    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xdfjb"
Jul 12 08:08:10.782354 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:08:10.782317    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd071e0cf_676f_4b50_a629_49761c12fe6d.slice/crio-3d94ea413593e99c66c56c17d9cbbc433337b7a5d3f6c4b17b90a9cbe9e63d20 WatchSource:0}: Error finding container 3d94ea413593e99c66c56c17d9cbbc433337b7a5d3f6c4b17b90a9cbe9e63d20: Status 404 returned error can't find the container with id 3d94ea413593e99c66c56c17d9cbbc433337b7a5d3f6c4b17b90a9cbe9e63d20
Jul 12 08:08:11.375842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:11.375796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xdfjb" event={"ID":"d071e0cf-676f-4b50-a629-49761c12fe6d","Type":"ContainerStarted","Data":"3d94ea413593e99c66c56c17d9cbbc433337b7a5d3f6c4b17b90a9cbe9e63d20"}
Jul 12 08:08:12.380833 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.380787    2558 generic.go:356] "Generic (PLEG): container finished" podID="d071e0cf-676f-4b50-a629-49761c12fe6d" containerID="93a1737bbbfcd148e92d011e406368fc2bf19b8bd4ff40c699dd6fa39a530fb0" exitCode=0
Jul 12 08:08:12.381246 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.380847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xdfjb" event={"ID":"d071e0cf-676f-4b50-a629-49761c12fe6d","Type":"ContainerDied","Data":"93a1737bbbfcd148e92d011e406368fc2bf19b8bd4ff40c699dd6fa39a530fb0"}
Jul 12 08:08:12.414461 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.414431    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-598d6677ff-chpp6"]
Jul 12 08:08:12.419261 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.419238    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.421788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.421766    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 12 08:08:12.421884 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.421766    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 12 08:08:12.421884 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.421837    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c79vr8s0v4ca\""
Jul 12 08:08:12.421884 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.421856    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 12 08:08:12.422103 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.422088    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 12 08:08:12.422203 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.422109    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 12 08:08:12.422203 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.422122    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5g7kw\""
Jul 12 08:08:12.433620 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.433593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-598d6677ff-chpp6"]
Jul 12 08:08:12.528658 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.528631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.528772 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.528672    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3542c3-623c-40fa-acae-a2cc43e7204d-metrics-client-ca\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.528772 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.528704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.528860 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.528822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.528919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.528901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.528972 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.528952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-grpc-tls\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.529068 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.529049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72qr8\" (UniqueName: \"kubernetes.io/projected/0a3542c3-623c-40fa-acae-a2cc43e7204d-kube-api-access-72qr8\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.529171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.529152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-tls\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629624 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-tls\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629624 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629882 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3542c3-623c-40fa-acae-a2cc43e7204d-metrics-client-ca\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629882 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629882 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629882 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629882 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-grpc-tls\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.629882 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.629834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72qr8\" (UniqueName: \"kubernetes.io/projected/0a3542c3-623c-40fa-acae-a2cc43e7204d-kube-api-access-72qr8\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.630772 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.630735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a3542c3-623c-40fa-acae-a2cc43e7204d-metrics-client-ca\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.633020 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.632960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.633131 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.633015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.633131 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.633060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-tls\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.633131 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.633069    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.633325 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.633207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.633325 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.633269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a3542c3-623c-40fa-acae-a2cc43e7204d-secret-grpc-tls\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.637129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.637106    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72qr8\" (UniqueName: \"kubernetes.io/projected/0a3542c3-623c-40fa-acae-a2cc43e7204d-kube-api-access-72qr8\") pod \"thanos-querier-598d6677ff-chpp6\" (UID: \"0a3542c3-623c-40fa-acae-a2cc43e7204d\") " pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.732260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.732227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:12.869235 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:12.869201    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-598d6677ff-chpp6"]
Jul 12 08:08:12.872197 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:08:12.872170    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3542c3_623c_40fa_acae_a2cc43e7204d.slice/crio-89d8166c9003094142bde1c6a0ccb2e969a651babc4ba82ffd3e35fdec4ec9e3 WatchSource:0}: Error finding container 89d8166c9003094142bde1c6a0ccb2e969a651babc4ba82ffd3e35fdec4ec9e3: Status 404 returned error can't find the container with id 89d8166c9003094142bde1c6a0ccb2e969a651babc4ba82ffd3e35fdec4ec9e3
Jul 12 08:08:13.386209 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:13.386175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"89d8166c9003094142bde1c6a0ccb2e969a651babc4ba82ffd3e35fdec4ec9e3"}
Jul 12 08:08:13.388683 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:13.388656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xdfjb" event={"ID":"d071e0cf-676f-4b50-a629-49761c12fe6d","Type":"ContainerStarted","Data":"828537c87043836d1a64c58fa8761f9c1b6c032f5b2564e9467973dde53f18ee"}
Jul 12 08:08:13.388823 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:13.388700    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xdfjb" event={"ID":"d071e0cf-676f-4b50-a629-49761c12fe6d","Type":"ContainerStarted","Data":"87bc5d99f5dd49be0188a16921edeee225f45c7313e7ab5c1901849c10a3ecd5"}
Jul 12 08:08:13.409264 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:13.409211    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xdfjb" podStartSLOduration=2.330025941 podStartE2EDuration="3.409195178s" totalImagesPullingTime="1.007947714s" totalInitContainerRuntime="71.221523ms" isStatefulPod=true podCreationTimestamp="2026-07-12 08:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:13.407121695 +0000 UTC m=+90.190122031" watchObservedRunningTime="2026-07-12 08:08:13.409195178 +0000 UTC m=+90.192195522"
Jul 12 08:08:14.930405 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.930370    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b795f75fd-qbpt5"]
Jul 12 08:08:14.934793 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.934763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.937082 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.937058    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 12 08:08:14.937260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.937239    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 08:08:14.937363 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.937259    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 12 08:08:14.937363 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.937315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 12 08:08:14.938039 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.938018    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2xs6f\""
Jul 12 08:08:14.938163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.938018    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6o0rjc1pba4r\""
Jul 12 08:08:14.947655 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.947629    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b795f75fd-qbpt5"]
Jul 12 08:08:14.950330 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2804ea04-cb80-4c3a-89eb-7b11801d4559-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.950469 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-secret-metrics-server-tls\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.950469 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2804ea04-cb80-4c3a-89eb-7b11801d4559-audit-log\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.950469 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-client-ca-bundle\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.950469 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-secret-metrics-server-client-certs\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.950632 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vvc9\" (UniqueName: \"kubernetes.io/projected/2804ea04-cb80-4c3a-89eb-7b11801d4559-kube-api-access-9vvc9\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:14.950632 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:14.950618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2804ea04-cb80-4c3a-89eb-7b11801d4559-metrics-server-audit-profiles\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.051956 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.051914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2804ea04-cb80-4c3a-89eb-7b11801d4559-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052143 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.051954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-secret-metrics-server-tls\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052143 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2804ea04-cb80-4c3a-89eb-7b11801d4559-audit-log\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052143 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-client-ca-bundle\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052143 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-secret-metrics-server-client-certs\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052143 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vvc9\" (UniqueName: \"kubernetes.io/projected/2804ea04-cb80-4c3a-89eb-7b11801d4559-kube-api-access-9vvc9\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052397 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2804ea04-cb80-4c3a-89eb-7b11801d4559-metrics-server-audit-profiles\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052543 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052517    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2804ea04-cb80-4c3a-89eb-7b11801d4559-audit-log\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.052862 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.052820    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2804ea04-cb80-4c3a-89eb-7b11801d4559-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.053106 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.053089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2804ea04-cb80-4c3a-89eb-7b11801d4559-metrics-server-audit-profiles\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.055258 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.055230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-client-ca-bundle\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.055382 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.055334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-secret-metrics-server-client-certs\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.055502 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.055457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2804ea04-cb80-4c3a-89eb-7b11801d4559-secret-metrics-server-tls\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.060142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.060115    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vvc9\" (UniqueName: \"kubernetes.io/projected/2804ea04-cb80-4c3a-89eb-7b11801d4559-kube-api-access-9vvc9\") pod \"metrics-server-b795f75fd-qbpt5\" (UID: \"2804ea04-cb80-4c3a-89eb-7b11801d4559\") " pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.199355 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.199269    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"]
Jul 12 08:08:15.203767 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.203745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.205764 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.205736    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 12 08:08:15.205907 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.205881    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cpxm2\""
Jul 12 08:08:15.212474 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.212443    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"]
Jul 12 08:08:15.245977 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.245941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:15.254256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.254223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxhv\" (UniqueName: \"kubernetes.io/projected/08525908-ac75-4326-a749-e8c95c1a3168-kube-api-access-hpxhv\") pod \"monitoring-plugin-5f68df7f58-zfqm9\" (UID: \"08525908-ac75-4326-a749-e8c95c1a3168\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.254417 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.254269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08525908-ac75-4326-a749-e8c95c1a3168-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zfqm9\" (UID: \"08525908-ac75-4326-a749-e8c95c1a3168\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.295567 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.295539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:08:15.355612 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.355576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxhv\" (UniqueName: \"kubernetes.io/projected/08525908-ac75-4326-a749-e8c95c1a3168-kube-api-access-hpxhv\") pod \"monitoring-plugin-5f68df7f58-zfqm9\" (UID: \"08525908-ac75-4326-a749-e8c95c1a3168\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.355766 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.355642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08525908-ac75-4326-a749-e8c95c1a3168-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zfqm9\" (UID: \"08525908-ac75-4326-a749-e8c95c1a3168\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.358707 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.358677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/08525908-ac75-4326-a749-e8c95c1a3168-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-zfqm9\" (UID: \"08525908-ac75-4326-a749-e8c95c1a3168\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.368202 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.368175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxhv\" (UniqueName: \"kubernetes.io/projected/08525908-ac75-4326-a749-e8c95c1a3168-kube-api-access-hpxhv\") pod \"monitoring-plugin-5f68df7f58-zfqm9\" (UID: \"08525908-ac75-4326-a749-e8c95c1a3168\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.516501 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.516479    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:15.564398 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.564356    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b795f75fd-qbpt5"]
Jul 12 08:08:15.577816 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:08:15.577766    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2804ea04_cb80_4c3a_89eb_7b11801d4559.slice/crio-23c1351b84c35235ccab154617c9c6ef72ccedb91642525f533329f2663bc029 WatchSource:0}: Error finding container 23c1351b84c35235ccab154617c9c6ef72ccedb91642525f533329f2663bc029: Status 404 returned error can't find the container with id 23c1351b84c35235ccab154617c9c6ef72ccedb91642525f533329f2663bc029
Jul 12 08:08:15.667890 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:15.667741    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"]
Jul 12 08:08:15.670447 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:08:15.670416    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08525908_ac75_4326_a749_e8c95c1a3168.slice/crio-6b8b5e7971c54e112eb4af317e73b84c881b93e8d97020dd020cebf6194868e8 WatchSource:0}: Error finding container 6b8b5e7971c54e112eb4af317e73b84c881b93e8d97020dd020cebf6194868e8: Status 404 returned error can't find the container with id 6b8b5e7971c54e112eb4af317e73b84c881b93e8d97020dd020cebf6194868e8
Jul 12 08:08:16.406449 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.406408    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9" event={"ID":"08525908-ac75-4326-a749-e8c95c1a3168","Type":"ContainerStarted","Data":"6b8b5e7971c54e112eb4af317e73b84c881b93e8d97020dd020cebf6194868e8"}
Jul 12 08:08:16.407996 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.407969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5" event={"ID":"2804ea04-cb80-4c3a-89eb-7b11801d4559","Type":"ContainerStarted","Data":"23c1351b84c35235ccab154617c9c6ef72ccedb91642525f533329f2663bc029"}
Jul 12 08:08:16.410722 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.410693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"e473ee873eb514c50837a84b0adacc5837e5d4ee91276faf86a56eb80098e5bb"}
Jul 12 08:08:16.410826 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.410761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"7d69019de580c767ff0137b744d6292da9e59f769fa80900c044296756ff81a1"}
Jul 12 08:08:16.410826 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.410797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"8288aa97b17159230a84492b8f89ff25ccebd12a84587696428ff9f882b7e7ac"}
Jul 12 08:08:16.610889 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.610861    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:08:16.616606 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.616578    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.619129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.619112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 12 08:08:16.619367 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.619345    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 12 08:08:16.619663 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.619644    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 12 08:08:16.620256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620240    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620408    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620442    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620492    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620616    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r6mxp\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620692    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620868    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c29skslhldotg\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 12 08:08:16.621100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.620988    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 12 08:08:16.621583 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.621174    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 12 08:08:16.621583 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.621172    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 12 08:08:16.621583 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.621505    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 12 08:08:16.623071 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.622843    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 12 08:08:16.630024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.629996    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:08:16.666237 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666372 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666372 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666372 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.666547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.666508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-config\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x524z\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-kube-api-access-x524z\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.671319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.668820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770423 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.770857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.771412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.771412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-config\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.771412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x524z\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-kube-api-access-x524z\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.771412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.770996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.771412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.771037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.771412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.771084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.773693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.771742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.773693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.771920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.773693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.772220    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.773693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.772775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.773693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.773374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.775210 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.775126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.775775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.775733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.776183 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.776148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.778688 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.778666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-config\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.778836 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.778805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.779660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.779690    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.779786    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.780130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.780140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.780165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-web-config\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.780598 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.780564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.781878 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.781831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.782743 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.782706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-config-out\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.783016 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.782990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x524z\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-kube-api-access-x524z\") pod \"prometheus-k8s-0\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:16.945450 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:16.945348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:17.418188 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:17.418128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"1eecb7330f54f8dfeb6a3e9fd2a19011bdc857861259661d5674fa43cc583fd4"}
Jul 12 08:08:17.418678 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:17.418308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"c3c34bbfdb5c3eb4901ec67bc8058dfe55abccd445c9e2413fa480e7bb5d8fa1"}
Jul 12 08:08:17.676697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:17.676667    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:08:18.425715 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.425669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5" event={"ID":"2804ea04-cb80-4c3a-89eb-7b11801d4559","Type":"ContainerStarted","Data":"c029d575a36a2593af61fb111113f7680a1b2745807ce6da54e2e7702bbae47a"}
Jul 12 08:08:18.427314 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.427267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"27adc1fdb61e8a4918b02edbbf71d202cd2aea59a0857e5925977d05064c27ce"}
Jul 12 08:08:18.430974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.430948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" event={"ID":"0a3542c3-623c-40fa-acae-a2cc43e7204d","Type":"ContainerStarted","Data":"38d7c468d0e6f6c61883ffc71e71f27d9d9e30f19024e8acc4a5daa6ec1b67e0"}
Jul 12 08:08:18.431109 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.431060    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:18.432585 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.432554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9" event={"ID":"08525908-ac75-4326-a749-e8c95c1a3168","Type":"ContainerStarted","Data":"545de74c18d3c0d6953f160c82b2020f72dc4003e1ee427e2e5b6277df84e71c"}
Jul 12 08:08:18.432781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.432764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:18.438809 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.438787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9"
Jul 12 08:08:18.442454 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.442414    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5" podStartSLOduration=2.502363633 podStartE2EDuration="4.44240264s" totalImagesPullingTime="1.940039007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:18.440662608 +0000 UTC m=+95.223662952" watchObservedRunningTime="2026-07-12 08:08:18.44240264 +0000 UTC m=+95.225402984"
Jul 12 08:08:18.454537 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.454480    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-zfqm9" podStartSLOduration=1.606110364 podStartE2EDuration="3.454462989s" totalImagesPullingTime="1.848352625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:18.453747497 +0000 UTC m=+95.236747846" watchObservedRunningTime="2026-07-12 08:08:18.454462989 +0000 UTC m=+95.237463334"
Jul 12 08:08:18.473946 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:18.473885    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6" podStartSLOduration=2.95748789 podStartE2EDuration="6.473868947s" totalImagesPullingTime="3.516381057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:18.473513734 +0000 UTC m=+95.256514115" watchObservedRunningTime="2026-07-12 08:08:18.473868947 +0000 UTC m=+95.256869291"
Jul 12 08:08:19.303718 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:19.303682    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67564454dd-krx2r"]
Jul 12 08:08:19.438403 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:19.438366    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef" exitCode=0
Jul 12 08:08:19.438792 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:19.438472    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"}
Jul 12 08:08:23.284595 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.284567    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrdms"
Jul 12 08:08:23.461867 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.461836    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"}
Jul 12 08:08:23.461992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.461931    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"}
Jul 12 08:08:23.461992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.461971    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"}
Jul 12 08:08:23.462064 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.462006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"}
Jul 12 08:08:23.462064 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.462060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"}
Jul 12 08:08:23.462122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.462097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerStarted","Data":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"}
Jul 12 08:08:23.504514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:23.504417    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.81579802 podStartE2EDuration="7.504400824s" totalImagesPullingTime="4.669206381s" totalInitContainerRuntime="19.396423ms" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:23.50299943 +0000 UTC m=+100.285999773" watchObservedRunningTime="2026-07-12 08:08:23.504400824 +0000 UTC m=+100.287401168"
Jul 12 08:08:24.445706 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:24.445677    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-598d6677ff-chpp6"
Jul 12 08:08:26.945632 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:26.945586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:08:35.246114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:35.246075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:35.246541 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:35.246162    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:40.534025 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:40.533993    2558 generic.go:356] "Generic (PLEG): container finished" podID="7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3" containerID="cc697905c3e104faca9e32dc4e317f8704fceb798e306bc3257e6478088e2fe9" exitCode=0
Jul 12 08:08:40.534408 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:40.534039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj" event={"ID":"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3","Type":"ContainerDied","Data":"cc697905c3e104faca9e32dc4e317f8704fceb798e306bc3257e6478088e2fe9"}
Jul 12 08:08:40.534408 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:40.534375    2558 scope.go:117] "RemoveContainer" containerID="cc697905c3e104faca9e32dc4e317f8704fceb798e306bc3257e6478088e2fe9"
Jul 12 08:08:41.540167 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:41.540131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l5vxj" event={"ID":"7e4ffdcf-04fc-43cd-9296-eca6ef7f41a3","Type":"ContainerStarted","Data":"f5ab77857b8773f4f4987cdc0df21db5c091eca9e33ed6fa6cf9df22b38260f4"}
Jul 12 08:08:44.325387 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.325347    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67564454dd-krx2r" podUID="67537171-dbd5-41c1-b8a1-fd5193dedbe2" containerName="registry" containerID="cri-o://b74017f37f54157f916ded4d050d4e42811d6f7be97fdb31bcae1036ce39cb9f" gracePeriod=30
Jul 12 08:08:44.554973 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.554939    2558 generic.go:356] "Generic (PLEG): container finished" podID="67537171-dbd5-41c1-b8a1-fd5193dedbe2" containerID="b74017f37f54157f916ded4d050d4e42811d6f7be97fdb31bcae1036ce39cb9f" exitCode=0
Jul 12 08:08:44.555145 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.555005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67564454dd-krx2r" event={"ID":"67537171-dbd5-41c1-b8a1-fd5193dedbe2","Type":"ContainerDied","Data":"b74017f37f54157f916ded4d050d4e42811d6f7be97fdb31bcae1036ce39cb9f"}
Jul 12 08:08:44.575102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.575041    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:08:44.717305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-trusted-ca\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717292    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-installation-pull-secrets\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717339    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7dqj\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-kube-api-access-b7dqj\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717393    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-certificates\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717423    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67537171-dbd5-41c1-b8a1-fd5193dedbe2-ca-trust-extracted\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717452    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717475    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-bound-sa-token\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717712 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717534    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-image-registry-private-configuration\") pod \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\" (UID: \"67537171-dbd5-41c1-b8a1-fd5193dedbe2\") "
Jul 12 08:08:44.717762 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717748    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:08:44.717846 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717826    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-trusted-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.718005 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.717951    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:08:44.720153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.720119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:08:44.720153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.720113    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:08:44.720378 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.720228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:08:44.720378 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.720342    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-kube-api-access-b7dqj" (OuterVolumeSpecName: "kube-api-access-b7dqj") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "kube-api-access-b7dqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:08:44.720598 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.720579    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:08:44.725929 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.725899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67537171-dbd5-41c1-b8a1-fd5193dedbe2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "67537171-dbd5-41c1-b8a1-fd5193dedbe2" (UID: "67537171-dbd5-41c1-b8a1-fd5193dedbe2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:08:44.818669 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818631    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-installation-pull-secrets\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.818669 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818666    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7dqj\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-kube-api-access-b7dqj\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.818669 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818676    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-certificates\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.818888 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818685    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67537171-dbd5-41c1-b8a1-fd5193dedbe2-ca-trust-extracted\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.818888 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818694    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-registry-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.818888 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818703    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67537171-dbd5-41c1-b8a1-fd5193dedbe2-bound-sa-token\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:44.818888 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:44.818713    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67537171-dbd5-41c1-b8a1-fd5193dedbe2-image-registry-private-configuration\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:08:45.560290 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:45.560234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67564454dd-krx2r" event={"ID":"67537171-dbd5-41c1-b8a1-fd5193dedbe2","Type":"ContainerDied","Data":"5d5397c059c91dabc9eb6384f5e3607ee280cda50b24ccc38d88892038c9b732"}
Jul 12 08:08:45.560290 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:45.560261    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67564454dd-krx2r"
Jul 12 08:08:45.560798 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:45.560330    2558 scope.go:117] "RemoveContainer" containerID="b74017f37f54157f916ded4d050d4e42811d6f7be97fdb31bcae1036ce39cb9f"
Jul 12 08:08:45.579521 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:45.579496    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67564454dd-krx2r"]
Jul 12 08:08:45.582785 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:45.582760    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67564454dd-krx2r"]
Jul 12 08:08:45.754804 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:45.754771    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67537171-dbd5-41c1-b8a1-fd5193dedbe2" path="/var/lib/kubelet/pods/67537171-dbd5-41c1-b8a1-fd5193dedbe2/volumes"
Jul 12 08:08:51.586669 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:51.586632    2558 generic.go:356] "Generic (PLEG): container finished" podID="3003ddb7-f5e4-47c9-9493-181850171749" containerID="4283a40259ee030ee8651c746d1f002a5d4eb3344039664e1f1f27eeea5c3961" exitCode=0
Jul 12 08:08:51.587199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:51.586711    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m" event={"ID":"3003ddb7-f5e4-47c9-9493-181850171749","Type":"ContainerDied","Data":"4283a40259ee030ee8651c746d1f002a5d4eb3344039664e1f1f27eeea5c3961"}
Jul 12 08:08:51.587199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:51.587112    2558 scope.go:117] "RemoveContainer" containerID="4283a40259ee030ee8651c746d1f002a5d4eb3344039664e1f1f27eeea5c3961"
Jul 12 08:08:52.592706 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:52.592663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6dc9m" event={"ID":"3003ddb7-f5e4-47c9-9493-181850171749","Type":"ContainerStarted","Data":"bcf851878decf7d86fff450a38ea5fccf812b442c645aa02032a1de055e90a83"}
Jul 12 08:08:55.251829 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:55.251801    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:55.255710 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:55.255687    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b795f75fd-qbpt5"
Jul 12 08:08:56.610037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:56.610002    2558 generic.go:356] "Generic (PLEG): container finished" podID="33dc61bb-6dbf-44a8-a793-5882af9def06" containerID="8a8be0fee671c4df40bb4ed7276dfec9cfdba887121f5dce2d001c62f90b9208" exitCode=0
Jul 12 08:08:56.610446 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:56.610069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs" event={"ID":"33dc61bb-6dbf-44a8-a793-5882af9def06","Type":"ContainerDied","Data":"8a8be0fee671c4df40bb4ed7276dfec9cfdba887121f5dce2d001c62f90b9208"}
Jul 12 08:08:56.610446 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:56.610436    2558 scope.go:117] "RemoveContainer" containerID="8a8be0fee671c4df40bb4ed7276dfec9cfdba887121f5dce2d001c62f90b9208"
Jul 12 08:08:57.160248 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:57.160216    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc544f466-pw5ml_4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357/router/0.log"
Jul 12 08:08:57.172023 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:57.171997    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx7lg_d3e80c24-675f-4c82-9dd4-45a2f5561f85/serve-healthcheck-canary/0.log"
Jul 12 08:08:57.615548 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:08:57.615512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-kflgs" event={"ID":"33dc61bb-6dbf-44a8-a793-5882af9def06","Type":"ContainerStarted","Data":"e11f895f073aef7f85f99484e8b0fa52c68fb5689563ceb53a5ff63bab8f3889"}
Jul 12 08:09:16.946052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:16.946001    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:16.962938 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:16.962910    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:17.719245 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:17.719213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:34.995747 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.995667    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:09:34.996182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.996010    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="prometheus" containerID="cri-o://5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8" gracePeriod=600
Jul 12 08:09:34.996182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.996030    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="thanos-sidecar" containerID="cri-o://770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d" gracePeriod=600
Jul 12 08:09:34.996182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.996088    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-web" containerID="cri-o://02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7" gracePeriod=600
Jul 12 08:09:34.996182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.996028    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy" containerID="cri-o://b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902" gracePeriod=600
Jul 12 08:09:34.996182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.996115    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="config-reloader" containerID="cri-o://e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d" gracePeriod=600
Jul 12 08:09:34.996479 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:34.996114    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32" gracePeriod=600
Jul 12 08:09:35.238966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.238938    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.373909 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.373870    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-web-config\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.373909 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.373908    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-0\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.373937    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-2\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.373960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-thanos-prometheus-http-client-file\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.373990    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-config\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374031    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-serving-certs-ca-bundle\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374060    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-tls-assets\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374085    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374127    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-kube-rbac-proxy\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-metrics-client-certs\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374231    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-tls\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374265    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x524z\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-kube-api-access-x524z\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374324    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-db\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374332    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374361    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-kubelet-serving-ca-bundle\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.374540 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374470    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.375105 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.374896    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.375884 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.375619    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.377503 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-config" (OuterVolumeSpecName: "config") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.377607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.377607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377543    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.377607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377582    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377601    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-trusted-ca-bundle\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377679    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-1\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377714    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-grpc-tls\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377726    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-kube-api-access-x524z" (OuterVolumeSpecName: "kube-api-access-x524z") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "kube-api-access-x524z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377740    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-config-out\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.377791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.377791    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-metrics-client-ca\") pod \"55dd3d04-6f98-4be7-ae70-781593317f1e\" (UID: \"55dd3d04-6f98-4be7-ae70-781593317f1e\") "
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378108    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-config\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378129    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378144    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378158    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-kube-rbac-proxy\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378172    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378184    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x524z\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-kube-api-access-x524z\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378190    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378198    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378212    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378226    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378241    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.378899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378418    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.378899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.378899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378554    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:09:35.378899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.378616    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:09:35.379802 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.379782    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.379977 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.379956    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.380317 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.380295    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.380473 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.380455    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-config-out" (OuterVolumeSpecName: "config-out") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:09:35.389416 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.389395    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-web-config" (OuterVolumeSpecName: "web-config") pod "55dd3d04-6f98-4be7-ae70-781593317f1e" (UID: "55dd3d04-6f98-4be7-ae70-781593317f1e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:09:35.479488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479447    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479483    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479499    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-grpc-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479511    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-config-out\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479522    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd3d04-6f98-4be7-ae70-781593317f1e-configmap-metrics-client-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479534    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-web-config\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479545    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd3d04-6f98-4be7-ae70-781593317f1e-tls-assets\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479557    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479579    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd3d04-6f98-4be7-ae70-781593317f1e-secret-metrics-client-certs\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.479693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.479591    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd3d04-6f98-4be7-ae70-781593317f1e-prometheus-k8s-db\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:09:35.779939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779903    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32" exitCode=0
Jul 12 08:09:35.779939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779926    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902" exitCode=0
Jul 12 08:09:35.779939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779932    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7" exitCode=0
Jul 12 08:09:35.779939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779937    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d" exitCode=0
Jul 12 08:09:35.779939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779942    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d" exitCode=0
Jul 12 08:09:35.779939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779947    2558 generic.go:356] "Generic (PLEG): container finished" podID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8" exitCode=0
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779982    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.779979    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"}
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780116    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"}
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780145    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"}
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780177    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"}
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780182    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"}
Jul 12 08:09:35.780229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780228    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"}
Jul 12 08:09:35.780545 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.780258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd3d04-6f98-4be7-ae70-781593317f1e","Type":"ContainerDied","Data":"27adc1fdb61e8a4918b02edbbf71d202cd2aea59a0857e5925977d05064c27ce"}
Jul 12 08:09:35.788247 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.788230    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.796068 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.796051    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.803458 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.803426    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:09:35.804553 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.804440    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.807094 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.807072    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:09:35.811824 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.811800    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.819056 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.819041    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.826658 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.826635    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.832443 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832419    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:09:35.832877 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832858    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="init-config-reloader"
Jul 12 08:09:35.832923 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832884    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="init-config-reloader"
Jul 12 08:09:35.832923 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832902    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67537171-dbd5-41c1-b8a1-fd5193dedbe2" containerName="registry"
Jul 12 08:09:35.832923 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832911    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="67537171-dbd5-41c1-b8a1-fd5193dedbe2" containerName="registry"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832947    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832958    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832971    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-web"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832979    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-web"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832990    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="thanos-sidecar"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.832999    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="thanos-sidecar"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833013    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="prometheus"
Jul 12 08:09:35.833037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833022    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="prometheus"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833041    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-thanos"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833050    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-thanos"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833069    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="config-reloader"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833078    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="config-reloader"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833165    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833181    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="config-reloader"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833190    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-web"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833198    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="67537171-dbd5-41c1-b8a1-fd5193dedbe2" containerName="registry"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833207    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="prometheus"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833216    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="kube-rbac-proxy-thanos"
Jul 12 08:09:35.833305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.833227    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" containerName="thanos-sidecar"
Jul 12 08:09:35.835044 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835027    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.835325 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.835296    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.835389 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835334    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"} err="failed to get container status \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist"
Jul 12 08:09:35.835389 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835365    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.835583 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.835570    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.835619 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835586    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"} err="failed to get container status \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist"
Jul 12 08:09:35.835619 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835597    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.835805 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.835791    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.835843 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835809    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"} err="failed to get container status \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist"
Jul 12 08:09:35.835843 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.835820    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.836018 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.836001    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.836057 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836022    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"} err="failed to get container status \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist"
Jul 12 08:09:35.836057 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836036    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.836257 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.836234    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.836348 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836269    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"} err="failed to get container status \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist"
Jul 12 08:09:35.836348 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836314    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.836601 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.836584    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.836637 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836606    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"} err="failed to get container status \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist"
Jul 12 08:09:35.836637 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836620    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.836867 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:09:35.836849    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.836933 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836875    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"} err="failed to get container status \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist"
Jul 12 08:09:35.836933 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.836895    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.837119 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837102    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"} err="failed to get container status \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist"
Jul 12 08:09:35.837169 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837120    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.837417 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837385    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"} err="failed to get container status \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist"
Jul 12 08:09:35.837458 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837418    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.837666 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837649    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"} err="failed to get container status \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist"
Jul 12 08:09:35.837703 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837667    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.837878 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837859    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"} err="failed to get container status \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist"
Jul 12 08:09:35.837941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.837881    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.838107 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838091    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"} err="failed to get container status \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist"
Jul 12 08:09:35.838148 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838109    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.838332 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838312    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"} err="failed to get container status \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist"
Jul 12 08:09:35.838380 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838333    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.838513 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838496    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"} err="failed to get container status \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist"
Jul 12 08:09:35.838579 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838515    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.838744 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838724    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"} err="failed to get container status \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist"
Jul 12 08:09:35.838744 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838743    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.838972 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838954    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"} err="failed to get container status \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist"
Jul 12 08:09:35.838972 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.838973    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.839199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839158    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"} err="failed to get container status \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist"
Jul 12 08:09:35.839255 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839201    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.839255 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.839670 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839482    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"} err="failed to get container status \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist"
Jul 12 08:09:35.839670 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839509    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.839935 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839911    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"} err="failed to get container status \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist"
Jul 12 08:09:35.840015 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.839962    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.840224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840204    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"} err="failed to get container status \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist"
Jul 12 08:09:35.840268 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840225    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.840477 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840453    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"} err="failed to get container status \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist"
Jul 12 08:09:35.840570 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840479    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.840709 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840691    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"} err="failed to get container status \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist"
Jul 12 08:09:35.840775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840711    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.840943 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840920    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"} err="failed to get container status \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist"
Jul 12 08:09:35.840943 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.840943    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.841158 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841138    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"} err="failed to get container status \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist"
Jul 12 08:09:35.841222 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841158    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.841420 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841401    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"} err="failed to get container status \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist"
Jul 12 08:09:35.841420 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841419    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.841622 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841605    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"} err="failed to get container status \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist"
Jul 12 08:09:35.841673 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841622    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.841828 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841810    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"} err="failed to get container status \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist"
Jul 12 08:09:35.841937 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.841829    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.842063 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842042    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"} err="failed to get container status \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist"
Jul 12 08:09:35.842127 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842065    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.842324 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842297    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"} err="failed to get container status \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist"
Jul 12 08:09:35.842324 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842322    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.842477 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842443    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 12 08:09:35.842530 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842474    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 12 08:09:35.842530 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842499    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 12 08:09:35.842626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 12 08:09:35.842626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842595    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"} err="failed to get container status \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist"
Jul 12 08:09:35.842626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842619    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.842946 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842926    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"} err="failed to get container status \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist"
Jul 12 08:09:35.843026 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.842953    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.843088 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843032    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 12 08:09:35.843206 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843188    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 12 08:09:35.843366 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843234    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"} err="failed to get container status \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist"
Jul 12 08:09:35.843366 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843257    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.843533 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843466    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"} err="failed to get container status \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist"
Jul 12 08:09:35.843533 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843484    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.843696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843616    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-r6mxp\""
Jul 12 08:09:35.843696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843625    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 12 08:09:35.843818 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843743    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"} err="failed to get container status \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist"
Jul 12 08:09:35.843818 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843759    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.843928 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843839    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c29skslhldotg\""
Jul 12 08:09:35.844010 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.843987    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"} err="failed to get container status \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist"
Jul 12 08:09:35.844126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844014    2558 scope.go:117] "RemoveContainer" containerID="7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"
Jul 12 08:09:35.844126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 12 08:09:35.844126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844078    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 12 08:09:35.844126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844100    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 12 08:09:35.844126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844122    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 12 08:09:35.844410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844223    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32"} err="failed to get container status \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": rpc error: code = NotFound desc = could not find container \"7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32\": container with ID starting with 7cff5fb64cbbbe9f43d236478b3e64bbfb4ddc0bbbbdbc2b23b61b1b242d5a32 not found: ID does not exist"
Jul 12 08:09:35.844410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844244    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 12 08:09:35.844410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844246    2558 scope.go:117] "RemoveContainer" containerID="b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"
Jul 12 08:09:35.844647 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844519    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902"} err="failed to get container status \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": rpc error: code = NotFound desc = could not find container \"b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902\": container with ID starting with b2543416dc6369c7ada4d9f0134dcd325a143b678397e700e5b54a968224f902 not found: ID does not exist"
Jul 12 08:09:35.844647 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844542    2558 scope.go:117] "RemoveContainer" containerID="02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"
Jul 12 08:09:35.844868 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844847    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7"} err="failed to get container status \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": rpc error: code = NotFound desc = could not find container \"02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7\": container with ID starting with 02f5cbd230988683a8fe8296ee2ad139ba6119e684e747d6733715b78ad78ac7 not found: ID does not exist"
Jul 12 08:09:35.844955 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.844869    2558 scope.go:117] "RemoveContainer" containerID="770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"
Jul 12 08:09:35.845222 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845085    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d"} err="failed to get container status \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": rpc error: code = NotFound desc = could not find container \"770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d\": container with ID starting with 770ad885eb2ac5c87eb29d744cdddde45ed2fab58a9bdaedb368ede51a0d451d not found: ID does not exist"
Jul 12 08:09:35.845222 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845104    2558 scope.go:117] "RemoveContainer" containerID="e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"
Jul 12 08:09:35.845509 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845350    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d"} err="failed to get container status \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": rpc error: code = NotFound desc = could not find container \"e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d\": container with ID starting with e2e5ca6cd61dcda9256684a72b0e2abdbaa2ae3a9693d5f36c4f1a571ea1948d not found: ID does not exist"
Jul 12 08:09:35.845509 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845376    2558 scope.go:117] "RemoveContainer" containerID="5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"
Jul 12 08:09:35.845630 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845606    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8"} err="failed to get container status \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": rpc error: code = NotFound desc = could not find container \"5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8\": container with ID starting with 5096f9f28aa57ec4e8307ebc900b9c016d0d6eff034d4bfb69126edc01b52fa8 not found: ID does not exist"
Jul 12 08:09:35.845630 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845625    2558 scope.go:117] "RemoveContainer" containerID="cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"
Jul 12 08:09:35.845917 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.845859    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef"} err="failed to get container status \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": rpc error: code = NotFound desc = could not find container \"cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef\": container with ID starting with cccdd19068bfc7515410ca1b596d499b2d93e27586072f883edcc9d6995e40ef not found: ID does not exist"
Jul 12 08:09:35.846593 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.846573    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 12 08:09:35.848387 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.848371    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 12 08:09:35.853458 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.853435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:09:35.983071 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983029    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983245 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983245 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983245 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983245 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983226    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43f8eaec-45a5-421c-bcb8-4216a13e6513-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43f8eaec-45a5-421c-bcb8-4216a13e6513-config-out\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ld77\" (UniqueName: \"kubernetes.io/projected/43f8eaec-45a5-421c-bcb8-4216a13e6513-kube-api-access-2ld77\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-config\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983642    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:35.983806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:35.983737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-web-config\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084472 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43f8eaec-45a5-421c-bcb8-4216a13e6513-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084472 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084554    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43f8eaec-45a5-421c-bcb8-4216a13e6513-config-out\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ld77\" (UniqueName: \"kubernetes.io/projected/43f8eaec-45a5-421c-bcb8-4216a13e6513-kube-api-access-2ld77\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-config\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-web-config\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.084993 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.085952 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.084984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.085952 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.085613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.085952 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.085619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.086102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.086069    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.086700 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.086672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.087879 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.087846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.087976 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.087915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.088122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.088095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.088174 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.088153    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.088696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.088391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/43f8eaec-45a5-421c-bcb8-4216a13e6513-config-out\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.088696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.088400    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.088696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.088653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/43f8eaec-45a5-421c-bcb8-4216a13e6513-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.088940 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.088909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.089083 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.089047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.089499 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.089476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.089997 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.089969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-config\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.090714 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.090698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-web-config\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.091068 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.091049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.091156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.091142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/43f8eaec-45a5-421c-bcb8-4216a13e6513-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.091406 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.091391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/43f8eaec-45a5-421c-bcb8-4216a13e6513-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.094052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.094030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ld77\" (UniqueName: \"kubernetes.io/projected/43f8eaec-45a5-421c-bcb8-4216a13e6513-kube-api-access-2ld77\") pod \"prometheus-k8s-0\" (UID: \"43f8eaec-45a5-421c-bcb8-4216a13e6513\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.151158 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.151120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:09:36.294044 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.294013    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 08:09:36.296326 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:09:36.296298    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f8eaec_45a5_421c_bcb8_4216a13e6513.slice/crio-c8fc32ba6492540735db2b6ce487f66eaa6bb61aec718ee1a272db11c36e8547 WatchSource:0}: Error finding container c8fc32ba6492540735db2b6ce487f66eaa6bb61aec718ee1a272db11c36e8547: Status 404 returned error can't find the container with id c8fc32ba6492540735db2b6ce487f66eaa6bb61aec718ee1a272db11c36e8547
Jul 12 08:09:36.785146 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.785113    2558 generic.go:356] "Generic (PLEG): container finished" podID="43f8eaec-45a5-421c-bcb8-4216a13e6513" containerID="f568f2fbe4dd5679590624a58c130e18659bed70213e5a211b2f4b28ecc5f6da" exitCode=0
Jul 12 08:09:36.785355 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.785206    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerDied","Data":"f568f2fbe4dd5679590624a58c130e18659bed70213e5a211b2f4b28ecc5f6da"}
Jul 12 08:09:36.785355 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:36.785290    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"c8fc32ba6492540735db2b6ce487f66eaa6bb61aec718ee1a272db11c36e8547"}
Jul 12 08:09:37.755492 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.755456    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55dd3d04-6f98-4be7-ae70-781593317f1e" path="/var/lib/kubelet/pods/55dd3d04-6f98-4be7-ae70-781593317f1e/volumes"
Jul 12 08:09:37.793683 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.793652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"20a4a2c9e238b398b12345ffb23ed81ed7df4b926358b44aa2fc5efcb3293655"}
Jul 12 08:09:37.793841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.793717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"96395d6ac441eb420eff502b0beaef13fd7bb18ca84f82571beae985d6018f1e"}
Jul 12 08:09:37.793841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.793745    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"2f383e54d2c7a56dcbcaeedd2a9781d4780bdbb482492913bd64a5ac9f149318"}
Jul 12 08:09:37.793841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.793769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"cc9be267dec8bd24fe2a92bef5e505543fca45ffe327983ef57e189ea670e8ab"}
Jul 12 08:09:37.793841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.793805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"9ace5af58e67af6db87ffa11238827d7b7ac67f35cf228383defc4070234f5e6"}
Jul 12 08:09:37.793841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.793832    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"43f8eaec-45a5-421c-bcb8-4216a13e6513","Type":"ContainerStarted","Data":"45590f383eddeb4b35c2a233d50ece64bd290356ccb6be66b3443912394fe74f"}
Jul 12 08:09:37.819653 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:37.819595    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.800301299 podStartE2EDuration="2.819570682s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.269383ms" isStatefulPod=false podCreationTimestamp="2026-07-12 08:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:09:37.818382873 +0000 UTC m=+174.601383219" watchObservedRunningTime="2026-07-12 08:09:37.819570682 +0000 UTC m=+174.602571026"
Jul 12 08:09:41.152167 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:09:41.152126    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:10:36.152033 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:10:36.151995    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:10:36.168345 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:10:36.168315    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:10:37.050825 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:10:37.050792    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 08:11:43.642295 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:11:43.642250    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:11:43.647692 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:11:43.647666    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:11:43.651145 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:11:43.651122    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:11:43.654779 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:11:43.654760    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 08:11:43.657233 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:11:43.657211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:13:21.481532 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.481499    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"]
Jul 12 08:13:21.484781 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.484761    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.488332 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.488305    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 08:13:21.488500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.488347    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 08:13:21.488500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.488306    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxs99\""
Jul 12 08:13:21.488500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.488437    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 08:13:21.488737 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.488719    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 08:13:21.508000 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.507966    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"]
Jul 12 08:13:21.524846 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.524807    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psnq8\" (UniqueName: \"kubernetes.io/projected/13d2c36d-b172-46f3-b761-c5c9376a807d-kube-api-access-psnq8\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.525008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.524870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13d2c36d-b172-46f3-b761-c5c9376a807d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.525008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.524896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13d2c36d-b172-46f3-b761-c5c9376a807d-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.525008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.524932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13d2c36d-b172-46f3-b761-c5c9376a807d-tmp\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.525008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.524961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/13d2c36d-b172-46f3-b761-c5c9376a807d-manifests\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.625661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.625629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/13d2c36d-b172-46f3-b761-c5c9376a807d-manifests\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.625844 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.625686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psnq8\" (UniqueName: \"kubernetes.io/projected/13d2c36d-b172-46f3-b761-c5c9376a807d-kube-api-access-psnq8\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.625844 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.625727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13d2c36d-b172-46f3-b761-c5c9376a807d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.625844 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.625742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13d2c36d-b172-46f3-b761-c5c9376a807d-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.625844 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.625775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13d2c36d-b172-46f3-b761-c5c9376a807d-tmp\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.626123 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.626055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/13d2c36d-b172-46f3-b761-c5c9376a807d-manifests\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.628211 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.628180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13d2c36d-b172-46f3-b761-c5c9376a807d-tmp\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.628403 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.628387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/13d2c36d-b172-46f3-b761-c5c9376a807d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.628532 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.628513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13d2c36d-b172-46f3-b761-c5c9376a807d-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.634129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.634105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psnq8\" (UniqueName: \"kubernetes.io/projected/13d2c36d-b172-46f3-b761-c5c9376a807d-kube-api-access-psnq8\") pod \"opendatahub-operator-controller-manager-595c444865-zfkgd\" (UID: \"13d2c36d-b172-46f3-b761-c5c9376a807d\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.795260 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.795228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:21.939556 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.939514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"]
Jul 12 08:13:21.943359 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:13:21.943332    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d2c36d_b172_46f3_b761_c5c9376a807d.slice/crio-0b48244aabb30ff71419cd810b7748846de8649051c0388f13aec0201d982c07 WatchSource:0}: Error finding container 0b48244aabb30ff71419cd810b7748846de8649051c0388f13aec0201d982c07: Status 404 returned error can't find the container with id 0b48244aabb30ff71419cd810b7748846de8649051c0388f13aec0201d982c07
Jul 12 08:13:21.945658 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:21.945638    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:13:22.706501 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:22.706450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd" event={"ID":"13d2c36d-b172-46f3-b761-c5c9376a807d","Type":"ContainerStarted","Data":"0b48244aabb30ff71419cd810b7748846de8649051c0388f13aec0201d982c07"}
Jul 12 08:13:25.723221 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:25.723129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd" event={"ID":"13d2c36d-b172-46f3-b761-c5c9376a807d","Type":"ContainerStarted","Data":"cc2673fe1071a99160529bdd43ee1311c8c4888f808e07814f0deb07de6b9907"}
Jul 12 08:13:26.729426 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:26.729388    2558 generic.go:356] "Generic (PLEG): container finished" podID="13d2c36d-b172-46f3-b761-c5c9376a807d" containerID="cc2673fe1071a99160529bdd43ee1311c8c4888f808e07814f0deb07de6b9907" exitCode=0
Jul 12 08:13:26.729820 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:26.729482    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd" event={"ID":"13d2c36d-b172-46f3-b761-c5c9376a807d","Type":"ContainerDied","Data":"cc2673fe1071a99160529bdd43ee1311c8c4888f808e07814f0deb07de6b9907"}
Jul 12 08:13:27.735858 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:27.735822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd" event={"ID":"13d2c36d-b172-46f3-b761-c5c9376a807d","Type":"ContainerStarted","Data":"0763293cb5c2c89aed0209652891ed98e16a68c3906edcce45c1e763dcc7aca0"}
Jul 12 08:13:27.736311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:27.735966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:27.756394 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:27.756347    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd" podStartSLOduration=2.300482563 podStartE2EDuration="6.756326865s" totalImagesPullingTime="3.426686194s" totalInitContainerRuntime="1.029158108s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:27.756077141 +0000 UTC m=+404.539077496" watchObservedRunningTime="2026-07-12 08:13:27.756326865 +0000 UTC m=+404.539327208"
Jul 12 08:13:38.742370 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:38.742334    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-zfkgd"
Jul 12 08:13:42.046455 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.046422    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"]
Jul 12 08:13:42.054344 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.054320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.056974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.056841    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 08:13:42.056974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.056859    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vwqgr\""
Jul 12 08:13:42.056974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.056841    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 08:13:42.056974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.056841    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 08:13:42.056974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.056841    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 08:13:42.063006 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.062981    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"]
Jul 12 08:13:42.211721 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.211673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.211721 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.211718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72t8\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-kube-api-access-j72t8\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.211931 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.211826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/520a9d75-2fc2-444e-9589-46f32e503d06-local-certs\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.211931 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.211866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-istio-token\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.211992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.211945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.211992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.211974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.212066 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.212000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-cacerts\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/520a9d75-2fc2-444e-9589-46f32e503d06-local-certs\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-istio-token\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313133    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-cacerts\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.313400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313180    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72t8\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-kube-api-access-j72t8\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.314007 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.313983    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.315633 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.315609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.315764 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.315720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-cacerts\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.315899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.315884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/520a9d75-2fc2-444e-9589-46f32e503d06-local-certs\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.315988 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.315971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.320697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.320676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-istio-token\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.320812 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.320737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72t8\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-kube-api-access-j72t8\") pod \"istiod-openshift-gateway-7574459656-nx89g\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.365359 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.365326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:42.505129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.505104    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"]
Jul 12 08:13:42.509323 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:13:42.509206    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520a9d75_2fc2_444e_9589_46f32e503d06.slice/crio-53fd0aecac81f5eaac61783a80dff2efd444f36647e0033ae105120e369624a1 WatchSource:0}: Error finding container 53fd0aecac81f5eaac61783a80dff2efd444f36647e0033ae105120e369624a1: Status 404 returned error can't find the container with id 53fd0aecac81f5eaac61783a80dff2efd444f36647e0033ae105120e369624a1
Jul 12 08:13:42.804613 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:42.804584    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" event={"ID":"520a9d75-2fc2-444e-9589-46f32e503d06","Type":"ContainerStarted","Data":"53fd0aecac81f5eaac61783a80dff2efd444f36647e0033ae105120e369624a1"}
Jul 12 08:13:44.863179 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:44.863140    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:13:44.863437 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:44.863217    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:13:45.820913 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:45.820872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" event={"ID":"520a9d75-2fc2-444e-9589-46f32e503d06","Type":"ContainerStarted","Data":"cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37"}
Jul 12 08:13:45.821131 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:45.821065    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:45.822602 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:45.822578    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nx89g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 08:13:45.822699 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:45.822621    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" podUID="520a9d75-2fc2-444e-9589-46f32e503d06" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 08:13:45.844551 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:45.844490    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" podStartSLOduration=1.492611317 podStartE2EDuration="3.844469064s" totalImagesPullingTime="2.351857747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:45.84322294 +0000 UTC m=+422.626223285" watchObservedRunningTime="2026-07-12 08:13:45.844469064 +0000 UTC m=+422.627469408"
Jul 12 08:13:46.826510 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:46.826480    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:49.700190 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.700149    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"]
Jul 12 08:13:49.704055 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.704036    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.706525 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.706501    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 08:13:49.706627 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.706606    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 08:13:49.707565 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.707546    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 08:13:49.707735 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.707591    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 08:13:49.707839 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.707810    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 08:13:49.707972 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.707955    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2qg5q\""
Jul 12 08:13:49.715105 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.715084    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"]
Jul 12 08:13:49.878109 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.878063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a757b48-9848-4a33-9055-45e374dfc8d3-metrics-cert\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.878109 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.878111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a757b48-9848-4a33-9055-45e374dfc8d3-manager-config\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.878426 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.878202    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77j7k\" (UniqueName: \"kubernetes.io/projected/2a757b48-9848-4a33-9055-45e374dfc8d3-kube-api-access-77j7k\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.878426 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.878325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a757b48-9848-4a33-9055-45e374dfc8d3-cert\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.979458 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.979365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j7k\" (UniqueName: \"kubernetes.io/projected/2a757b48-9848-4a33-9055-45e374dfc8d3-kube-api-access-77j7k\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.979458 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.979430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a757b48-9848-4a33-9055-45e374dfc8d3-cert\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.979720 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.979472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a757b48-9848-4a33-9055-45e374dfc8d3-metrics-cert\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.979720 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.979493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a757b48-9848-4a33-9055-45e374dfc8d3-manager-config\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.980122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.980101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2a757b48-9848-4a33-9055-45e374dfc8d3-manager-config\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.982108 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.982086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a757b48-9848-4a33-9055-45e374dfc8d3-metrics-cert\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.982200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.982136    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a757b48-9848-4a33-9055-45e374dfc8d3-cert\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:49.987266 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:49.987245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77j7k\" (UniqueName: \"kubernetes.io/projected/2a757b48-9848-4a33-9055-45e374dfc8d3-kube-api-access-77j7k\") pod \"lws-controller-manager-59795878b4-85gm8\" (UID: \"2a757b48-9848-4a33-9055-45e374dfc8d3\") " pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:50.013939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:50.013904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:50.166973 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:50.166939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"]
Jul 12 08:13:50.170343 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:13:50.170314    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a757b48_9848_4a33_9055_45e374dfc8d3.slice/crio-7c73af77dd9b58accf5364aae1aaedede2c691b04a38c7dd1cd8be61b0372bdd WatchSource:0}: Error finding container 7c73af77dd9b58accf5364aae1aaedede2c691b04a38c7dd1cd8be61b0372bdd: Status 404 returned error can't find the container with id 7c73af77dd9b58accf5364aae1aaedede2c691b04a38c7dd1cd8be61b0372bdd
Jul 12 08:13:50.845813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:50.845764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8" event={"ID":"2a757b48-9848-4a33-9055-45e374dfc8d3","Type":"ContainerStarted","Data":"7c73af77dd9b58accf5364aae1aaedede2c691b04a38c7dd1cd8be61b0372bdd"}
Jul 12 08:13:52.856880 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:52.856843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8" event={"ID":"2a757b48-9848-4a33-9055-45e374dfc8d3","Type":"ContainerStarted","Data":"8263b72a7af72fa57bd1d4b775427e9ebfed122b456b6811dbc5d7231bbbb8e1"}
Jul 12 08:13:52.857397 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:52.856925    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:13:52.880435 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:52.880335    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8" podStartSLOduration=1.430933757 podStartE2EDuration="3.880316703s" totalImagesPullingTime="2.449382946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:52.879228788 +0000 UTC m=+429.662229133" watchObservedRunningTime="2026-07-12 08:13:52.880316703 +0000 UTC m=+429.663317047"
Jul 12 08:13:53.895263 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:53.895225    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"]
Jul 12 08:13:53.895681 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:53.895440    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" podUID="520a9d75-2fc2-444e-9589-46f32e503d06" containerName="discovery" containerID="cri-o://cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37" gracePeriod=30
Jul 12 08:13:54.143481 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.143450    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:54.321490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321455    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-ca-configmap\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.321665 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321505    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-kubeconfig\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.321665 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321545    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/520a9d75-2fc2-444e-9589-46f32e503d06-local-certs\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.321665 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-istio-token\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.321832 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321717    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-dns-cert\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.321832 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321757    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j72t8\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-kube-api-access-j72t8\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.321832 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-cacerts\") pod \"520a9d75-2fc2-444e-9589-46f32e503d06\" (UID: \"520a9d75-2fc2-444e-9589-46f32e503d06\") "
Jul 12 08:13:54.322001 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.321904    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:13:54.322128 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.322106    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-ca-configmap\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.324235 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.324191    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-cacerts" (OuterVolumeSpecName: "cacerts") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:13:54.324377 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.324314    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-istio-token" (OuterVolumeSpecName: "istio-token") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:13:54.324520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.324483    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/520a9d75-2fc2-444e-9589-46f32e503d06-local-certs" (OuterVolumeSpecName: "local-certs") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:13:54.324636 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.324548    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-kube-api-access-j72t8" (OuterVolumeSpecName: "kube-api-access-j72t8") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "kube-api-access-j72t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:13:54.324636 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.324560    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:13:54.324636 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.324585    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "520a9d75-2fc2-444e-9589-46f32e503d06" (UID: "520a9d75-2fc2-444e-9589-46f32e503d06"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:13:54.423547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.423509    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-kubeconfig\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.423547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.423538    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/520a9d75-2fc2-444e-9589-46f32e503d06-local-certs\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.423547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.423548    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-istio-token\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.423547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.423556    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-istio-csr-dns-cert\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.423815 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.423565    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j72t8\" (UniqueName: \"kubernetes.io/projected/520a9d75-2fc2-444e-9589-46f32e503d06-kube-api-access-j72t8\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.423815 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.423576    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/520a9d75-2fc2-444e-9589-46f32e503d06-cacerts\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:13:54.867746 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.867711    2558 generic.go:356] "Generic (PLEG): container finished" podID="520a9d75-2fc2-444e-9589-46f32e503d06" containerID="cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37" exitCode=0
Jul 12 08:13:54.867918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.867763    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"
Jul 12 08:13:54.867918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.867800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" event={"ID":"520a9d75-2fc2-444e-9589-46f32e503d06","Type":"ContainerDied","Data":"cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37"}
Jul 12 08:13:54.867918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.867858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nx89g" event={"ID":"520a9d75-2fc2-444e-9589-46f32e503d06","Type":"ContainerDied","Data":"53fd0aecac81f5eaac61783a80dff2efd444f36647e0033ae105120e369624a1"}
Jul 12 08:13:54.867918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.867885    2558 scope.go:117] "RemoveContainer" containerID="cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37"
Jul 12 08:13:54.877063 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.877043    2558 scope.go:117] "RemoveContainer" containerID="cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37"
Jul 12 08:13:54.877405 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:13:54.877386    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37\": container with ID starting with cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37 not found: ID does not exist" containerID="cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37"
Jul 12 08:13:54.877450 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.877415    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37"} err="failed to get container status \"cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37\": rpc error: code = NotFound desc = could not find container \"cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37\": container with ID starting with cc619e664072790e05bd8486f623d466156760a714c0610ed2d0dbbb2ab76e37 not found: ID does not exist"
Jul 12 08:13:54.888598 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.888577    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"]
Jul 12 08:13:54.891675 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:54.891653    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nx89g"]
Jul 12 08:13:55.755553 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:13:55.755520    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="520a9d75-2fc2-444e-9589-46f32e503d06" path="/var/lib/kubelet/pods/520a9d75-2fc2-444e-9589-46f32e503d06/volumes"
Jul 12 08:14:03.864819 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:03.864777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59795878b4-85gm8"
Jul 12 08:14:41.996986 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:41.996950    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f79kk"]
Jul 12 08:14:41.997574 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:41.997473    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="520a9d75-2fc2-444e-9589-46f32e503d06" containerName="discovery"
Jul 12 08:14:41.997574 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:41.997494    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="520a9d75-2fc2-444e-9589-46f32e503d06" containerName="discovery"
Jul 12 08:14:41.997697 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:41.997633    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="520a9d75-2fc2-444e-9589-46f32e503d06" containerName="discovery"
Jul 12 08:14:42.000550 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.000527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:42.002686 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.002662    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 08:14:42.003522 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.003503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-plccf\""
Jul 12 08:14:42.003661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.003526    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 08:14:42.010948 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.010923    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f79kk"]
Jul 12 08:14:42.048956 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.048925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gj4m\" (UniqueName: \"kubernetes.io/projected/0837b300-78cc-4a03-97bb-9cfa7732250c-kube-api-access-8gj4m\") pod \"kuadrant-operator-catalog-f79kk\" (UID: \"0837b300-78cc-4a03-97bb-9cfa7732250c\") " pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:42.149411 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.149368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gj4m\" (UniqueName: \"kubernetes.io/projected/0837b300-78cc-4a03-97bb-9cfa7732250c-kube-api-access-8gj4m\") pod \"kuadrant-operator-catalog-f79kk\" (UID: \"0837b300-78cc-4a03-97bb-9cfa7732250c\") " pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:42.157164 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.157135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gj4m\" (UniqueName: \"kubernetes.io/projected/0837b300-78cc-4a03-97bb-9cfa7732250c-kube-api-access-8gj4m\") pod \"kuadrant-operator-catalog-f79kk\" (UID: \"0837b300-78cc-4a03-97bb-9cfa7732250c\") " pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:42.311362 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.311320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:42.442935 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.442862    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f79kk"]
Jul 12 08:14:42.445455 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:14:42.445426    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0837b300_78cc_4a03_97bb_9cfa7732250c.slice/crio-2125c76c4e0cc45559b43f20a2a72e8f267c0cf46f0d9b9a66bd1b92ba42b640 WatchSource:0}: Error finding container 2125c76c4e0cc45559b43f20a2a72e8f267c0cf46f0d9b9a66bd1b92ba42b640: Status 404 returned error can't find the container with id 2125c76c4e0cc45559b43f20a2a72e8f267c0cf46f0d9b9a66bd1b92ba42b640
Jul 12 08:14:42.509052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.509016    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f79kk"]
Jul 12 08:14:42.582874 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.580263    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjmtn"]
Jul 12 08:14:42.586329 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.586299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:42.589026 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.588998    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjmtn"]
Jul 12 08:14:42.653304 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.653249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlf7v\" (UniqueName: \"kubernetes.io/projected/17967d60-bfee-476f-8136-083311fe35d2-kube-api-access-tlf7v\") pod \"kuadrant-operator-catalog-sjmtn\" (UID: \"17967d60-bfee-476f-8136-083311fe35d2\") " pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:42.754203 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.754163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlf7v\" (UniqueName: \"kubernetes.io/projected/17967d60-bfee-476f-8136-083311fe35d2-kube-api-access-tlf7v\") pod \"kuadrant-operator-catalog-sjmtn\" (UID: \"17967d60-bfee-476f-8136-083311fe35d2\") " pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:42.761992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.761964    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlf7v\" (UniqueName: \"kubernetes.io/projected/17967d60-bfee-476f-8136-083311fe35d2-kube-api-access-tlf7v\") pod \"kuadrant-operator-catalog-sjmtn\" (UID: \"17967d60-bfee-476f-8136-083311fe35d2\") " pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:42.897933 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:42.897835    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:43.040924 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:43.040892    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sjmtn"]
Jul 12 08:14:43.043687 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:14:43.043651    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17967d60_bfee_476f_8136_083311fe35d2.slice/crio-62ca44dc671e74eef95ef6f3b8ec12c1ff327b2592d97638d54d089f37c2703a WatchSource:0}: Error finding container 62ca44dc671e74eef95ef6f3b8ec12c1ff327b2592d97638d54d089f37c2703a: Status 404 returned error can't find the container with id 62ca44dc671e74eef95ef6f3b8ec12c1ff327b2592d97638d54d089f37c2703a
Jul 12 08:14:43.081254 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:43.081214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn" event={"ID":"17967d60-bfee-476f-8136-083311fe35d2","Type":"ContainerStarted","Data":"62ca44dc671e74eef95ef6f3b8ec12c1ff327b2592d97638d54d089f37c2703a"}
Jul 12 08:14:43.082456 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:43.082432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f79kk" event={"ID":"0837b300-78cc-4a03-97bb-9cfa7732250c","Type":"ContainerStarted","Data":"2125c76c4e0cc45559b43f20a2a72e8f267c0cf46f0d9b9a66bd1b92ba42b640"}
Jul 12 08:14:45.093726 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.093685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f79kk" event={"ID":"0837b300-78cc-4a03-97bb-9cfa7732250c","Type":"ContainerStarted","Data":"98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122"}
Jul 12 08:14:45.093726 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.093703    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-f79kk" podUID="0837b300-78cc-4a03-97bb-9cfa7732250c" containerName="registry-server" containerID="cri-o://98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122" gracePeriod=2
Jul 12 08:14:45.095375 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.095353    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn" event={"ID":"17967d60-bfee-476f-8136-083311fe35d2","Type":"ContainerStarted","Data":"9a5cc3f3f6c868318dd2d7f2efd80d46e992a2169af90ef2e58df4e63f76bb52"}
Jul 12 08:14:45.108842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.108789    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f79kk" podStartSLOduration=1.979970641 podStartE2EDuration="4.108772063s" totalImagesPullingTime="2.128801422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:14:45.107707575 +0000 UTC m=+481.890707920" watchObservedRunningTime="2026-07-12 08:14:45.108772063 +0000 UTC m=+481.891772406"
Jul 12 08:14:45.123691 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.123646    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn" podStartSLOduration=1.590209556 podStartE2EDuration="3.123629056s" totalImagesPullingTime="1.5334195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:14:45.122216646 +0000 UTC m=+481.905216982" watchObservedRunningTime="2026-07-12 08:14:45.123629056 +0000 UTC m=+481.906629426"
Jul 12 08:14:45.340564 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.340540    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:45.376674 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.376594    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gj4m\" (UniqueName: \"kubernetes.io/projected/0837b300-78cc-4a03-97bb-9cfa7732250c-kube-api-access-8gj4m\") pod \"0837b300-78cc-4a03-97bb-9cfa7732250c\" (UID: \"0837b300-78cc-4a03-97bb-9cfa7732250c\") "
Jul 12 08:14:45.378951 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.378925    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0837b300-78cc-4a03-97bb-9cfa7732250c-kube-api-access-8gj4m" (OuterVolumeSpecName: "kube-api-access-8gj4m") pod "0837b300-78cc-4a03-97bb-9cfa7732250c" (UID: "0837b300-78cc-4a03-97bb-9cfa7732250c"). InnerVolumeSpecName "kube-api-access-8gj4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:14:45.477667 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:45.477633    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gj4m\" (UniqueName: \"kubernetes.io/projected/0837b300-78cc-4a03-97bb-9cfa7732250c-kube-api-access-8gj4m\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:14:46.106514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.106477    2558 generic.go:356] "Generic (PLEG): container finished" podID="0837b300-78cc-4a03-97bb-9cfa7732250c" containerID="98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122" exitCode=0
Jul 12 08:14:46.106945 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.106540    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f79kk"
Jul 12 08:14:46.106945 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.106560    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f79kk" event={"ID":"0837b300-78cc-4a03-97bb-9cfa7732250c","Type":"ContainerDied","Data":"98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122"}
Jul 12 08:14:46.106945 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.106645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f79kk" event={"ID":"0837b300-78cc-4a03-97bb-9cfa7732250c","Type":"ContainerDied","Data":"2125c76c4e0cc45559b43f20a2a72e8f267c0cf46f0d9b9a66bd1b92ba42b640"}
Jul 12 08:14:46.106945 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.106676    2558 scope.go:117] "RemoveContainer" containerID="98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122"
Jul 12 08:14:46.116128 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.116104    2558 scope.go:117] "RemoveContainer" containerID="98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122"
Jul 12 08:14:46.116574 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:14:46.116534    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122\": container with ID starting with 98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122 not found: ID does not exist" containerID="98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122"
Jul 12 08:14:46.116661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.116621    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122"} err="failed to get container status \"98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122\": rpc error: code = NotFound desc = could not find container \"98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122\": container with ID starting with 98064f5caaabe33a8166c24464fffea5aa805d4a047939c706b2902a2c60c122 not found: ID does not exist"
Jul 12 08:14:46.122238 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.122217    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f79kk"]
Jul 12 08:14:46.127843 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:46.127821    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f79kk"]
Jul 12 08:14:47.755412 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:47.755374    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0837b300-78cc-4a03-97bb-9cfa7732250c" path="/var/lib/kubelet/pods/0837b300-78cc-4a03-97bb-9cfa7732250c/volumes"
Jul 12 08:14:52.898652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:52.898606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:52.899046 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:52.898674    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:52.921670 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:52.921646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:14:53.163103 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:14:53.163017    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sjmtn"
Jul 12 08:15:13.404020 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.403983    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"]
Jul 12 08:15:13.404431 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.404371    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0837b300-78cc-4a03-97bb-9cfa7732250c" containerName="registry-server"
Jul 12 08:15:13.404431 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.404384    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0837b300-78cc-4a03-97bb-9cfa7732250c" containerName="registry-server"
Jul 12 08:15:13.404500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.404472    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0837b300-78cc-4a03-97bb-9cfa7732250c" containerName="registry-server"
Jul 12 08:15:13.410853 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.410837    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:13.413249 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.413224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bb65w\""
Jul 12 08:15:13.413505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.413488    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 12 08:15:13.418337 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.418313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"]
Jul 12 08:15:13.521468 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.521433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d64l\" (UniqueName: \"kubernetes.io/projected/40da0f5c-df8a-4427-93d2-8065dee6f6b5-kube-api-access-5d64l\") pod \"dns-operator-controller-manager-864dd78c4c-td4m7\" (UID: \"40da0f5c-df8a-4427-93d2-8065dee6f6b5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:13.622862 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.622826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d64l\" (UniqueName: \"kubernetes.io/projected/40da0f5c-df8a-4427-93d2-8065dee6f6b5-kube-api-access-5d64l\") pod \"dns-operator-controller-manager-864dd78c4c-td4m7\" (UID: \"40da0f5c-df8a-4427-93d2-8065dee6f6b5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:13.634045 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.634016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d64l\" (UniqueName: \"kubernetes.io/projected/40da0f5c-df8a-4427-93d2-8065dee6f6b5-kube-api-access-5d64l\") pod \"dns-operator-controller-manager-864dd78c4c-td4m7\" (UID: \"40da0f5c-df8a-4427-93d2-8065dee6f6b5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:13.721813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.721714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:13.859862 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:13.859837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"]
Jul 12 08:15:13.862754 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:15:13.862730    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40da0f5c_df8a_4427_93d2_8065dee6f6b5.slice/crio-dd2896e6882a7217ffc8860e4c1a0c834d57bf8b387836ceab4ace5610000a02 WatchSource:0}: Error finding container dd2896e6882a7217ffc8860e4c1a0c834d57bf8b387836ceab4ace5610000a02: Status 404 returned error can't find the container with id dd2896e6882a7217ffc8860e4c1a0c834d57bf8b387836ceab4ace5610000a02
Jul 12 08:15:14.236190 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:14.236148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7" event={"ID":"40da0f5c-df8a-4427-93d2-8065dee6f6b5","Type":"ContainerStarted","Data":"dd2896e6882a7217ffc8860e4c1a0c834d57bf8b387836ceab4ace5610000a02"}
Jul 12 08:15:16.248488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.248406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7" event={"ID":"40da0f5c-df8a-4427-93d2-8065dee6f6b5","Type":"ContainerStarted","Data":"0ddff561269bc64a12be975ee36e8db376f282904f9a8c44fda6f7f4a59e1cfe"}
Jul 12 08:15:16.248488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.248470    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:16.266550 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.266500    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7" podStartSLOduration=1.3604504720000001 podStartE2EDuration="3.266482794s" totalImagesPullingTime="1.906032322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:16.266059362 +0000 UTC m=+513.049059734" watchObservedRunningTime="2026-07-12 08:15:16.266482794 +0000 UTC m=+513.049483138"
Jul 12 08:15:16.868217 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.868169    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"]
Jul 12 08:15:16.871630 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.871614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:16.874117 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.874091    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-82frv\""
Jul 12 08:15:16.880241 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.880214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"]
Jul 12 08:15:16.956738 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:16.956700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdxr\" (UniqueName: \"kubernetes.io/projected/853360b2-afa3-42b2-8b5c-5ecac5d4c596-kube-api-access-zrdxr\") pod \"limitador-operator-controller-manager-859d7b78bd-7r59m\" (UID: \"853360b2-afa3-42b2-8b5c-5ecac5d4c596\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:17.058147 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:17.058116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdxr\" (UniqueName: \"kubernetes.io/projected/853360b2-afa3-42b2-8b5c-5ecac5d4c596-kube-api-access-zrdxr\") pod \"limitador-operator-controller-manager-859d7b78bd-7r59m\" (UID: \"853360b2-afa3-42b2-8b5c-5ecac5d4c596\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:17.069818 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:17.069790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdxr\" (UniqueName: \"kubernetes.io/projected/853360b2-afa3-42b2-8b5c-5ecac5d4c596-kube-api-access-zrdxr\") pod \"limitador-operator-controller-manager-859d7b78bd-7r59m\" (UID: \"853360b2-afa3-42b2-8b5c-5ecac5d4c596\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:17.182225 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:17.182151    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:17.323927 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:17.323899    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"]
Jul 12 08:15:17.326772 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:15:17.326741    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853360b2_afa3_42b2_8b5c_5ecac5d4c596.slice/crio-b14fc125cd153506f93757e1f9e2b48a793ac1f5bb45164974e4f6a8bb3e9865 WatchSource:0}: Error finding container b14fc125cd153506f93757e1f9e2b48a793ac1f5bb45164974e4f6a8bb3e9865: Status 404 returned error can't find the container with id b14fc125cd153506f93757e1f9e2b48a793ac1f5bb45164974e4f6a8bb3e9865
Jul 12 08:15:18.262228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:18.262190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m" event={"ID":"853360b2-afa3-42b2-8b5c-5ecac5d4c596","Type":"ContainerStarted","Data":"b14fc125cd153506f93757e1f9e2b48a793ac1f5bb45164974e4f6a8bb3e9865"}
Jul 12 08:15:19.268746 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:19.268656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m" event={"ID":"853360b2-afa3-42b2-8b5c-5ecac5d4c596","Type":"ContainerStarted","Data":"975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c"}
Jul 12 08:15:19.268746 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:19.268733    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:19.284891 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:19.284838    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m" podStartSLOduration=1.636683175 podStartE2EDuration="3.284823206s" totalImagesPullingTime="1.648140031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:19.28292593 +0000 UTC m=+516.065926274" watchObservedRunningTime="2026-07-12 08:15:19.284823206 +0000 UTC m=+516.067823601"
Jul 12 08:15:20.796808 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:20.796771    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"]
Jul 12 08:15:20.800201 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:20.800184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:20.802436 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:20.802415    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fd58p\""
Jul 12 08:15:20.808660 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:20.808636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"]
Jul 12 08:15:20.893200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:20.893158    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5xs\" (UniqueName: \"kubernetes.io/projected/9a5570b9-7d70-4e52-b5f3-4cf2f0587c05-kube-api-access-gp5xs\") pod \"authorino-operator-75cc8d5cb7-fhnd5\" (UID: \"9a5570b9-7d70-4e52-b5f3-4cf2f0587c05\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:20.994106 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:20.994068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5xs\" (UniqueName: \"kubernetes.io/projected/9a5570b9-7d70-4e52-b5f3-4cf2f0587c05-kube-api-access-gp5xs\") pod \"authorino-operator-75cc8d5cb7-fhnd5\" (UID: \"9a5570b9-7d70-4e52-b5f3-4cf2f0587c05\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:21.002680 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:21.002649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5xs\" (UniqueName: \"kubernetes.io/projected/9a5570b9-7d70-4e52-b5f3-4cf2f0587c05-kube-api-access-gp5xs\") pod \"authorino-operator-75cc8d5cb7-fhnd5\" (UID: \"9a5570b9-7d70-4e52-b5f3-4cf2f0587c05\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:21.111507 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:21.111419    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:21.255154 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:21.255125    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"]
Jul 12 08:15:21.257752 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:15:21.257725    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5570b9_7d70_4e52_b5f3_4cf2f0587c05.slice/crio-6fc4f45e0183238cc31da4a7a93c4b2d33f7daa577b307bdb35e8301383f3825 WatchSource:0}: Error finding container 6fc4f45e0183238cc31da4a7a93c4b2d33f7daa577b307bdb35e8301383f3825: Status 404 returned error can't find the container with id 6fc4f45e0183238cc31da4a7a93c4b2d33f7daa577b307bdb35e8301383f3825
Jul 12 08:15:21.281027 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:21.280998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5" event={"ID":"9a5570b9-7d70-4e52-b5f3-4cf2f0587c05","Type":"ContainerStarted","Data":"6fc4f45e0183238cc31da4a7a93c4b2d33f7daa577b307bdb35e8301383f3825"}
Jul 12 08:15:24.298306 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:24.298238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5" event={"ID":"9a5570b9-7d70-4e52-b5f3-4cf2f0587c05","Type":"ContainerStarted","Data":"9a4df0907ae95d0c7701cadb194d438a974285ddece02819808211a0645ec418"}
Jul 12 08:15:24.298743 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:24.298336    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:24.316691 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:24.316631    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5" podStartSLOduration=2.190491034 podStartE2EDuration="4.316614017s" totalImagesPullingTime="2.126122983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:24.315514001 +0000 UTC m=+521.098514347" watchObservedRunningTime="2026-07-12 08:15:24.316614017 +0000 UTC m=+521.099614361"
Jul 12 08:15:27.257984 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:27.257953    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-td4m7"
Jul 12 08:15:30.278148 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:30.278117    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:33.969603 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:33.969567    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"]
Jul 12 08:15:33.973228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:33.973205    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:33.975222 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:33.975200    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 12 08:15:33.975537 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:33.975516    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ppmvh\""
Jul 12 08:15:33.975641 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:33.975618    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 12 08:15:33.979327 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:33.979298    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"]
Jul 12 08:15:34.002419 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.002390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f645e32-a22f-444d-b62e-11cfeebfd70d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.002584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.002428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6f645e32-a22f-444d-b62e-11cfeebfd70d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.002584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.002452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4vpf\" (UniqueName: \"kubernetes.io/projected/6f645e32-a22f-444d-b62e-11cfeebfd70d-kube-api-access-s4vpf\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.103640 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.103602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4vpf\" (UniqueName: \"kubernetes.io/projected/6f645e32-a22f-444d-b62e-11cfeebfd70d-kube-api-access-s4vpf\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.103826 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.103707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f645e32-a22f-444d-b62e-11cfeebfd70d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.103826 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.103736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6f645e32-a22f-444d-b62e-11cfeebfd70d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.103921 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:34.103836    2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 12 08:15:34.103921 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:34.103905    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f645e32-a22f-444d-b62e-11cfeebfd70d-plugin-serving-cert podName:6f645e32-a22f-444d-b62e-11cfeebfd70d nodeName:}" failed. No retries permitted until 2026-07-12 08:15:34.603889324 +0000 UTC m=+531.386889650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6f645e32-a22f-444d-b62e-11cfeebfd70d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-cg7lv" (UID: "6f645e32-a22f-444d-b62e-11cfeebfd70d") : secret "plugin-serving-cert" not found
Jul 12 08:15:34.104309 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.104293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6f645e32-a22f-444d-b62e-11cfeebfd70d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.112261 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.112236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4vpf\" (UniqueName: \"kubernetes.io/projected/6f645e32-a22f-444d-b62e-11cfeebfd70d-kube-api-access-s4vpf\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.606729 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.606688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f645e32-a22f-444d-b62e-11cfeebfd70d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.609253 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.609227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f645e32-a22f-444d-b62e-11cfeebfd70d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cg7lv\" (UID: \"6f645e32-a22f-444d-b62e-11cfeebfd70d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:34.893501 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:34.893383    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"
Jul 12 08:15:35.028922 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:35.028884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv"]
Jul 12 08:15:35.034418 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:15:35.034393    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f645e32_a22f_444d_b62e_11cfeebfd70d.slice/crio-0935c78b20117eb09a29199eae6da12524506102cb9d26561db2d4dcda4cbf34 WatchSource:0}: Error finding container 0935c78b20117eb09a29199eae6da12524506102cb9d26561db2d4dcda4cbf34: Status 404 returned error can't find the container with id 0935c78b20117eb09a29199eae6da12524506102cb9d26561db2d4dcda4cbf34
Jul 12 08:15:35.306403 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:35.306371    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fhnd5"
Jul 12 08:15:35.357050 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:35.357014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv" event={"ID":"6f645e32-a22f-444d-b62e-11cfeebfd70d","Type":"ContainerStarted","Data":"0935c78b20117eb09a29199eae6da12524506102cb9d26561db2d4dcda4cbf34"}
Jul 12 08:15:43.313638 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.313603    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"]
Jul 12 08:15:43.317413 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.317384    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.319890 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.319869    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4m58q\""
Jul 12 08:15:43.330203 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.330177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"]
Jul 12 08:15:43.382582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.382549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdp8\" (UniqueName: \"kubernetes.io/projected/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-kube-api-access-qjdp8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.382765 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.382601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.483830 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.483787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdp8\" (UniqueName: \"kubernetes.io/projected/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-kube-api-access-qjdp8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.484031 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.483850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.484251 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.484228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.495034 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.495004    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdp8\" (UniqueName: \"kubernetes.io/projected/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-kube-api-access-qjdp8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:43.632692 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.632607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4m58q\""
Jul 12 08:15:43.640513 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:43.640486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:15:44.155262 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.155223    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"]
Jul 12 08:15:44.161328 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.161295    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"]
Jul 12 08:15:44.190984 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.190888    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"]
Jul 12 08:15:44.198762 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.198167    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"]
Jul 12 08:15:44.198762 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.198396    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" containerName="manager" containerID="cri-o://975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c" gracePeriod=2
Jul 12 08:15:44.198762 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.198614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.203328 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.203297    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"]
Jul 12 08:15:44.209661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.209631    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"]
Jul 12 08:15:44.230724 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:44.230670    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7r59m\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:44.232469 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:44.232424    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7r59m\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:44.290758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.290725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nsx\" (UniqueName: \"kubernetes.io/projected/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-kube-api-access-t9nsx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jww2v\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.290939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.290859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jww2v\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.391747 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.391698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nsx\" (UniqueName: \"kubernetes.io/projected/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-kube-api-access-t9nsx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jww2v\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.392241 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.391795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jww2v\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.392316 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.392239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jww2v\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.400962 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.400931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nsx\" (UniqueName: \"kubernetes.io/projected/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-kube-api-access-t9nsx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jww2v\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:44.563524 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:44.563486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:15:56.539141 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.539108    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"]
Jul 12 08:15:56.730684 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.730645    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"]
Jul 12 08:15:56.731086 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.731068    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" containerName="manager"
Jul 12 08:15:56.731086 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.731085    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" containerName="manager"
Jul 12 08:15:56.731243 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.731137    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" containerName="manager"
Jul 12 08:15:56.771446 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.771402    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"]
Jul 12 08:15:56.771634 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.771549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:56.913042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.912952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bmhr\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:56.913194 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:56.913114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtp44\" (UniqueName: \"kubernetes.io/projected/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-kube-api-access-rtp44\") pod \"kuadrant-operator-controller-manager-86878c769f-6bmhr\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:57.014234 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.014196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bmhr\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:57.014438 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.014303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtp44\" (UniqueName: \"kubernetes.io/projected/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-kube-api-access-rtp44\") pod \"kuadrant-operator-controller-manager-86878c769f-6bmhr\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:57.014615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.014593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bmhr\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:57.025355 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.025330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtp44\" (UniqueName: \"kubernetes.io/projected/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-kube-api-access-rtp44\") pod \"kuadrant-operator-controller-manager-86878c769f-6bmhr\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:57.084758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.084712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:15:57.876407 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.876370    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:57.878507 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:57.878460    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7r59m\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:57.897542 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.897515    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"]
Jul 12 08:15:57.899086 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:15:57.899058    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e82f7f_a98d_4942_a9c3_3ce42c1e58d6.slice/crio-a5f1eafd419987b1a67589860c887318c682ec01bc60dbefbc18f995eebcedb9 WatchSource:0}: Error finding container a5f1eafd419987b1a67589860c887318c682ec01bc60dbefbc18f995eebcedb9: Status 404 returned error can't find the container with id a5f1eafd419987b1a67589860c887318c682ec01bc60dbefbc18f995eebcedb9
Jul 12 08:15:57.923947 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.923916    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrdxr\" (UniqueName: \"kubernetes.io/projected/853360b2-afa3-42b2-8b5c-5ecac5d4c596-kube-api-access-zrdxr\") pod \"853360b2-afa3-42b2-8b5c-5ecac5d4c596\" (UID: \"853360b2-afa3-42b2-8b5c-5ecac5d4c596\") "
Jul 12 08:15:57.925978 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.925958    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853360b2-afa3-42b2-8b5c-5ecac5d4c596-kube-api-access-zrdxr" (OuterVolumeSpecName: "kube-api-access-zrdxr") pod "853360b2-afa3-42b2-8b5c-5ecac5d4c596" (UID: "853360b2-afa3-42b2-8b5c-5ecac5d4c596"). InnerVolumeSpecName "kube-api-access-zrdxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:15:57.926318 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:57.926298    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"]
Jul 12 08:15:57.927977 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:15:57.927956    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7b4fe8_b901_411b_93cc_180c5dc8b1c5.slice/crio-90221ecd7451659d6de0a184d8cf6963223ede199e67427157c614e15086cdd3 WatchSource:0}: Error finding container 90221ecd7451659d6de0a184d8cf6963223ede199e67427157c614e15086cdd3: Status 404 returned error can't find the container with id 90221ecd7451659d6de0a184d8cf6963223ede199e67427157c614e15086cdd3
Jul 12 08:15:58.024665 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.024633    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrdxr\" (UniqueName: \"kubernetes.io/projected/853360b2-afa3-42b2-8b5c-5ecac5d4c596-kube-api-access-zrdxr\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:15:58.490941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.490853    2558 generic.go:356] "Generic (PLEG): container finished" podID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" containerID="975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c" exitCode=0
Jul 12 08:15:58.491120 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.490968    2558 scope.go:117] "RemoveContainer" containerID="975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c"
Jul 12 08:15:58.491187 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.491124    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:58.493731 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:58.493695    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7r59m\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:58.494741 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.494705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv" event={"ID":"6f645e32-a22f-444d-b62e-11cfeebfd70d","Type":"ContainerStarted","Data":"6fcd6e150659ffd1ed394ddb7d4913644cec731b62bebaa329c723b1174833ab"}
Jul 12 08:15:58.496846 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:58.496818    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7r59m\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:58.497230 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.497202    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v" event={"ID":"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5","Type":"ContainerStarted","Data":"90221ecd7451659d6de0a184d8cf6963223ede199e67427157c614e15086cdd3"}
Jul 12 08:15:58.501464 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.501441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr" event={"ID":"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6","Type":"ContainerStarted","Data":"a5f1eafd419987b1a67589860c887318c682ec01bc60dbefbc18f995eebcedb9"}
Jul 12 08:15:58.512256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.512227    2558 scope.go:117] "RemoveContainer" containerID="975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c"
Jul 12 08:15:58.512812 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:58.512704    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c\": container with ID starting with 975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c not found: ID does not exist" containerID="975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c"
Jul 12 08:15:58.512812 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.512744    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c"} err="failed to get container status \"975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c\": rpc error: code = NotFound desc = could not find container \"975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c\": container with ID starting with 975f53002db2573709aea56d8a6a61b877815e033201204d2baf5a5d40a7fa9c not found: ID does not exist"
Jul 12 08:15:58.516016 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:58.515845    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cg7lv" podStartSLOduration=2.729684262 podStartE2EDuration="25.515827131s" totalImagesPullingTime="22.786142869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:58.515258565 +0000 UTC m=+555.298258909" watchObservedRunningTime="2026-07-12 08:15:58.515827131 +0000 UTC m=+555.298827476"
Jul 12 08:15:58.517179 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:15:58.517135    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7r59m\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7r59m"
Jul 12 08:15:59.756806 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:15:59.756736    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853360b2-afa3-42b2-8b5c-5ecac5d4c596" path="/var/lib/kubelet/pods/853360b2-afa3-42b2-8b5c-5ecac5d4c596/volumes"
Jul 12 08:16:00.253621 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:00.253574    2558 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-vhvpk_kuadrant-system_97df2f20-66a7-4c23-af6e-a1c5b5dccd22_0(70727acd50d361e4905b0b1c137639fd494dc99c15f244f07bb5c1c81808690d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-vhvpk to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 12 08:16:00.253722 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:00.253650    2558 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-vhvpk_kuadrant-system_97df2f20-66a7-4c23-af6e-a1c5b5dccd22_0(70727acd50d361e4905b0b1c137639fd494dc99c15f244f07bb5c1c81808690d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-vhvpk to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:00.517309 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.517201    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:00.519334 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:00.519302    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="97df2f20-66a7-4c23-af6e-a1c5b5dccd22" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:00.527564 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.527539    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:00.529651 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:00.529615    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="97df2f20-66a7-4c23-af6e-a1c5b5dccd22" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:00.649896 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.649857    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjdp8\" (UniqueName: \"kubernetes.io/projected/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-kube-api-access-qjdp8\") pod \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") "
Jul 12 08:16:00.650080 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.649935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-extensions-socket-volume\") pod \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\" (UID: \"97df2f20-66a7-4c23-af6e-a1c5b5dccd22\") "
Jul 12 08:16:00.650537 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.650511    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97df2f20-66a7-4c23-af6e-a1c5b5dccd22" (UID: "97df2f20-66a7-4c23-af6e-a1c5b5dccd22"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:16:00.653042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.653015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-kube-api-access-qjdp8" (OuterVolumeSpecName: "kube-api-access-qjdp8") pod "97df2f20-66a7-4c23-af6e-a1c5b5dccd22" (UID: "97df2f20-66a7-4c23-af6e-a1c5b5dccd22"). InnerVolumeSpecName "kube-api-access-qjdp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:16:00.751621 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.751581    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjdp8\" (UniqueName: \"kubernetes.io/projected/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-kube-api-access-qjdp8\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:16:00.751621 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:00.751613    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97df2f20-66a7-4c23-af6e-a1c5b5dccd22-extensions-socket-volume\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:16:01.522949 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:01.522917    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:01.525125 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:01.525086    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="97df2f20-66a7-4c23-af6e-a1c5b5dccd22" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:01.532850 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:01.532818    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-vhvpk\" is forbidden: User \"system:node:ip-10-0-128-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-71.ec2.internal' and this object" podUID="97df2f20-66a7-4c23-af6e-a1c5b5dccd22" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-vhvpk"
Jul 12 08:16:01.757418 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:01.757141    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97df2f20-66a7-4c23-af6e-a1c5b5dccd22" path="/var/lib/kubelet/pods/97df2f20-66a7-4c23-af6e-a1c5b5dccd22/volumes"
Jul 12 08:16:02.530522 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.530473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v" event={"ID":"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5","Type":"ContainerStarted","Data":"e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab"}
Jul 12 08:16:02.530992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.530532    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v" podUID="ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" containerName="manager" containerID="cri-o://e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab" gracePeriod=10
Jul 12 08:16:02.530992 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.530588    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:16:02.532380 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.532354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr" event={"ID":"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6","Type":"ContainerStarted","Data":"c66d135cca81d4518165da01eb181c297886c8abc703cae5df808f6220b0e5c1"}
Jul 12 08:16:02.532504 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.532472    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:16:02.548566 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.548465    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v" podStartSLOduration=14.179391964 podStartE2EDuration="18.54844446s" totalImagesPullingTime="4.369052496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:16:02.547812305 +0000 UTC m=+559.330812662" watchObservedRunningTime="2026-07-12 08:16:02.54844446 +0000 UTC m=+559.331444807"
Jul 12 08:16:02.564160 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.564103    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr" podStartSLOduration=2.152073328 podStartE2EDuration="6.564084362s" totalImagesPullingTime="4.412011034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:16:02.563252492 +0000 UTC m=+559.346252851" watchObservedRunningTime="2026-07-12 08:16:02.564084362 +0000 UTC m=+559.347084706"
Jul 12 08:16:02.786258 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.786228    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:16:02.872683 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.872590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9nsx\" (UniqueName: \"kubernetes.io/projected/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-kube-api-access-t9nsx\") pod \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") "
Jul 12 08:16:02.872868 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.872686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-extensions-socket-volume\") pod \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\" (UID: \"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5\") "
Jul 12 08:16:02.873002 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.872977    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" (UID: "ff7b4fe8-b901-411b-93cc-180c5dc8b1c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:16:02.874934 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.874903    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-kube-api-access-t9nsx" (OuterVolumeSpecName: "kube-api-access-t9nsx") pod "ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" (UID: "ff7b4fe8-b901-411b-93cc-180c5dc8b1c5"). InnerVolumeSpecName "kube-api-access-t9nsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:16:02.973855 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.973817    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-extensions-socket-volume\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:16:02.973855 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:02.973848    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9nsx\" (UniqueName: \"kubernetes.io/projected/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5-kube-api-access-t9nsx\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:16:03.538901 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.538855    2558 generic.go:356] "Generic (PLEG): container finished" podID="ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" containerID="e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab" exitCode=2
Jul 12 08:16:03.538901 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.538906    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"
Jul 12 08:16:03.539433 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.538901    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v" event={"ID":"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5","Type":"ContainerDied","Data":"e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab"}
Jul 12 08:16:03.539433 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.539102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v" event={"ID":"ff7b4fe8-b901-411b-93cc-180c5dc8b1c5","Type":"ContainerDied","Data":"90221ecd7451659d6de0a184d8cf6963223ede199e67427157c614e15086cdd3"}
Jul 12 08:16:03.539433 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.539147    2558 scope.go:117] "RemoveContainer" containerID="e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab"
Jul 12 08:16:03.548675 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.548652    2558 scope.go:117] "RemoveContainer" containerID="e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab"
Jul 12 08:16:03.548960 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:03.548941    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab\": container with ID starting with e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab not found: ID does not exist" containerID="e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab"
Jul 12 08:16:03.549015 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.548970    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab"} err="failed to get container status \"e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab\": rpc error: code = NotFound desc = could not find container \"e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab\": container with ID starting with e650d205c805bd7477dd1587d0468753e034cedb34f142ef0dbb530b4930a6ab not found: ID does not exist"
Jul 12 08:16:03.559921 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.559892    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"]
Jul 12 08:16:03.563046 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.563022    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jww2v"]
Jul 12 08:16:03.755575 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:03.755495    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" path="/var/lib/kubelet/pods/ff7b4fe8-b901-411b-93cc-180c5dc8b1c5/volumes"
Jul 12 08:16:13.541856 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:13.541821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:16:32.095514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.095477    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:32.095927 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.095841    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" containerName="manager"
Jul 12 08:16:32.095927 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.095851    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" containerName="manager"
Jul 12 08:16:32.095927 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.095913    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7b4fe8-b901-411b-93cc-180c5dc8b1c5" containerName="manager"
Jul 12 08:16:32.148994 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.148964    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:32.149168 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.149083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.151348 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.151322    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 08:16:32.191967 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.191935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:32.222058 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.222020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj886\" (UniqueName: \"kubernetes.io/projected/921cbe6f-a876-4f28-bf1a-017b679ff958-kube-api-access-cj886\") pod \"limitador-limitador-64c94fd64f-cnwxs\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.222238 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.222086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/921cbe6f-a876-4f28-bf1a-017b679ff958-config-file\") pod \"limitador-limitador-64c94fd64f-cnwxs\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.323376 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.323338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/921cbe6f-a876-4f28-bf1a-017b679ff958-config-file\") pod \"limitador-limitador-64c94fd64f-cnwxs\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.323576 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.323421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj886\" (UniqueName: \"kubernetes.io/projected/921cbe6f-a876-4f28-bf1a-017b679ff958-kube-api-access-cj886\") pod \"limitador-limitador-64c94fd64f-cnwxs\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.324061 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.324003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/921cbe6f-a876-4f28-bf1a-017b679ff958-config-file\") pod \"limitador-limitador-64c94fd64f-cnwxs\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.332628 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.332595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj886\" (UniqueName: \"kubernetes.io/projected/921cbe6f-a876-4f28-bf1a-017b679ff958-kube-api-access-cj886\") pod \"limitador-limitador-64c94fd64f-cnwxs\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.459505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.459420    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:32.602217 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.602156    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:32.604607 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:16:32.604575    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921cbe6f_a876_4f28_bf1a_017b679ff958.slice/crio-4a78b6b4e08005ceea16ede11b6eafce6fdd17ab299031670345f7eab1d3b2a9 WatchSource:0}: Error finding container 4a78b6b4e08005ceea16ede11b6eafce6fdd17ab299031670345f7eab1d3b2a9: Status 404 returned error can't find the container with id 4a78b6b4e08005ceea16ede11b6eafce6fdd17ab299031670345f7eab1d3b2a9
Jul 12 08:16:32.680906 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:32.680867    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs" event={"ID":"921cbe6f-a876-4f28-bf1a-017b679ff958","Type":"ContainerStarted","Data":"4a78b6b4e08005ceea16ede11b6eafce6fdd17ab299031670345f7eab1d3b2a9"}
Jul 12 08:16:33.096252 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.096216    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2k2w"]
Jul 12 08:16:33.100966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.100947    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:16:33.103120 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.103099    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5l5x7\""
Jul 12 08:16:33.104103 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.104082    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2k2w"]
Jul 12 08:16:33.130666 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.130638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxs56\" (UniqueName: \"kubernetes.io/projected/fb075e5e-31ea-467c-9eb6-ebbb643745b8-kube-api-access-wxs56\") pod \"authorino-75d556bd77-d2k2w\" (UID: \"fb075e5e-31ea-467c-9eb6-ebbb643745b8\") " pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:16:33.231569 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.231531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxs56\" (UniqueName: \"kubernetes.io/projected/fb075e5e-31ea-467c-9eb6-ebbb643745b8-kube-api-access-wxs56\") pod \"authorino-75d556bd77-d2k2w\" (UID: \"fb075e5e-31ea-467c-9eb6-ebbb643745b8\") " pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:16:33.239764 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.239725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxs56\" (UniqueName: \"kubernetes.io/projected/fb075e5e-31ea-467c-9eb6-ebbb643745b8-kube-api-access-wxs56\") pod \"authorino-75d556bd77-d2k2w\" (UID: \"fb075e5e-31ea-467c-9eb6-ebbb643745b8\") " pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:16:33.412261 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.412182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:16:33.595975 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.595938    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2k2w"]
Jul 12 08:16:33.600033 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:16:33.599992    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb075e5e_31ea_467c_9eb6_ebbb643745b8.slice/crio-413a03922e2e1088144c929f45518a093b5793c0f3c946256b963284ac030f12 WatchSource:0}: Error finding container 413a03922e2e1088144c929f45518a093b5793c0f3c946256b963284ac030f12: Status 404 returned error can't find the container with id 413a03922e2e1088144c929f45518a093b5793c0f3c946256b963284ac030f12
Jul 12 08:16:33.689105 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:33.689020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2k2w" event={"ID":"fb075e5e-31ea-467c-9eb6-ebbb643745b8","Type":"ContainerStarted","Data":"413a03922e2e1088144c929f45518a093b5793c0f3c946256b963284ac030f12"}
Jul 12 08:16:37.718792 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:37.718694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs" event={"ID":"921cbe6f-a876-4f28-bf1a-017b679ff958","Type":"ContainerStarted","Data":"db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311"}
Jul 12 08:16:37.718792 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:37.718760    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:37.720295 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:37.720247    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2k2w" event={"ID":"fb075e5e-31ea-467c-9eb6-ebbb643745b8","Type":"ContainerStarted","Data":"075e35231c0c8c325a1efa206f2a6d706da2866d4cb271796796418cc89538b4"}
Jul 12 08:16:37.736120 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:37.736058    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs" podStartSLOduration=1.023383769 podStartE2EDuration="5.736042773s" totalImagesPullingTime="4.712659004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:16:37.734129334 +0000 UTC m=+594.517129680" watchObservedRunningTime="2026-07-12 08:16:37.736042773 +0000 UTC m=+594.519043161"
Jul 12 08:16:37.747566 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:37.747516    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d2k2w" podStartSLOduration=0.971524821 podStartE2EDuration="4.747498938s" totalImagesPullingTime="3.775974117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:16:37.746946131 +0000 UTC m=+594.529946474" watchObservedRunningTime="2026-07-12 08:16:37.747498938 +0000 UTC m=+594.530499332"
Jul 12 08:16:43.677229 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:43.677199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:16:43.678699 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:43.678669    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:16:43.684144 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:43.684122    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:16:43.685778 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:43.685761    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:16:46.800799 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:46.800753    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:46.801334 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:46.801040    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs" podUID="921cbe6f-a876-4f28-bf1a-017b679ff958" containerName="limitador" containerID="cri-o://db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311" gracePeriod=30
Jul 12 08:16:46.801962 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:46.801697    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:47.360307 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.360259    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:47.469474 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.469377    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj886\" (UniqueName: \"kubernetes.io/projected/921cbe6f-a876-4f28-bf1a-017b679ff958-kube-api-access-cj886\") pod \"921cbe6f-a876-4f28-bf1a-017b679ff958\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") "
Jul 12 08:16:47.469648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.469486    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/921cbe6f-a876-4f28-bf1a-017b679ff958-config-file\") pod \"921cbe6f-a876-4f28-bf1a-017b679ff958\" (UID: \"921cbe6f-a876-4f28-bf1a-017b679ff958\") "
Jul 12 08:16:47.469839 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.469817    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/921cbe6f-a876-4f28-bf1a-017b679ff958-config-file" (OuterVolumeSpecName: "config-file") pod "921cbe6f-a876-4f28-bf1a-017b679ff958" (UID: "921cbe6f-a876-4f28-bf1a-017b679ff958"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:16:47.471714 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.471692    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921cbe6f-a876-4f28-bf1a-017b679ff958-kube-api-access-cj886" (OuterVolumeSpecName: "kube-api-access-cj886") pod "921cbe6f-a876-4f28-bf1a-017b679ff958" (UID: "921cbe6f-a876-4f28-bf1a-017b679ff958"). InnerVolumeSpecName "kube-api-access-cj886". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:16:47.570530 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.570494    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj886\" (UniqueName: \"kubernetes.io/projected/921cbe6f-a876-4f28-bf1a-017b679ff958-kube-api-access-cj886\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:16:47.570530 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.570524    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/921cbe6f-a876-4f28-bf1a-017b679ff958-config-file\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:16:47.769003 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.768968    2558 generic.go:356] "Generic (PLEG): container finished" podID="921cbe6f-a876-4f28-bf1a-017b679ff958" containerID="db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311" exitCode=0
Jul 12 08:16:47.769151 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.769016    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"
Jul 12 08:16:47.769151 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.769047    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs" event={"ID":"921cbe6f-a876-4f28-bf1a-017b679ff958","Type":"ContainerDied","Data":"db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311"}
Jul 12 08:16:47.769151 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.769100    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnwxs" event={"ID":"921cbe6f-a876-4f28-bf1a-017b679ff958","Type":"ContainerDied","Data":"4a78b6b4e08005ceea16ede11b6eafce6fdd17ab299031670345f7eab1d3b2a9"}
Jul 12 08:16:47.769151 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.769121    2558 scope.go:117] "RemoveContainer" containerID="db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311"
Jul 12 08:16:47.778036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.778019    2558 scope.go:117] "RemoveContainer" containerID="db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311"
Jul 12 08:16:47.778339 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:16:47.778306    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311\": container with ID starting with db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311 not found: ID does not exist" containerID="db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311"
Jul 12 08:16:47.778434 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.778341    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311"} err="failed to get container status \"db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311\": rpc error: code = NotFound desc = could not find container \"db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311\": container with ID starting with db2027231c2afc8c6297a3731e5510b6cfca1099be34a5f12cbf4df59a78e311 not found: ID does not exist"
Jul 12 08:16:47.785091 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.785067    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:47.788167 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:47.788145    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnwxs"]
Jul 12 08:16:49.755515 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:49.755483    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="921cbe6f-a876-4f28-bf1a-017b679ff958" path="/var/lib/kubelet/pods/921cbe6f-a876-4f28-bf1a-017b679ff958/volumes"
Jul 12 08:16:52.450351 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.450312    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"]
Jul 12 08:16:52.450906 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.450884    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921cbe6f-a876-4f28-bf1a-017b679ff958" containerName="limitador"
Jul 12 08:16:52.450969 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.450910    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="921cbe6f-a876-4f28-bf1a-017b679ff958" containerName="limitador"
Jul 12 08:16:52.451052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.451031    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="921cbe6f-a876-4f28-bf1a-017b679ff958" containerName="limitador"
Jul 12 08:16:52.455907 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.455886    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.458269 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.458246    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 08:16:52.458393 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.458377    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qr495\""
Jul 12 08:16:52.458449 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.458377    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 12 08:16:52.458933 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.458913    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 08:16:52.462442 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.462421    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"]
Jul 12 08:16:52.513399 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.513365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85a64f9b-e04b-4cba-8866-f9f6effa90f6-data\") pod \"postgres-69fb4594cf-xthc5\" (UID: \"85a64f9b-e04b-4cba-8866-f9f6effa90f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.513584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.513404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzj76\" (UniqueName: \"kubernetes.io/projected/85a64f9b-e04b-4cba-8866-f9f6effa90f6-kube-api-access-tzj76\") pod \"postgres-69fb4594cf-xthc5\" (UID: \"85a64f9b-e04b-4cba-8866-f9f6effa90f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.614138 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.614102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85a64f9b-e04b-4cba-8866-f9f6effa90f6-data\") pod \"postgres-69fb4594cf-xthc5\" (UID: \"85a64f9b-e04b-4cba-8866-f9f6effa90f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.614138 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.614140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzj76\" (UniqueName: \"kubernetes.io/projected/85a64f9b-e04b-4cba-8866-f9f6effa90f6-kube-api-access-tzj76\") pod \"postgres-69fb4594cf-xthc5\" (UID: \"85a64f9b-e04b-4cba-8866-f9f6effa90f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.614526 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.614506    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/85a64f9b-e04b-4cba-8866-f9f6effa90f6-data\") pod \"postgres-69fb4594cf-xthc5\" (UID: \"85a64f9b-e04b-4cba-8866-f9f6effa90f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.622042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.622019    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzj76\" (UniqueName: \"kubernetes.io/projected/85a64f9b-e04b-4cba-8866-f9f6effa90f6-kube-api-access-tzj76\") pod \"postgres-69fb4594cf-xthc5\" (UID: \"85a64f9b-e04b-4cba-8866-f9f6effa90f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.767784 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.767696    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:52.908289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:52.908254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"]
Jul 12 08:16:52.910779 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:16:52.910753    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a64f9b_e04b_4cba_8866_f9f6effa90f6.slice/crio-7cde3a19ff37ec63c98451df0e5b404ccb9183cc9017f86689e110fb0409f8fb WatchSource:0}: Error finding container 7cde3a19ff37ec63c98451df0e5b404ccb9183cc9017f86689e110fb0409f8fb: Status 404 returned error can't find the container with id 7cde3a19ff37ec63c98451df0e5b404ccb9183cc9017f86689e110fb0409f8fb
Jul 12 08:16:53.799612 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:53.799573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5" event={"ID":"85a64f9b-e04b-4cba-8866-f9f6effa90f6","Type":"ContainerStarted","Data":"7cde3a19ff37ec63c98451df0e5b404ccb9183cc9017f86689e110fb0409f8fb"}
Jul 12 08:16:58.831251 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:58.831204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5" event={"ID":"85a64f9b-e04b-4cba-8866-f9f6effa90f6","Type":"ContainerStarted","Data":"03c460ac56a3555c84fd9d1fbe6020695c1cac68d9d8e93cf2537dad18860a4c"}
Jul 12 08:16:58.831765 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:58.831295    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:16:58.847716 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:16:58.847662    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5" podStartSLOduration=1.203505615 podStartE2EDuration="6.847644654s" totalImagesPullingTime="5.644139039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:16:58.846801935 +0000 UTC m=+615.629802292" watchObservedRunningTime="2026-07-12 08:16:58.847644654 +0000 UTC m=+615.630644997"
Jul 12 08:17:04.866928 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:04.866843    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xthc5"
Jul 12 08:17:07.617156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:07.617088    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2k2w"]
Jul 12 08:17:07.617743 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:07.617292    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d2k2w" podUID="fb075e5e-31ea-467c-9eb6-ebbb643745b8" containerName="authorino" containerID="cri-o://075e35231c0c8c325a1efa206f2a6d706da2866d4cb271796796418cc89538b4" gracePeriod=30
Jul 12 08:17:07.878403 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:07.878366    2558 generic.go:356] "Generic (PLEG): container finished" podID="fb075e5e-31ea-467c-9eb6-ebbb643745b8" containerID="075e35231c0c8c325a1efa206f2a6d706da2866d4cb271796796418cc89538b4" exitCode=0
Jul 12 08:17:07.878546 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:07.878405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2k2w" event={"ID":"fb075e5e-31ea-467c-9eb6-ebbb643745b8","Type":"ContainerDied","Data":"075e35231c0c8c325a1efa206f2a6d706da2866d4cb271796796418cc89538b4"}
Jul 12 08:17:07.904672 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:07.904641    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:17:08.056885 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.056850    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxs56\" (UniqueName: \"kubernetes.io/projected/fb075e5e-31ea-467c-9eb6-ebbb643745b8-kube-api-access-wxs56\") pod \"fb075e5e-31ea-467c-9eb6-ebbb643745b8\" (UID: \"fb075e5e-31ea-467c-9eb6-ebbb643745b8\") "
Jul 12 08:17:08.059330 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.059253    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb075e5e-31ea-467c-9eb6-ebbb643745b8-kube-api-access-wxs56" (OuterVolumeSpecName: "kube-api-access-wxs56") pod "fb075e5e-31ea-467c-9eb6-ebbb643745b8" (UID: "fb075e5e-31ea-467c-9eb6-ebbb643745b8"). InnerVolumeSpecName "kube-api-access-wxs56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:17:08.158298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.158193    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxs56\" (UniqueName: \"kubernetes.io/projected/fb075e5e-31ea-467c-9eb6-ebbb643745b8-kube-api-access-wxs56\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:17:08.890350 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.890303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2k2w" event={"ID":"fb075e5e-31ea-467c-9eb6-ebbb643745b8","Type":"ContainerDied","Data":"413a03922e2e1088144c929f45518a093b5793c0f3c946256b963284ac030f12"}
Jul 12 08:17:08.890350 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.890339    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2k2w"
Jul 12 08:17:08.890350 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.890358    2558 scope.go:117] "RemoveContainer" containerID="075e35231c0c8c325a1efa206f2a6d706da2866d4cb271796796418cc89538b4"
Jul 12 08:17:08.909430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.909401    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2k2w"]
Jul 12 08:17:08.910966 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:08.910946    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2k2w"]
Jul 12 08:17:09.755347 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:09.755310    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb075e5e-31ea-467c-9eb6-ebbb643745b8" path="/var/lib/kubelet/pods/fb075e5e-31ea-467c-9eb6-ebbb643745b8/volumes"
Jul 12 08:17:11.950092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.950055    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f498b99f8-7gr59"]
Jul 12 08:17:11.950495 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.950456    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb075e5e-31ea-467c-9eb6-ebbb643745b8" containerName="authorino"
Jul 12 08:17:11.950495 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.950469    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb075e5e-31ea-467c-9eb6-ebbb643745b8" containerName="authorino"
Jul 12 08:17:11.950572 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.950565    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb075e5e-31ea-467c-9eb6-ebbb643745b8" containerName="authorino"
Jul 12 08:17:11.969328 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.969266    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f498b99f8-7gr59"]
Jul 12 08:17:11.969487 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.969374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:11.973648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.973622    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 08:17:11.973811 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.973662    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tzdg4\""
Jul 12 08:17:11.974465 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:11.974444    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 08:17:12.098791 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.098758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.098975 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.098883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ppg\" (UniqueName: \"kubernetes.io/projected/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-kube-api-access-z8ppg\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.127442 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.127410    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cff869cd6-rzhcx"]
Jul 12 08:17:12.131124 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.131100    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.139586 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.139559    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-rzhcx"]
Jul 12 08:17:12.200528 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.200421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.200714 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.200548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ppg\" (UniqueName: \"kubernetes.io/projected/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-kube-api-access-z8ppg\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.200714 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:17:12.200585    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 12 08:17:12.200714 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:17:12.200678    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert podName:b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6 nodeName:}" failed. No retries permitted until 2026-07-12 08:17:12.700662341 +0000 UTC m=+629.483662664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert") pod "maas-controller-6f498b99f8-7gr59" (UID: "b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6") : secret "maas-controller-webhook-cert" not found
Jul 12 08:17:12.209075 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.209047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ppg\" (UniqueName: \"kubernetes.io/projected/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-kube-api-access-z8ppg\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.301557 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.301520    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87267641-8a09-42ba-8156-f43e069cf0f3-webhook-cert\") pod \"maas-controller-7cff869cd6-rzhcx\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") " pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.301774 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.301576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbbxx\" (UniqueName: \"kubernetes.io/projected/87267641-8a09-42ba-8156-f43e069cf0f3-kube-api-access-zbbxx\") pod \"maas-controller-7cff869cd6-rzhcx\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") " pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.402646 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.402609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87267641-8a09-42ba-8156-f43e069cf0f3-webhook-cert\") pod \"maas-controller-7cff869cd6-rzhcx\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") " pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.402810 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.402672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbbxx\" (UniqueName: \"kubernetes.io/projected/87267641-8a09-42ba-8156-f43e069cf0f3-kube-api-access-zbbxx\") pod \"maas-controller-7cff869cd6-rzhcx\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") " pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.405245 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.405225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87267641-8a09-42ba-8156-f43e069cf0f3-webhook-cert\") pod \"maas-controller-7cff869cd6-rzhcx\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") " pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.410399 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.410373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbbxx\" (UniqueName: \"kubernetes.io/projected/87267641-8a09-42ba-8156-f43e069cf0f3-kube-api-access-zbbxx\") pod \"maas-controller-7cff869cd6-rzhcx\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") " pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.442445 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.442404    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:12.577582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.577557    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-rzhcx"]
Jul 12 08:17:12.579856 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:17:12.579825    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87267641_8a09_42ba_8156_f43e069cf0f3.slice/crio-9927bc1b79b4bc769a5a0b8bcd65a37e341eb1d0c07513013d6370e75ada8643 WatchSource:0}: Error finding container 9927bc1b79b4bc769a5a0b8bcd65a37e341eb1d0c07513013d6370e75ada8643: Status 404 returned error can't find the container with id 9927bc1b79b4bc769a5a0b8bcd65a37e341eb1d0c07513013d6370e75ada8643
Jul 12 08:17:12.705689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.705593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.708102 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.708082    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert\") pod \"maas-controller-6f498b99f8-7gr59\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") " pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.880520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.880481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:12.914200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:12.914166    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cff869cd6-rzhcx" event={"ID":"87267641-8a09-42ba-8156-f43e069cf0f3","Type":"ContainerStarted","Data":"9927bc1b79b4bc769a5a0b8bcd65a37e341eb1d0c07513013d6370e75ada8643"}
Jul 12 08:17:13.017087 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:13.017061    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f498b99f8-7gr59"]
Jul 12 08:17:13.019307 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:17:13.019265    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb075e5fa_a2d8_4b5a_8ea5_025ee6e2a6a6.slice/crio-cc01e6bd1ab3ec7ad5e007a7374a5c8e79419988a562c0249502115b865a66b9 WatchSource:0}: Error finding container cc01e6bd1ab3ec7ad5e007a7374a5c8e79419988a562c0249502115b865a66b9: Status 404 returned error can't find the container with id cc01e6bd1ab3ec7ad5e007a7374a5c8e79419988a562c0249502115b865a66b9
Jul 12 08:17:13.923637 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:13.922761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f498b99f8-7gr59" event={"ID":"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6","Type":"ContainerStarted","Data":"cc01e6bd1ab3ec7ad5e007a7374a5c8e79419988a562c0249502115b865a66b9"}
Jul 12 08:17:15.935336 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:15.935228    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cff869cd6-rzhcx" event={"ID":"87267641-8a09-42ba-8156-f43e069cf0f3","Type":"ContainerStarted","Data":"0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf"}
Jul 12 08:17:15.935811 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:15.935442    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:15.937009 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:15.936982    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f498b99f8-7gr59" event={"ID":"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6","Type":"ContainerStarted","Data":"6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590"}
Jul 12 08:17:15.937150 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:15.937033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:15.950002 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:15.949946    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cff869cd6-rzhcx" podStartSLOduration=1.255489192 podStartE2EDuration="3.949928253s" totalImagesPullingTime="2.694439061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:17:15.949604948 +0000 UTC m=+632.732605294" watchObservedRunningTime="2026-07-12 08:17:15.949928253 +0000 UTC m=+632.732928598"
Jul 12 08:17:15.967335 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:15.967260    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f498b99f8-7gr59" podStartSLOduration=2.702350725 podStartE2EDuration="4.967244315s" totalImagesPullingTime="2.26489359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:17:15.966089226 +0000 UTC m=+632.749089566" watchObservedRunningTime="2026-07-12 08:17:15.967244315 +0000 UTC m=+632.750244660"
Jul 12 08:17:26.950119 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:26.950091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:26.950546 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:26.950167    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:17:27.061030 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.060991    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f498b99f8-7gr59"]
Jul 12 08:17:27.061295 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.061250    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f498b99f8-7gr59" podUID="b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" containerName="manager" containerID="cri-o://6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590" gracePeriod=30
Jul 12 08:17:27.315758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.315730    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:27.340042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.340010    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert\") pod \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") "
Jul 12 08:17:27.340226 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.340105    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8ppg\" (UniqueName: \"kubernetes.io/projected/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-kube-api-access-z8ppg\") pod \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\" (UID: \"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6\") "
Jul 12 08:17:27.342428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.342392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" (UID: "b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:17:27.342428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.342403    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-kube-api-access-z8ppg" (OuterVolumeSpecName: "kube-api-access-z8ppg") pod "b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" (UID: "b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6"). InnerVolumeSpecName "kube-api-access-z8ppg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:17:27.441172 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.441131    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-webhook-cert\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:17:27.441172 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.441162    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8ppg\" (UniqueName: \"kubernetes.io/projected/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6-kube-api-access-z8ppg\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:17:27.997232 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.997197    2558 generic.go:356] "Generic (PLEG): container finished" podID="b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" containerID="6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590" exitCode=0
Jul 12 08:17:27.997671 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.997245    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f498b99f8-7gr59"
Jul 12 08:17:27.997671 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.997304    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f498b99f8-7gr59" event={"ID":"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6","Type":"ContainerDied","Data":"6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590"}
Jul 12 08:17:27.997671 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.997358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f498b99f8-7gr59" event={"ID":"b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6","Type":"ContainerDied","Data":"cc01e6bd1ab3ec7ad5e007a7374a5c8e79419988a562c0249502115b865a66b9"}
Jul 12 08:17:27.997671 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:27.997381    2558 scope.go:117] "RemoveContainer" containerID="6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590"
Jul 12 08:17:28.006209 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:28.006176    2558 scope.go:117] "RemoveContainer" containerID="6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590"
Jul 12 08:17:28.006509 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:17:28.006491    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590\": container with ID starting with 6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590 not found: ID does not exist" containerID="6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590"
Jul 12 08:17:28.006567 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:28.006518    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590"} err="failed to get container status \"6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590\": rpc error: code = NotFound desc = could not find container \"6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590\": container with ID starting with 6dd958bcc3eb00310d07e766c4064a84ab6cd6c99403a72aaea4ac75cc109590 not found: ID does not exist"
Jul 12 08:17:28.013444 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:28.013382    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f498b99f8-7gr59"]
Jul 12 08:17:28.017009 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:28.016985    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f498b99f8-7gr59"]
Jul 12 08:17:29.755743 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:29.755712    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" path="/var/lib/kubelet/pods/b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6/volumes"
Jul 12 08:17:48.415201 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.415162    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"]
Jul 12 08:17:48.415699 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.415567    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" containerName="manager"
Jul 12 08:17:48.415699 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.415578    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" containerName="manager"
Jul 12 08:17:48.415699 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.415639    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b075e5fa-a2d8-4b5a-8ea5-025ee6e2a6a6" containerName="manager"
Jul 12 08:17:48.421379 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.421357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.423726 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.423700    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 12 08:17:48.423850 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.423803    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mvgcp\""
Jul 12 08:17:48.431114 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.431088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"]
Jul 12 08:17:48.534758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.534723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8577a89-95d2-47a9-9f0a-ff9f0475d529-maas-api-tls\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.534942 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.534766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8577a89-95d2-47a9-9f0a-ff9f0475d529-openshift-service-ca\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.534942 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.534881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9j8\" (UniqueName: \"kubernetes.io/projected/f8577a89-95d2-47a9-9f0a-ff9f0475d529-kube-api-access-sw9j8\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.635957 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.635921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8577a89-95d2-47a9-9f0a-ff9f0475d529-openshift-service-ca\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.636168 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.635989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9j8\" (UniqueName: \"kubernetes.io/projected/f8577a89-95d2-47a9-9f0a-ff9f0475d529-kube-api-access-sw9j8\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.636168 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.636070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8577a89-95d2-47a9-9f0a-ff9f0475d529-maas-api-tls\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.636775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.636746    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8577a89-95d2-47a9-9f0a-ff9f0475d529-openshift-service-ca\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.638766 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.638741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8577a89-95d2-47a9-9f0a-ff9f0475d529-maas-api-tls\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.648973 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.648938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9j8\" (UniqueName: \"kubernetes.io/projected/f8577a89-95d2-47a9-9f0a-ff9f0475d529-kube-api-access-sw9j8\") pod \"maas-api-698d87b8f4-d5lkr\" (UID: \"f8577a89-95d2-47a9-9f0a-ff9f0475d529\") " pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.733406 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.733312    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:48.884004 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.883976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"]
Jul 12 08:17:48.885899 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:17:48.885866    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8577a89_95d2_47a9_9f0a_ff9f0475d529.slice/crio-cff7c15e47ee1517dfebe697a1dc5fd927098ef2928719b4c9ad39f8a4cc1026 WatchSource:0}: Error finding container cff7c15e47ee1517dfebe697a1dc5fd927098ef2928719b4c9ad39f8a4cc1026: Status 404 returned error can't find the container with id cff7c15e47ee1517dfebe697a1dc5fd927098ef2928719b4c9ad39f8a4cc1026
Jul 12 08:17:48.951939 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.951904    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kxqv8"]
Jul 12 08:17:48.956198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.956182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:48.958651 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.958628    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 12 08:17:48.968573 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:48.968547    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kxqv8"]
Jul 12 08:17:49.031814 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.031780    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-b6l6j"]
Jul 12 08:17:49.035184 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.035168    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.038635 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.038613    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-psn96\""
Jul 12 08:17:49.039687 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.039662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96njd\" (UniqueName: \"kubernetes.io/projected/b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c-kube-api-access-96njd\") pod \"payload-processing-58f86c7798-kxqv8\" (UID: \"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c\") " pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.039768 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.039707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c-plugins-config-volume\") pod \"payload-processing-58f86c7798-kxqv8\" (UID: \"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c\") " pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.054288 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.054250    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-b6l6j"]
Jul 12 08:17:49.102126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.102091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr" event={"ID":"f8577a89-95d2-47a9-9f0a-ff9f0475d529","Type":"ContainerStarted","Data":"cff7c15e47ee1517dfebe697a1dc5fd927098ef2928719b4c9ad39f8a4cc1026"}
Jul 12 08:17:49.140967 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.140918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3847b8f1-c0f2-4839-9974-4bad50b815d5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-b6l6j\" (UID: \"3847b8f1-c0f2-4839-9974-4bad50b815d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.141136 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.140976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c-plugins-config-volume\") pod \"payload-processing-58f86c7798-kxqv8\" (UID: \"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c\") " pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.141178 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.141137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzslr\" (UniqueName: \"kubernetes.io/projected/3847b8f1-c0f2-4839-9974-4bad50b815d5-kube-api-access-rzslr\") pod \"payload-pre-processing-7964457696-b6l6j\" (UID: \"3847b8f1-c0f2-4839-9974-4bad50b815d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.141228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.141172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96njd\" (UniqueName: \"kubernetes.io/projected/b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c-kube-api-access-96njd\") pod \"payload-processing-58f86c7798-kxqv8\" (UID: \"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c\") " pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.141737 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.141719    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c-plugins-config-volume\") pod \"payload-processing-58f86c7798-kxqv8\" (UID: \"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c\") " pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.150542 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.150513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96njd\" (UniqueName: \"kubernetes.io/projected/b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c-kube-api-access-96njd\") pod \"payload-processing-58f86c7798-kxqv8\" (UID: \"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c\") " pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.241815 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.241775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzslr\" (UniqueName: \"kubernetes.io/projected/3847b8f1-c0f2-4839-9974-4bad50b815d5-kube-api-access-rzslr\") pod \"payload-pre-processing-7964457696-b6l6j\" (UID: \"3847b8f1-c0f2-4839-9974-4bad50b815d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.242017 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.241833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3847b8f1-c0f2-4839-9974-4bad50b815d5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-b6l6j\" (UID: \"3847b8f1-c0f2-4839-9974-4bad50b815d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.242565 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.242544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3847b8f1-c0f2-4839-9974-4bad50b815d5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-b6l6j\" (UID: \"3847b8f1-c0f2-4839-9974-4bad50b815d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.259689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.259659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzslr\" (UniqueName: \"kubernetes.io/projected/3847b8f1-c0f2-4839-9974-4bad50b815d5-kube-api-access-rzslr\") pod \"payload-pre-processing-7964457696-b6l6j\" (UID: \"3847b8f1-c0f2-4839-9974-4bad50b815d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.267529 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.267494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:49.345655 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.345624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:49.420693 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.420661    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kxqv8"]
Jul 12 08:17:49.422377 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:17:49.422346    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ddbf81_483b_48b4_8308_3a3f1ce5bf4c.slice/crio-f7d0bb06c097528f9b583e358daaea726c209e9a6bcf96b50be1ea76d5da31c3 WatchSource:0}: Error finding container f7d0bb06c097528f9b583e358daaea726c209e9a6bcf96b50be1ea76d5da31c3: Status 404 returned error can't find the container with id f7d0bb06c097528f9b583e358daaea726c209e9a6bcf96b50be1ea76d5da31c3
Jul 12 08:17:49.500692 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:49.500534    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-b6l6j"]
Jul 12 08:17:49.502970 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:17:49.502941    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3847b8f1_c0f2_4839_9974_4bad50b815d5.slice/crio-3328894352abc040817720583cad5ea4d17fc6ad3f4687c19301c6181dde7270 WatchSource:0}: Error finding container 3328894352abc040817720583cad5ea4d17fc6ad3f4687c19301c6181dde7270: Status 404 returned error can't find the container with id 3328894352abc040817720583cad5ea4d17fc6ad3f4687c19301c6181dde7270
Jul 12 08:17:50.111099 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:50.111063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8" event={"ID":"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c","Type":"ContainerStarted","Data":"f7d0bb06c097528f9b583e358daaea726c209e9a6bcf96b50be1ea76d5da31c3"}
Jul 12 08:17:50.113048 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:50.113018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j" event={"ID":"3847b8f1-c0f2-4839-9974-4bad50b815d5","Type":"ContainerStarted","Data":"3328894352abc040817720583cad5ea4d17fc6ad3f4687c19301c6181dde7270"}
Jul 12 08:17:51.119218 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.119117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j" event={"ID":"3847b8f1-c0f2-4839-9974-4bad50b815d5","Type":"ContainerStarted","Data":"2eb34dbe67812dec8d9255d77e063b9b86708c3bebfeb3d0608786798d047f3a"}
Jul 12 08:17:51.119218 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.119195    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:17:51.120792 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.120772    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8" event={"ID":"b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c","Type":"ContainerStarted","Data":"0390548ded2d367fbead3c95da041eede096f656b5780ed9b5f596bdd05a9937"}
Jul 12 08:17:51.120921 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.120820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:17:51.122142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.122121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr" event={"ID":"f8577a89-95d2-47a9-9f0a-ff9f0475d529","Type":"ContainerStarted","Data":"673bd6a72bdc6f0eb00467981c6cffe00611309b35d9949a930f0a3a072c8a02"}
Jul 12 08:17:51.122244 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.122237    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:17:51.138754 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.138693    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j" podStartSLOduration=1.8034850690000002 podStartE2EDuration="3.138671235s" totalImagesPullingTime="1.335186166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:17:51.137229413 +0000 UTC m=+667.920229756" watchObservedRunningTime="2026-07-12 08:17:51.138671235 +0000 UTC m=+667.921671580"
Jul 12 08:17:51.157120 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.157060    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8" podStartSLOduration=1.74417953 podStartE2EDuration="3.157039656s" totalImagesPullingTime="1.412860126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:17:51.15662848 +0000 UTC m=+667.939628825" watchObservedRunningTime="2026-07-12 08:17:51.157039656 +0000 UTC m=+667.940040001"
Jul 12 08:17:51.178255 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:51.178196    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr" podStartSLOduration=1.627166356 podStartE2EDuration="3.178179189s" totalImagesPullingTime="1.551012833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:17:51.17676212 +0000 UTC m=+667.959762478" watchObservedRunningTime="2026-07-12 08:17:51.178179189 +0000 UTC m=+667.961179532"
Jul 12 08:17:57.133462 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:17:57.133424    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-698d87b8f4-d5lkr"
Jul 12 08:18:02.130129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:02.130099    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-kxqv8"
Jul 12 08:18:02.130642 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:02.130421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-b6l6j"
Jul 12 08:18:16.274374 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.274343    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"]
Jul 12 08:18:16.278514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.278491    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.281914 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.281879    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 08:18:16.282092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.281940    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vxrzn\""
Jul 12 08:18:16.282092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.281879    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 08:18:16.283168 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.283141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 12 08:18:16.286849 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.286830    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"]
Jul 12 08:18:16.384440 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.384403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.384440 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.384442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.384668 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.384462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnd75\" (UniqueName: \"kubernetes.io/projected/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-kube-api-access-hnd75\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.384668 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.384580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.384668 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.384648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.384773 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.384669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.485968 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.485931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486166 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486166 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486166 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486166 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486166 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnd75\" (UniqueName: \"kubernetes.io/projected/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-kube-api-access-hnd75\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486559 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486534    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486638 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486566    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.486638 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.486591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.488565 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.488539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.488776 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.488755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.493130 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.493111    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnd75\" (UniqueName: \"kubernetes.io/projected/9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e-kube-api-access-hnd75\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9\" (UID: \"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.592527 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.592441    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:16.734364 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:16.734334    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"]
Jul 12 08:18:16.737162 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:18:16.737127    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0b20b8_5b2f_4a06_98c5_cd49fc1f059e.slice/crio-ebaa5fbcfdf3a3022e5248e3a74d02bfdafc560acba612b69f2705259980f26b WatchSource:0}: Error finding container ebaa5fbcfdf3a3022e5248e3a74d02bfdafc560acba612b69f2705259980f26b: Status 404 returned error can't find the container with id ebaa5fbcfdf3a3022e5248e3a74d02bfdafc560acba612b69f2705259980f26b
Jul 12 08:18:17.265437 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:17.265315    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9" event={"ID":"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e","Type":"ContainerStarted","Data":"ebaa5fbcfdf3a3022e5248e3a74d02bfdafc560acba612b69f2705259980f26b"}
Jul 12 08:18:18.273538 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:18.273507    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9" event={"ID":"9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e","Type":"ContainerStarted","Data":"df17df16b97f8389d39c80c466ec8b61f933afaf9aa6b6c19317f914de9439b7"}
Jul 12 08:18:18.290555 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:18.290503    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9" podStartSLOduration=1.254170701 podStartE2EDuration="2.290487907s" totalImagesPullingTime="1.036317206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:18:18.288834537 +0000 UTC m=+695.071834885" watchObservedRunningTime="2026-07-12 08:18:18.290487907 +0000 UTC m=+695.073488250"
Jul 12 08:18:26.593547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:26.593508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:26.593940 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:26.593596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:26.606147 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:26.606118    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:27.330043 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:27.330015    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9"
Jul 12 08:18:28.927236 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:28.927202    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"]
Jul 12 08:18:28.932018 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:28.932001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:28.936614 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:28.936591    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 12 08:18:28.965117 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:28.965080    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"]
Jul 12 08:18:29.006723 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.006692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84283585-2bdc-4967-865e-8db0c8478538-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.006926 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.006759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kvrb\" (UniqueName: \"kubernetes.io/projected/84283585-2bdc-4967-865e-8db0c8478538-kube-api-access-9kvrb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.006926 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.006834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.007040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.006939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.007040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.006968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.007040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.007013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.107875 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.107838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84283585-2bdc-4967-865e-8db0c8478538-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.107875 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.107879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kvrb\" (UniqueName: \"kubernetes.io/projected/84283585-2bdc-4967-865e-8db0c8478538-kube-api-access-9kvrb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.107899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.107953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.107973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.107998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108464 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.108438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108571 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.108487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.108571 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.108519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.110591 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.110571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84283585-2bdc-4967-865e-8db0c8478538-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.110676 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.110573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84283585-2bdc-4967-865e-8db0c8478538-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.117428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.117401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kvrb\" (UniqueName: \"kubernetes.io/projected/84283585-2bdc-4967-865e-8db0c8478538-kube-api-access-9kvrb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jsljb\" (UID: \"84283585-2bdc-4967-865e-8db0c8478538\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.243292 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.243182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:29.394289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.394233    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"]
Jul 12 08:18:29.397658 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:18:29.397633    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84283585_2bdc_4967_865e_8db0c8478538.slice/crio-1483ee7e5452150e71968890d40d49355ba2bf0ef4ac6e6de7683f44424fb4ca WatchSource:0}: Error finding container 1483ee7e5452150e71968890d40d49355ba2bf0ef4ac6e6de7683f44424fb4ca: Status 404 returned error can't find the container with id 1483ee7e5452150e71968890d40d49355ba2bf0ef4ac6e6de7683f44424fb4ca
Jul 12 08:18:29.398995 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:29.398967    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:18:30.334960 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:30.334917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb" event={"ID":"84283585-2bdc-4967-865e-8db0c8478538","Type":"ContainerStarted","Data":"9d854f7643922a31e3f3f3da359b83c812bc614a531750c5165dda23e4141ffe"}
Jul 12 08:18:30.335374 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:30.334992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb" event={"ID":"84283585-2bdc-4967-865e-8db0c8478538","Type":"ContainerStarted","Data":"1483ee7e5452150e71968890d40d49355ba2bf0ef4ac6e6de7683f44424fb4ca"}
Jul 12 08:18:30.362865 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:30.362795    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb" podStartSLOduration=2.171319748 podStartE2EDuration="2.362778486s" totalImagesPullingTime="191.458738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:18:30.361198668 +0000 UTC m=+707.144199043" watchObservedRunningTime="2026-07-12 08:18:30.362778486 +0000 UTC m=+707.145778829"
Jul 12 08:18:39.243694 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:39.243586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:39.243694 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:39.243662    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:39.256498 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:39.256471    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:18:39.398707 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:18:39.398668    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jsljb"
Jul 12 08:21:04.380961 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.380916    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-rzhcx"]
Jul 12 08:21:04.381696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.381213    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cff869cd6-rzhcx" podUID="87267641-8a09-42ba-8156-f43e069cf0f3" containerName="manager" containerID="cri-o://0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf" gracePeriod=30
Jul 12 08:21:04.646648 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.646581    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:21:04.669614 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.669584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbbxx\" (UniqueName: \"kubernetes.io/projected/87267641-8a09-42ba-8156-f43e069cf0f3-kube-api-access-zbbxx\") pod \"87267641-8a09-42ba-8156-f43e069cf0f3\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") "
Jul 12 08:21:04.669809 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.669650    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87267641-8a09-42ba-8156-f43e069cf0f3-webhook-cert\") pod \"87267641-8a09-42ba-8156-f43e069cf0f3\" (UID: \"87267641-8a09-42ba-8156-f43e069cf0f3\") "
Jul 12 08:21:04.672448 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.672415    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87267641-8a09-42ba-8156-f43e069cf0f3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "87267641-8a09-42ba-8156-f43e069cf0f3" (UID: "87267641-8a09-42ba-8156-f43e069cf0f3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:21:04.679666 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.679620    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87267641-8a09-42ba-8156-f43e069cf0f3-kube-api-access-zbbxx" (OuterVolumeSpecName: "kube-api-access-zbbxx") pod "87267641-8a09-42ba-8156-f43e069cf0f3" (UID: "87267641-8a09-42ba-8156-f43e069cf0f3"). InnerVolumeSpecName "kube-api-access-zbbxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:21:04.770955 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.770916    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbbxx\" (UniqueName: \"kubernetes.io/projected/87267641-8a09-42ba-8156-f43e069cf0f3-kube-api-access-zbbxx\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:21:04.770955 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:04.770949    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87267641-8a09-42ba-8156-f43e069cf0f3-webhook-cert\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:21:05.137768 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.137725    2558 generic.go:356] "Generic (PLEG): container finished" podID="87267641-8a09-42ba-8156-f43e069cf0f3" containerID="0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf" exitCode=0
Jul 12 08:21:05.137986 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.137772    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cff869cd6-rzhcx"
Jul 12 08:21:05.137986 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.137807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cff869cd6-rzhcx" event={"ID":"87267641-8a09-42ba-8156-f43e069cf0f3","Type":"ContainerDied","Data":"0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf"}
Jul 12 08:21:05.137986 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.137860    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cff869cd6-rzhcx" event={"ID":"87267641-8a09-42ba-8156-f43e069cf0f3","Type":"ContainerDied","Data":"9927bc1b79b4bc769a5a0b8bcd65a37e341eb1d0c07513013d6370e75ada8643"}
Jul 12 08:21:05.137986 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.137882    2558 scope.go:117] "RemoveContainer" containerID="0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf"
Jul 12 08:21:05.148388 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.148367    2558 scope.go:117] "RemoveContainer" containerID="0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf"
Jul 12 08:21:05.148711 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:21:05.148691    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf\": container with ID starting with 0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf not found: ID does not exist" containerID="0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf"
Jul 12 08:21:05.148761 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.148722    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf"} err="failed to get container status \"0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf\": rpc error: code = NotFound desc = could not find container \"0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf\": container with ID starting with 0d2e70545eccebf83c11917979ea3b69783cff7cd7f5df1a81d436617adef1bf not found: ID does not exist"
Jul 12 08:21:05.159448 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.159416    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-rzhcx"]
Jul 12 08:21:05.163609 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.163573    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-rzhcx"]
Jul 12 08:21:05.757289 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.757247    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87267641-8a09-42ba-8156-f43e069cf0f3" path="/var/lib/kubelet/pods/87267641-8a09-42ba-8156-f43e069cf0f3/volumes"
Jul 12 08:21:05.927526 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.927490    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cff869cd6-xxw8b"]
Jul 12 08:21:05.927896 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.927885    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87267641-8a09-42ba-8156-f43e069cf0f3" containerName="manager"
Jul 12 08:21:05.927941 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.927898    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="87267641-8a09-42ba-8156-f43e069cf0f3" containerName="manager"
Jul 12 08:21:05.927985 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.927977    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="87267641-8a09-42ba-8156-f43e069cf0f3" containerName="manager"
Jul 12 08:21:05.932640 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.932620    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:05.934926 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.934905    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 12 08:21:05.935745 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.935730    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 12 08:21:05.935834 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.935769    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tzdg4\""
Jul 12 08:21:05.940533 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.940424    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-xxw8b"]
Jul 12 08:21:05.981024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.980980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbq6\" (UniqueName: \"kubernetes.io/projected/b8ba6590-351f-41eb-bce7-28d5c84e9377-kube-api-access-5zbq6\") pod \"maas-controller-7cff869cd6-xxw8b\" (UID: \"b8ba6590-351f-41eb-bce7-28d5c84e9377\") " pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:05.981218 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:05.981070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8ba6590-351f-41eb-bce7-28d5c84e9377-webhook-cert\") pod \"maas-controller-7cff869cd6-xxw8b\" (UID: \"b8ba6590-351f-41eb-bce7-28d5c84e9377\") " pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:06.081852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:06.081816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbq6\" (UniqueName: \"kubernetes.io/projected/b8ba6590-351f-41eb-bce7-28d5c84e9377-kube-api-access-5zbq6\") pod \"maas-controller-7cff869cd6-xxw8b\" (UID: \"b8ba6590-351f-41eb-bce7-28d5c84e9377\") " pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:06.082055 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:06.081902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8ba6590-351f-41eb-bce7-28d5c84e9377-webhook-cert\") pod \"maas-controller-7cff869cd6-xxw8b\" (UID: \"b8ba6590-351f-41eb-bce7-28d5c84e9377\") " pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:06.084581 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:06.084560    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8ba6590-351f-41eb-bce7-28d5c84e9377-webhook-cert\") pod \"maas-controller-7cff869cd6-xxw8b\" (UID: \"b8ba6590-351f-41eb-bce7-28d5c84e9377\") " pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:06.090481 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:06.090457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbq6\" (UniqueName: \"kubernetes.io/projected/b8ba6590-351f-41eb-bce7-28d5c84e9377-kube-api-access-5zbq6\") pod \"maas-controller-7cff869cd6-xxw8b\" (UID: \"b8ba6590-351f-41eb-bce7-28d5c84e9377\") " pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:06.244770 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:06.244728    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:06.386864 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:06.386837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cff869cd6-xxw8b"]
Jul 12 08:21:06.388875 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:21:06.388842    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ba6590_351f_41eb_bce7_28d5c84e9377.slice/crio-d4f4cf2c3bd137fdb055ef6b99dbca75acf2d0371c5f3935d385b820fd226e9c WatchSource:0}: Error finding container d4f4cf2c3bd137fdb055ef6b99dbca75acf2d0371c5f3935d385b820fd226e9c: Status 404 returned error can't find the container with id d4f4cf2c3bd137fdb055ef6b99dbca75acf2d0371c5f3935d385b820fd226e9c
Jul 12 08:21:07.154731 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:07.154640    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cff869cd6-xxw8b" event={"ID":"b8ba6590-351f-41eb-bce7-28d5c84e9377","Type":"ContainerStarted","Data":"0781a2a67bab29bdea04843529977fb1aa4601098deb6c24ada2692e1813d5ee"}
Jul 12 08:21:07.154731 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:07.154702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cff869cd6-xxw8b" event={"ID":"b8ba6590-351f-41eb-bce7-28d5c84e9377","Type":"ContainerStarted","Data":"d4f4cf2c3bd137fdb055ef6b99dbca75acf2d0371c5f3935d385b820fd226e9c"}
Jul 12 08:21:07.154731 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:07.154726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:07.172342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:07.172269    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cff869cd6-xxw8b" podStartSLOduration=1.665956731 podStartE2EDuration="2.17225052s" totalImagesPullingTime="506.293789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:21:07.170175324 +0000 UTC m=+863.953175667" watchObservedRunningTime="2026-07-12 08:21:07.17225052 +0000 UTC m=+863.955250897"
Jul 12 08:21:18.165920 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:18.165879    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cff869cd6-xxw8b"
Jul 12 08:21:43.711662 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:43.711629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:21:43.712142 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:43.711629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:21:43.719409 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:43.719386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:21:43.719561 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:21:43.719386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:25:51.195627 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:51.195585    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"]
Jul 12 08:25:51.198243 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:51.195828    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr" podUID="77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" containerName="manager" containerID="cri-o://c66d135cca81d4518165da01eb181c297886c8abc703cae5df808f6220b0e5c1" gracePeriod=10
Jul 12 08:25:54.629568 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.629533    2558 generic.go:356] "Generic (PLEG): container finished" podID="77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" containerID="c66d135cca81d4518165da01eb181c297886c8abc703cae5df808f6220b0e5c1" exitCode=0
Jul 12 08:25:54.630029 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.629604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr" event={"ID":"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6","Type":"ContainerDied","Data":"c66d135cca81d4518165da01eb181c297886c8abc703cae5df808f6220b0e5c1"}
Jul 12 08:25:54.773384 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.773357    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:25:54.894319 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.894197    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtp44\" (UniqueName: \"kubernetes.io/projected/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-kube-api-access-rtp44\") pod \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") "
Jul 12 08:25:54.894500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.894336    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-extensions-socket-volume\") pod \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\" (UID: \"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6\") "
Jul 12 08:25:54.894684 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.894655    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" (UID: "77e82f7f-a98d-4942-a9c3-3ce42c1e58d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:25:54.896545 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.896519    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-kube-api-access-rtp44" (OuterVolumeSpecName: "kube-api-access-rtp44") pod "77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" (UID: "77e82f7f-a98d-4942-a9c3-3ce42c1e58d6"). InnerVolumeSpecName "kube-api-access-rtp44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:25:54.995775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.995738    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtp44\" (UniqueName: \"kubernetes.io/projected/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-kube-api-access-rtp44\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:25:54.995775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:54.995767    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6-extensions-socket-volume\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:25:55.635763 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:55.635732    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"
Jul 12 08:25:55.635763 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:55.635743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr" event={"ID":"77e82f7f-a98d-4942-a9c3-3ce42c1e58d6","Type":"ContainerDied","Data":"a5f1eafd419987b1a67589860c887318c682ec01bc60dbefbc18f995eebcedb9"}
Jul 12 08:25:55.636298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:55.635799    2558 scope.go:117] "RemoveContainer" containerID="c66d135cca81d4518165da01eb181c297886c8abc703cae5df808f6220b0e5c1"
Jul 12 08:25:55.656615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:55.656587    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"]
Jul 12 08:25:55.660439 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:55.660415    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bmhr"]
Jul 12 08:25:55.755782 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:25:55.755748    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" path="/var/lib/kubelet/pods/77e82f7f-a98d-4942-a9c3-3ce42c1e58d6/volumes"
Jul 12 08:26:43.743449 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:43.743413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:26:43.744820 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:43.744791    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:26:43.750946 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:43.750920    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:26:43.752692 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:43.752672    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:26:52.299386 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.299347    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"]
Jul 12 08:26:52.299769 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.299756    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" containerName="manager"
Jul 12 08:26:52.299769 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.299771    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" containerName="manager"
Jul 12 08:26:52.299906 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.299892    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="77e82f7f-a98d-4942-a9c3-3ce42c1e58d6" containerName="manager"
Jul 12 08:26:52.303117 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.303096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.305681 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.305661    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4m58q\""
Jul 12 08:26:52.316990 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.316957    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"]
Jul 12 08:26:52.422329 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.422250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vjd\" (UniqueName: \"kubernetes.io/projected/8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b-kube-api-access-x8vjd\") pod \"kuadrant-operator-controller-manager-86878c769f-cvntj\" (UID: \"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.422528 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.422359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvntj\" (UID: \"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.523227 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.523186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vjd\" (UniqueName: \"kubernetes.io/projected/8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b-kube-api-access-x8vjd\") pod \"kuadrant-operator-controller-manager-86878c769f-cvntj\" (UID: \"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.523459 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.523238    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvntj\" (UID: \"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.523689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.523669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvntj\" (UID: \"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.535061 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.535030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vjd\" (UniqueName: \"kubernetes.io/projected/8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b-kube-api-access-x8vjd\") pod \"kuadrant-operator-controller-manager-86878c769f-cvntj\" (UID: \"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.613455 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.613363    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.758163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.758140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"]
Jul 12 08:26:52.760954 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:26:52.760917    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6248eb_aa07_4c98_b9d1_6ea9b6fef29b.slice/crio-4af14134062a147d076cce2a99f2fc64f8d890cc65e249cda72f626e73702514 WatchSource:0}: Error finding container 4af14134062a147d076cce2a99f2fc64f8d890cc65e249cda72f626e73702514: Status 404 returned error can't find the container with id 4af14134062a147d076cce2a99f2fc64f8d890cc65e249cda72f626e73702514
Jul 12 08:26:52.929309 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.929201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj" event={"ID":"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b","Type":"ContainerStarted","Data":"f4f54621101150fad2bafde45b75ae93beed8b8d415c7c084cf71eb0207906cc"}
Jul 12 08:26:52.929309 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.929260    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj" event={"ID":"8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b","Type":"ContainerStarted","Data":"4af14134062a147d076cce2a99f2fc64f8d890cc65e249cda72f626e73702514"}
Jul 12 08:26:52.929509 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.929331    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:26:52.948471 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:26:52.948423    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj" podStartSLOduration=0.948407146 podStartE2EDuration="948.407146ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:26:52.946674787 +0000 UTC m=+1209.729675131" watchObservedRunningTime="2026-07-12 08:26:52.948407146 +0000 UTC m=+1209.731407490"
Jul 12 08:27:03.937191 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:27:03.937160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvntj"
Jul 12 08:31:43.774708 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:31:43.774679    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:31:43.782670 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:31:43.782646    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:31:43.788344 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:31:43.788327    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:31:43.795512 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:31:43.795490    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:32:52.485197 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.485163    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"]
Jul 12 08:32:52.488985 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.488965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.491581 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.491561    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-836b156d-serving-cert\""
Jul 12 08:32:52.499529 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.499506    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"]
Jul 12 08:32:52.551414 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.551374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3081eef1-d473-4f31-8f43-00cfe0790cb0-maas-api-tls\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.551414 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.551416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3081eef1-d473-4f31-8f43-00cfe0790cb0-openshift-service-ca\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.551634 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.551437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hqj\" (UniqueName: \"kubernetes.io/projected/3081eef1-d473-4f31-8f43-00cfe0790cb0-kube-api-access-44hqj\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.652490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.652449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hqj\" (UniqueName: \"kubernetes.io/projected/3081eef1-d473-4f31-8f43-00cfe0790cb0-kube-api-access-44hqj\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.652686 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.652626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3081eef1-d473-4f31-8f43-00cfe0790cb0-maas-api-tls\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.652686 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.652675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3081eef1-d473-4f31-8f43-00cfe0790cb0-openshift-service-ca\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.653459 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.653435    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3081eef1-d473-4f31-8f43-00cfe0790cb0-openshift-service-ca\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.655379 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.655350    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3081eef1-d473-4f31-8f43-00cfe0790cb0-maas-api-tls\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.661500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.661480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hqj\" (UniqueName: \"kubernetes.io/projected/3081eef1-d473-4f31-8f43-00cfe0790cb0-kube-api-access-44hqj\") pod \"maas-api-e2e-ait-836b156d-675fbfd964-fpt2p\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.801909 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.801866    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:52.955633 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.955608    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"]
Jul 12 08:32:52.958192 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:32:52.958163    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3081eef1_d473_4f31_8f43_00cfe0790cb0.slice/crio-c2ba5cec0178b0fc839cf0eaeb5dfa7beb903800f4d9a69102fe5869b1be732d WatchSource:0}: Error finding container c2ba5cec0178b0fc839cf0eaeb5dfa7beb903800f4d9a69102fe5869b1be732d: Status 404 returned error can't find the container with id c2ba5cec0178b0fc839cf0eaeb5dfa7beb903800f4d9a69102fe5869b1be732d
Jul 12 08:32:52.959610 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:52.959594    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:32:53.736129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:53.736044    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p" event={"ID":"3081eef1-d473-4f31-8f43-00cfe0790cb0","Type":"ContainerStarted","Data":"ffeca51933c6b4e2c1cf9b18c681ab24941c08c1b70244ec11067404eb62c02b"}
Jul 12 08:32:53.736129 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:53.736107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p" event={"ID":"3081eef1-d473-4f31-8f43-00cfe0790cb0","Type":"ContainerStarted","Data":"c2ba5cec0178b0fc839cf0eaeb5dfa7beb903800f4d9a69102fe5869b1be732d"}
Jul 12 08:32:53.736558 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:53.736146    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:53.753306 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:53.753231    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p" podStartSLOduration=1.356956118 podStartE2EDuration="1.753214639s" totalImagesPullingTime="396.258521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:32:53.75150561 +0000 UTC m=+1570.534505955" watchObservedRunningTime="2026-07-12 08:32:53.753214639 +0000 UTC m=+1570.536214982"
Jul 12 08:32:57.593967 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.593935    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"]
Jul 12 08:32:57.594430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.594167    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p" podUID="3081eef1-d473-4f31-8f43-00cfe0790cb0" containerName="maas-api" containerID="cri-o://ffeca51933c6b4e2c1cf9b18c681ab24941c08c1b70244ec11067404eb62c02b" gracePeriod=30
Jul 12 08:32:57.762893 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.762856    2558 generic.go:356] "Generic (PLEG): container finished" podID="3081eef1-d473-4f31-8f43-00cfe0790cb0" containerID="ffeca51933c6b4e2c1cf9b18c681ab24941c08c1b70244ec11067404eb62c02b" exitCode=0
Jul 12 08:32:57.763068 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.762922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p" event={"ID":"3081eef1-d473-4f31-8f43-00cfe0790cb0","Type":"ContainerDied","Data":"ffeca51933c6b4e2c1cf9b18c681ab24941c08c1b70244ec11067404eb62c02b"}
Jul 12 08:32:57.854800 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.854726    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:57.905391 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.905357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3081eef1-d473-4f31-8f43-00cfe0790cb0-openshift-service-ca\") pod \"3081eef1-d473-4f31-8f43-00cfe0790cb0\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") "
Jul 12 08:32:57.905568 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.905399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44hqj\" (UniqueName: \"kubernetes.io/projected/3081eef1-d473-4f31-8f43-00cfe0790cb0-kube-api-access-44hqj\") pod \"3081eef1-d473-4f31-8f43-00cfe0790cb0\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") "
Jul 12 08:32:57.905637 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.905571    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3081eef1-d473-4f31-8f43-00cfe0790cb0-maas-api-tls\") pod \"3081eef1-d473-4f31-8f43-00cfe0790cb0\" (UID: \"3081eef1-d473-4f31-8f43-00cfe0790cb0\") "
Jul 12 08:32:57.905720 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.905694    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3081eef1-d473-4f31-8f43-00cfe0790cb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3081eef1-d473-4f31-8f43-00cfe0790cb0" (UID: "3081eef1-d473-4f31-8f43-00cfe0790cb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:32:57.905884 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.905866    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3081eef1-d473-4f31-8f43-00cfe0790cb0-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:32:57.907681 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.907658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3081eef1-d473-4f31-8f43-00cfe0790cb0-kube-api-access-44hqj" (OuterVolumeSpecName: "kube-api-access-44hqj") pod "3081eef1-d473-4f31-8f43-00cfe0790cb0" (UID: "3081eef1-d473-4f31-8f43-00cfe0790cb0"). InnerVolumeSpecName "kube-api-access-44hqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:32:57.907795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:57.907780    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3081eef1-d473-4f31-8f43-00cfe0790cb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3081eef1-d473-4f31-8f43-00cfe0790cb0" (UID: "3081eef1-d473-4f31-8f43-00cfe0790cb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:32:58.007078 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.007029    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3081eef1-d473-4f31-8f43-00cfe0790cb0-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:32:58.007078 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.007072    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44hqj\" (UniqueName: \"kubernetes.io/projected/3081eef1-d473-4f31-8f43-00cfe0790cb0-kube-api-access-44hqj\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:32:58.771532 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.771501    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"
Jul 12 08:32:58.771532 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.771514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p" event={"ID":"3081eef1-d473-4f31-8f43-00cfe0790cb0","Type":"ContainerDied","Data":"c2ba5cec0178b0fc839cf0eaeb5dfa7beb903800f4d9a69102fe5869b1be732d"}
Jul 12 08:32:58.772191 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.771581    2558 scope.go:117] "RemoveContainer" containerID="ffeca51933c6b4e2c1cf9b18c681ab24941c08c1b70244ec11067404eb62c02b"
Jul 12 08:32:58.792990 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.792964    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"]
Jul 12 08:32:58.796706 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:58.796685    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-836b156d-675fbfd964-fpt2p"]
Jul 12 08:32:59.756903 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:32:59.756868    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3081eef1-d473-4f31-8f43-00cfe0790cb0" path="/var/lib/kubelet/pods/3081eef1-d473-4f31-8f43-00cfe0790cb0/volumes"
Jul 12 08:33:04.875918 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.875882    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"]
Jul 12 08:33:04.876908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.876497    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3081eef1-d473-4f31-8f43-00cfe0790cb0" containerName="maas-api"
Jul 12 08:33:04.876908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.876522    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3081eef1-d473-4f31-8f43-00cfe0790cb0" containerName="maas-api"
Jul 12 08:33:04.876908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.876697    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3081eef1-d473-4f31-8f43-00cfe0790cb0" containerName="maas-api"
Jul 12 08:33:04.881536 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.881515    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:04.883842 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.883819    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-65d96a1b-serving-cert\""
Jul 12 08:33:04.892490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.892461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"]
Jul 12 08:33:04.976342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.976268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6057ab8d-cc4f-499e-9aaa-f0768b06f377-maas-api-tls\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:04.976513 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.976351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6057ab8d-cc4f-499e-9aaa-f0768b06f377-openshift-service-ca\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:04.976513 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:04.976372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndfq\" (UniqueName: \"kubernetes.io/projected/6057ab8d-cc4f-499e-9aaa-f0768b06f377-kube-api-access-9ndfq\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.077825 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.077785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6057ab8d-cc4f-499e-9aaa-f0768b06f377-maas-api-tls\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.077825 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.077824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6057ab8d-cc4f-499e-9aaa-f0768b06f377-openshift-service-ca\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.078058 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.077843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndfq\" (UniqueName: \"kubernetes.io/projected/6057ab8d-cc4f-499e-9aaa-f0768b06f377-kube-api-access-9ndfq\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.078565 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.078546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6057ab8d-cc4f-499e-9aaa-f0768b06f377-openshift-service-ca\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.080457 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.080433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6057ab8d-cc4f-499e-9aaa-f0768b06f377-maas-api-tls\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.085881 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.085855    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndfq\" (UniqueName: \"kubernetes.io/projected/6057ab8d-cc4f-499e-9aaa-f0768b06f377-kube-api-access-9ndfq\") pod \"maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.194491 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.194397    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.358322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.358251    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"]
Jul 12 08:33:05.360355 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:33:05.360322    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6057ab8d_cc4f_499e_9aaa_f0768b06f377.slice/crio-f16c1c46c321c7c867aa0e0c9386dd2edeed0b8c66bb0a10a0c297b001ad54c2 WatchSource:0}: Error finding container f16c1c46c321c7c867aa0e0c9386dd2edeed0b8c66bb0a10a0c297b001ad54c2: Status 404 returned error can't find the container with id f16c1c46c321c7c867aa0e0c9386dd2edeed0b8c66bb0a10a0c297b001ad54c2
Jul 12 08:33:05.812440 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.812402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk" event={"ID":"6057ab8d-cc4f-499e-9aaa-f0768b06f377","Type":"ContainerStarted","Data":"2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9"}
Jul 12 08:33:05.812607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.812459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk" event={"ID":"6057ab8d-cc4f-499e-9aaa-f0768b06f377","Type":"ContainerStarted","Data":"f16c1c46c321c7c867aa0e0c9386dd2edeed0b8c66bb0a10a0c297b001ad54c2"}
Jul 12 08:33:05.812607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.812484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:05.830419 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:05.830368    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk" podStartSLOduration=1.512251498 podStartE2EDuration="1.830350094s" totalImagesPullingTime="318.098596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:33:05.829556671 +0000 UTC m=+1582.612557019" watchObservedRunningTime="2026-07-12 08:33:05.830350094 +0000 UTC m=+1582.613350438"
Jul 12 08:33:10.271919 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.271884    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"]
Jul 12 08:33:10.272387 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.272101    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk" podUID="6057ab8d-cc4f-499e-9aaa-f0768b06f377" containerName="maas-api" containerID="cri-o://2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9" gracePeriod=30
Jul 12 08:33:10.279303 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.279252    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:10.521668 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.521640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:10.633030 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.632948    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6057ab8d-cc4f-499e-9aaa-f0768b06f377-openshift-service-ca\") pod \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") "
Jul 12 08:33:10.633030 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.632985    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6057ab8d-cc4f-499e-9aaa-f0768b06f377-maas-api-tls\") pod \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") "
Jul 12 08:33:10.633030 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.633024    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ndfq\" (UniqueName: \"kubernetes.io/projected/6057ab8d-cc4f-499e-9aaa-f0768b06f377-kube-api-access-9ndfq\") pod \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\" (UID: \"6057ab8d-cc4f-499e-9aaa-f0768b06f377\") "
Jul 12 08:33:10.633331 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.633307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6057ab8d-cc4f-499e-9aaa-f0768b06f377-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6057ab8d-cc4f-499e-9aaa-f0768b06f377" (UID: "6057ab8d-cc4f-499e-9aaa-f0768b06f377"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:33:10.635224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.635194    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6057ab8d-cc4f-499e-9aaa-f0768b06f377-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6057ab8d-cc4f-499e-9aaa-f0768b06f377" (UID: "6057ab8d-cc4f-499e-9aaa-f0768b06f377"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:33:10.635358 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.635231    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6057ab8d-cc4f-499e-9aaa-f0768b06f377-kube-api-access-9ndfq" (OuterVolumeSpecName: "kube-api-access-9ndfq") pod "6057ab8d-cc4f-499e-9aaa-f0768b06f377" (UID: "6057ab8d-cc4f-499e-9aaa-f0768b06f377"). InnerVolumeSpecName "kube-api-access-9ndfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:33:10.734758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.734722    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6057ab8d-cc4f-499e-9aaa-f0768b06f377-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:33:10.734758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.734752    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6057ab8d-cc4f-499e-9aaa-f0768b06f377-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:33:10.734758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.734762    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ndfq\" (UniqueName: \"kubernetes.io/projected/6057ab8d-cc4f-499e-9aaa-f0768b06f377-kube-api-access-9ndfq\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:33:10.842435 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.842397    2558 generic.go:356] "Generic (PLEG): container finished" podID="6057ab8d-cc4f-499e-9aaa-f0768b06f377" containerID="2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9" exitCode=0
Jul 12 08:33:10.842435 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.842443    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"
Jul 12 08:33:10.842700 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.842478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk" event={"ID":"6057ab8d-cc4f-499e-9aaa-f0768b06f377","Type":"ContainerDied","Data":"2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9"}
Jul 12 08:33:10.842700 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.842535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk" event={"ID":"6057ab8d-cc4f-499e-9aaa-f0768b06f377","Type":"ContainerDied","Data":"f16c1c46c321c7c867aa0e0c9386dd2edeed0b8c66bb0a10a0c297b001ad54c2"}
Jul 12 08:33:10.842700 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.842559    2558 scope.go:117] "RemoveContainer" containerID="2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9"
Jul 12 08:33:10.852305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.852269    2558 scope.go:117] "RemoveContainer" containerID="2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9"
Jul 12 08:33:10.852548 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:33:10.852533    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9\": container with ID starting with 2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9 not found: ID does not exist" containerID="2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9"
Jul 12 08:33:10.852598 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.852556    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9"} err="failed to get container status \"2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9\": rpc error: code = NotFound desc = could not find container \"2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9\": container with ID starting with 2fc1bee213e2f28b5996cdb390ecc9a4f6996c088273b0d87e58f7313b168eb9 not found: ID does not exist"
Jul 12 08:33:10.863661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.863638    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"]
Jul 12 08:33:10.867217 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:10.867197    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-65d96a1b-6899fd59ff-jl4bk"]
Jul 12 08:33:11.757224 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:11.757189    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6057ab8d-cc4f-499e-9aaa-f0768b06f377" path="/var/lib/kubelet/pods/6057ab8d-cc4f-499e-9aaa-f0768b06f377/volumes"
Jul 12 08:33:23.326311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.326261    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"]
Jul 12 08:33:23.327040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.327015    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6057ab8d-cc4f-499e-9aaa-f0768b06f377" containerName="maas-api"
Jul 12 08:33:23.327040 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.327037    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6057ab8d-cc4f-499e-9aaa-f0768b06f377" containerName="maas-api"
Jul 12 08:33:23.327322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.327155    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6057ab8d-cc4f-499e-9aaa-f0768b06f377" containerName="maas-api"
Jul 12 08:33:23.330520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.330498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.333017 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.332983    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5249a3b1-serving-cert\""
Jul 12 08:33:23.344829 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.344802    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"]
Jul 12 08:33:23.347899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.347361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4d2f59-65cc-48c9-9802-ea5d949403e4-openshift-service-ca\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.347899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.347402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7j9v\" (UniqueName: \"kubernetes.io/projected/ef4d2f59-65cc-48c9-9802-ea5d949403e4-kube-api-access-z7j9v\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.347899 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.347460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.448839 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.448797    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4d2f59-65cc-48c9-9802-ea5d949403e4-openshift-service-ca\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.448839 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.448841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7j9v\" (UniqueName: \"kubernetes.io/projected/ef4d2f59-65cc-48c9-9802-ea5d949403e4-kube-api-access-z7j9v\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.449107 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.448891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.449107 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:33:23.449031    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-serving-cert: secret "maas-api-e2e-derive-5249a3b1-serving-cert" not found
Jul 12 08:33:23.449213 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:33:23.449112    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls podName:ef4d2f59-65cc-48c9-9802-ea5d949403e4 nodeName:}" failed. No retries permitted until 2026-07-12 08:33:23.94909081 +0000 UTC m=+1600.732091138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls") pod "maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" (UID: "ef4d2f59-65cc-48c9-9802-ea5d949403e4") : secret "maas-api-e2e-derive-5249a3b1-serving-cert" not found
Jul 12 08:33:23.449546 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.449523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4d2f59-65cc-48c9-9802-ea5d949403e4-openshift-service-ca\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.461050 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.461025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7j9v\" (UniqueName: \"kubernetes.io/projected/ef4d2f59-65cc-48c9-9802-ea5d949403e4-kube-api-access-z7j9v\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.953543 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.953509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:23.956327 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:23.956300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls\") pod \"maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:24.243804 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:24.243709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:24.387880 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:24.387858    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"]
Jul 12 08:33:24.390466 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:33:24.390420    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4d2f59_65cc_48c9_9802_ea5d949403e4.slice/crio-be4b744b8a7c5bae767bee0253825f668f1024bf3638368557ac9cc7ba16c558 WatchSource:0}: Error finding container be4b744b8a7c5bae767bee0253825f668f1024bf3638368557ac9cc7ba16c558: Status 404 returned error can't find the container with id be4b744b8a7c5bae767bee0253825f668f1024bf3638368557ac9cc7ba16c558
Jul 12 08:33:24.914434 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:24.914400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" event={"ID":"ef4d2f59-65cc-48c9-9802-ea5d949403e4","Type":"ContainerStarted","Data":"2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f"}
Jul 12 08:33:24.914608 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:24.914452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" event={"ID":"ef4d2f59-65cc-48c9-9802-ea5d949403e4","Type":"ContainerStarted","Data":"be4b744b8a7c5bae767bee0253825f668f1024bf3638368557ac9cc7ba16c558"}
Jul 12 08:33:24.914608 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:24.914499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:24.930574 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:24.930525    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" podStartSLOduration=1.5770012119999999 podStartE2EDuration="1.930510578s" totalImagesPullingTime="353.509366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:33:24.929631209 +0000 UTC m=+1601.712631556" watchObservedRunningTime="2026-07-12 08:33:24.930510578 +0000 UTC m=+1601.713510969"
Jul 12 08:33:27.892909 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:27.892878    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"]
Jul 12 08:33:27.893363 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:27.893087    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" podUID="ef4d2f59-65cc-48c9-9802-ea5d949403e4" containerName="maas-api" containerID="cri-o://2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f" gracePeriod=30
Jul 12 08:33:28.149191 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.149122    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:28.192353 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.192328    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4d2f59-65cc-48c9-9802-ea5d949403e4-openshift-service-ca\") pod \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") "
Jul 12 08:33:28.192526 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.192362    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls\") pod \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") "
Jul 12 08:33:28.192526 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.192419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7j9v\" (UniqueName: \"kubernetes.io/projected/ef4d2f59-65cc-48c9-9802-ea5d949403e4-kube-api-access-z7j9v\") pod \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\" (UID: \"ef4d2f59-65cc-48c9-9802-ea5d949403e4\") "
Jul 12 08:33:28.192768 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.192741    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4d2f59-65cc-48c9-9802-ea5d949403e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef4d2f59-65cc-48c9-9802-ea5d949403e4" (UID: "ef4d2f59-65cc-48c9-9802-ea5d949403e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:33:28.194690 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.194662    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4d2f59-65cc-48c9-9802-ea5d949403e4-kube-api-access-z7j9v" (OuterVolumeSpecName: "kube-api-access-z7j9v") pod "ef4d2f59-65cc-48c9-9802-ea5d949403e4" (UID: "ef4d2f59-65cc-48c9-9802-ea5d949403e4"). InnerVolumeSpecName "kube-api-access-z7j9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:33:28.194771 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.194666    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef4d2f59-65cc-48c9-9802-ea5d949403e4" (UID: "ef4d2f59-65cc-48c9-9802-ea5d949403e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:33:28.293390 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.293349    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7j9v\" (UniqueName: \"kubernetes.io/projected/ef4d2f59-65cc-48c9-9802-ea5d949403e4-kube-api-access-z7j9v\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:33:28.293390 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.293382    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef4d2f59-65cc-48c9-9802-ea5d949403e4-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:33:28.293390 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.293395    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef4d2f59-65cc-48c9-9802-ea5d949403e4-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:33:28.934659 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.934621    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef4d2f59-65cc-48c9-9802-ea5d949403e4" containerID="2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f" exitCode=0
Jul 12 08:33:28.935092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.934671    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"
Jul 12 08:33:28.935092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.934710    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" event={"ID":"ef4d2f59-65cc-48c9-9802-ea5d949403e4","Type":"ContainerDied","Data":"2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f"}
Jul 12 08:33:28.935092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.934768    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b" event={"ID":"ef4d2f59-65cc-48c9-9802-ea5d949403e4","Type":"ContainerDied","Data":"be4b744b8a7c5bae767bee0253825f668f1024bf3638368557ac9cc7ba16c558"}
Jul 12 08:33:28.935092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.934797    2558 scope.go:117] "RemoveContainer" containerID="2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f"
Jul 12 08:33:28.944980 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.944960    2558 scope.go:117] "RemoveContainer" containerID="2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f"
Jul 12 08:33:28.945259 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:33:28.945239    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f\": container with ID starting with 2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f not found: ID does not exist" containerID="2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f"
Jul 12 08:33:28.945363 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.945267    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f"} err="failed to get container status \"2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f\": rpc error: code = NotFound desc = could not find container \"2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f\": container with ID starting with 2eca5b3bab4eb83cea659ecf79079b5ebb31037ced7415ce816f6e340fbf077f not found: ID does not exist"
Jul 12 08:33:28.959310 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.959264    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"]
Jul 12 08:33:28.966092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:28.966064    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5249a3b1-56588dcfdf-4vs5b"]
Jul 12 08:33:28.987716 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:33:28.987687    2558 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4d2f59_65cc_48c9_9802_ea5d949403e4.slice\": RecentStats: unable to find data in memory cache]"
Jul 12 08:33:29.756434 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:33:29.756403    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef4d2f59-65cc-48c9-9802-ea5d949403e4" path="/var/lib/kubelet/pods/ef4d2f59-65cc-48c9-9802-ea5d949403e4/volumes"
Jul 12 08:35:11.176188 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.176114    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"]
Jul 12 08:35:11.176627 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.176548    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef4d2f59-65cc-48c9-9802-ea5d949403e4" containerName="maas-api"
Jul 12 08:35:11.176627 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.176559    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef4d2f59-65cc-48c9-9802-ea5d949403e4" containerName="maas-api"
Jul 12 08:35:11.176702 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.176629    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef4d2f59-65cc-48c9-9802-ea5d949403e4" containerName="maas-api"
Jul 12 08:35:11.179780 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.179763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.182085 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.182059    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7937c472-serving-cert\""
Jul 12 08:35:11.190422 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.190398    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"]
Jul 12 08:35:11.283436 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.283399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qchc\" (UniqueName: \"kubernetes.io/projected/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-kube-api-access-8qchc\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.283609 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.283470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.283609 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.283494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-openshift-service-ca\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.384713 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.384679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.384713 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.384716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-openshift-service-ca\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.384924 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.384787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qchc\" (UniqueName: \"kubernetes.io/projected/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-kube-api-access-8qchc\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.384924 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:35:11.384848    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-serving-cert: secret "maas-api-e2e-mt-7937c472-serving-cert" not found
Jul 12 08:35:11.385001 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:35:11.384928    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls podName:0e7e8ce4-68df-4a99-a9c4-bfe043ff972a nodeName:}" failed. No retries permitted until 2026-07-12 08:35:11.884908574 +0000 UTC m=+1708.667908918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls") pod "maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" (UID: "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a") : secret "maas-api-e2e-mt-7937c472-serving-cert" not found
Jul 12 08:35:11.385466 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.385449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-openshift-service-ca\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.393322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.393266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qchc\" (UniqueName: \"kubernetes.io/projected/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-kube-api-access-8qchc\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.889389 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:11.889349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:11.889573 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:35:11.889505    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-serving-cert: secret "maas-api-e2e-mt-7937c472-serving-cert" not found
Jul 12 08:35:11.889573 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:35:11.889566    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls podName:0e7e8ce4-68df-4a99-a9c4-bfe043ff972a nodeName:}" failed. No retries permitted until 2026-07-12 08:35:12.889550522 +0000 UTC m=+1709.672550844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls") pod "maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" (UID: "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a") : secret "maas-api-e2e-mt-7937c472-serving-cert" not found
Jul 12 08:35:12.897075 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:12.897040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:12.899763 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:12.899724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") pod \"maas-api-e2e-mt-7937c472-6f458f9776-jrwc8\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:12.992294 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:12.992241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:13.129994 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:13.129854    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"]
Jul 12 08:35:13.133211 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:35:13.133176    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7e8ce4_68df_4a99_a9c4_bfe043ff972a.slice/crio-53d0aabc1c36b71039ef08659f4ccaaaecc3de848bc3e8f27f544ce0c441e4c6 WatchSource:0}: Error finding container 53d0aabc1c36b71039ef08659f4ccaaaecc3de848bc3e8f27f544ce0c441e4c6: Status 404 returned error can't find the container with id 53d0aabc1c36b71039ef08659f4ccaaaecc3de848bc3e8f27f544ce0c441e4c6
Jul 12 08:35:13.457484 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:13.457453    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" event={"ID":"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a","Type":"ContainerStarted","Data":"53d0aabc1c36b71039ef08659f4ccaaaecc3de848bc3e8f27f544ce0c441e4c6"}
Jul 12 08:35:14.464063 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:14.464029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" event={"ID":"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a","Type":"ContainerStarted","Data":"dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79"}
Jul 12 08:35:14.464527 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:14.464098    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:14.481268 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:14.481223    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" podStartSLOduration=3.110229355 podStartE2EDuration="3.481207497s" totalImagesPullingTime="370.978142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:35:14.479801914 +0000 UTC m=+1711.262802261" watchObservedRunningTime="2026-07-12 08:35:14.481207497 +0000 UTC m=+1711.264207841"
Jul 12 08:35:20.475379 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:20.475349    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:23.067582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.067546    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"]
Jul 12 08:35:23.068024 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.067811    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" podUID="0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" containerName="maas-api" containerID="cri-o://dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79" gracePeriod=30
Jul 12 08:35:23.321944 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.321885    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:23.395626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.395591    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qchc\" (UniqueName: \"kubernetes.io/projected/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-kube-api-access-8qchc\") pod \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") "
Jul 12 08:35:23.395626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.395631    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") pod \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") "
Jul 12 08:35:23.395861 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.395674    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-openshift-service-ca\") pod \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\" (UID: \"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a\") "
Jul 12 08:35:23.396115 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.396091    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" (UID: "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:35:23.397840 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.397810    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" (UID: "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:35:23.397943 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.397847    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-kube-api-access-8qchc" (OuterVolumeSpecName: "kube-api-access-8qchc") pod "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" (UID: "0e7e8ce4-68df-4a99-a9c4-bfe043ff972a"). InnerVolumeSpecName "kube-api-access-8qchc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:35:23.497199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.497165    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:35:23.497199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.497192    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qchc\" (UniqueName: \"kubernetes.io/projected/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-kube-api-access-8qchc\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:35:23.497199 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.497202    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:35:23.510465 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.510433    2558 generic.go:356] "Generic (PLEG): container finished" podID="0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" containerID="dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79" exitCode=0
Jul 12 08:35:23.510617 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.510491    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"
Jul 12 08:35:23.510617 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.510513    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" event={"ID":"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a","Type":"ContainerDied","Data":"dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79"}
Jul 12 08:35:23.510617 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.510590    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8" event={"ID":"0e7e8ce4-68df-4a99-a9c4-bfe043ff972a","Type":"ContainerDied","Data":"53d0aabc1c36b71039ef08659f4ccaaaecc3de848bc3e8f27f544ce0c441e4c6"}
Jul 12 08:35:23.510617 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.510612    2558 scope.go:117] "RemoveContainer" containerID="dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79"
Jul 12 08:35:23.519851 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.519836    2558 scope.go:117] "RemoveContainer" containerID="dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79"
Jul 12 08:35:23.520114 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:35:23.520096    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79\": container with ID starting with dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79 not found: ID does not exist" containerID="dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79"
Jul 12 08:35:23.520161 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.520123    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79"} err="failed to get container status \"dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79\": rpc error: code = NotFound desc = could not find container \"dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79\": container with ID starting with dafc5497023bec63c4c4b312696954205bfebfd5888ef3628d82b64a8a6fdc79 not found: ID does not exist"
Jul 12 08:35:23.533492 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.533467    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"]
Jul 12 08:35:23.537613 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.537591    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7937c472-6f458f9776-jrwc8"]
Jul 12 08:35:23.756937 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:23.756857    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" path="/var/lib/kubelet/pods/0e7e8ce4-68df-4a99-a9c4-bfe043ff972a/volumes"
Jul 12 08:35:51.220330 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.220292    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"]
Jul 12 08:35:51.220986 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.220969    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" containerName="maas-api"
Jul 12 08:35:51.221034 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.220990    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" containerName="maas-api"
Jul 12 08:35:51.221092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.221080    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e7e8ce4-68df-4a99-a9c4-bfe043ff972a" containerName="maas-api"
Jul 12 08:35:51.224711 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.224691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.227323 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.227306    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a5ecc4df-serving-cert\""
Jul 12 08:35:51.232795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.232772    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"]
Jul 12 08:35:51.356712 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.356675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf1577d-8100-4b6b-b134-dd66ef014545-maas-api-tls\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.356923 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.356729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf1577d-8100-4b6b-b134-dd66ef014545-openshift-service-ca\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.356923 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.356830    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2s99\" (UniqueName: \"kubernetes.io/projected/fcf1577d-8100-4b6b-b134-dd66ef014545-kube-api-access-m2s99\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.457401 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.457371    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2s99\" (UniqueName: \"kubernetes.io/projected/fcf1577d-8100-4b6b-b134-dd66ef014545-kube-api-access-m2s99\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.457584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.457450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf1577d-8100-4b6b-b134-dd66ef014545-maas-api-tls\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.457584 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.457506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf1577d-8100-4b6b-b134-dd66ef014545-openshift-service-ca\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.458181 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.458163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf1577d-8100-4b6b-b134-dd66ef014545-openshift-service-ca\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.460042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.460007    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf1577d-8100-4b6b-b134-dd66ef014545-maas-api-tls\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.465479 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.465459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2s99\" (UniqueName: \"kubernetes.io/projected/fcf1577d-8100-4b6b-b134-dd66ef014545-kube-api-access-m2s99\") pod \"maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.536254 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.536225    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:51.674931 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:51.674906    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"]
Jul 12 08:35:51.677146 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:35:51.677117    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf1577d_8100_4b6b_b134_dd66ef014545.slice/crio-04b47298d889f371549cad651c2f7332f4af677c6b5e3f5d5e3d83371617227c WatchSource:0}: Error finding container 04b47298d889f371549cad651c2f7332f4af677c6b5e3f5d5e3d83371617227c: Status 404 returned error can't find the container with id 04b47298d889f371549cad651c2f7332f4af677c6b5e3f5d5e3d83371617227c
Jul 12 08:35:52.671804 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:52.671769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt" event={"ID":"fcf1577d-8100-4b6b-b134-dd66ef014545","Type":"ContainerStarted","Data":"27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2"}
Jul 12 08:35:52.672182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:52.671833    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt" event={"ID":"fcf1577d-8100-4b6b-b134-dd66ef014545","Type":"ContainerStarted","Data":"04b47298d889f371549cad651c2f7332f4af677c6b5e3f5d5e3d83371617227c"}
Jul 12 08:35:52.672182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:52.671863    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:35:52.688661 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:52.688616    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt" podStartSLOduration=1.316726766 podStartE2EDuration="1.688600192s" totalImagesPullingTime="371.873426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:35:52.687872105 +0000 UTC m=+1749.470872452" watchObservedRunningTime="2026-07-12 08:35:52.688600192 +0000 UTC m=+1749.471600533"
Jul 12 08:35:58.682320 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:35:58.682267    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:36:23.326195 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.326161    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"]
Jul 12 08:36:23.326730 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.326390    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt" podUID="fcf1577d-8100-4b6b-b134-dd66ef014545" containerName="maas-api" containerID="cri-o://27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2" gracePeriod=30
Jul 12 08:36:23.585153 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.585093    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:36:23.643037 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.642995    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf1577d-8100-4b6b-b134-dd66ef014545-openshift-service-ca\") pod \"fcf1577d-8100-4b6b-b134-dd66ef014545\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") "
Jul 12 08:36:23.643223 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.643107    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2s99\" (UniqueName: \"kubernetes.io/projected/fcf1577d-8100-4b6b-b134-dd66ef014545-kube-api-access-m2s99\") pod \"fcf1577d-8100-4b6b-b134-dd66ef014545\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") "
Jul 12 08:36:23.643223 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.643158    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf1577d-8100-4b6b-b134-dd66ef014545-maas-api-tls\") pod \"fcf1577d-8100-4b6b-b134-dd66ef014545\" (UID: \"fcf1577d-8100-4b6b-b134-dd66ef014545\") "
Jul 12 08:36:23.643418 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.643395    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcf1577d-8100-4b6b-b134-dd66ef014545-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fcf1577d-8100-4b6b-b134-dd66ef014545" (UID: "fcf1577d-8100-4b6b-b134-dd66ef014545"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:36:23.643517 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.643500    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcf1577d-8100-4b6b-b134-dd66ef014545-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:36:23.645264 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.645236    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcf1577d-8100-4b6b-b134-dd66ef014545-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fcf1577d-8100-4b6b-b134-dd66ef014545" (UID: "fcf1577d-8100-4b6b-b134-dd66ef014545"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:36:23.645415 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.645347    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf1577d-8100-4b6b-b134-dd66ef014545-kube-api-access-m2s99" (OuterVolumeSpecName: "kube-api-access-m2s99") pod "fcf1577d-8100-4b6b-b134-dd66ef014545" (UID: "fcf1577d-8100-4b6b-b134-dd66ef014545"). InnerVolumeSpecName "kube-api-access-m2s99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:36:23.744679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.744628    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2s99\" (UniqueName: \"kubernetes.io/projected/fcf1577d-8100-4b6b-b134-dd66ef014545-kube-api-access-m2s99\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:36:23.744679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.744661    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fcf1577d-8100-4b6b-b134-dd66ef014545-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:36:23.826100 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.826060    2558 generic.go:356] "Generic (PLEG): container finished" podID="fcf1577d-8100-4b6b-b134-dd66ef014545" containerID="27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2" exitCode=0
Jul 12 08:36:23.826298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.826099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt" event={"ID":"fcf1577d-8100-4b6b-b134-dd66ef014545","Type":"ContainerDied","Data":"27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2"}
Jul 12 08:36:23.826298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.826154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt" event={"ID":"fcf1577d-8100-4b6b-b134-dd66ef014545","Type":"ContainerDied","Data":"04b47298d889f371549cad651c2f7332f4af677c6b5e3f5d5e3d83371617227c"}
Jul 12 08:36:23.826298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.826177    2558 scope.go:117] "RemoveContainer" containerID="27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2"
Jul 12 08:36:23.826298 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.826109    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"
Jul 12 08:36:23.835400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.835373    2558 scope.go:117] "RemoveContainer" containerID="27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2"
Jul 12 08:36:23.835642 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:36:23.835617    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2\": container with ID starting with 27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2 not found: ID does not exist" containerID="27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2"
Jul 12 08:36:23.835750 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.835653    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2"} err="failed to get container status \"27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2\": rpc error: code = NotFound desc = could not find container \"27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2\": container with ID starting with 27f214e661d5d6b43053e03087aaa072da5f4cf6b4c98f3d9f25558eb68f26d2 not found: ID does not exist"
Jul 12 08:36:23.841609 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.841587    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"]
Jul 12 08:36:23.845508 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:23.845482    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a5ecc4df-647f454fb5-vb6wt"]
Jul 12 08:36:25.756181 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:25.756147    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf1577d-8100-4b6b-b134-dd66ef014545" path="/var/lib/kubelet/pods/fcf1577d-8100-4b6b-b134-dd66ef014545/volumes"
Jul 12 08:36:43.809177 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:43.809060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:36:43.817101 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:43.817078    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:36:43.821118 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:43.821098    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:36:43.828185 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:36:43.828169    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:38:14.831075 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.830986    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"]
Jul 12 08:38:14.831671 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.831651    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf1577d-8100-4b6b-b134-dd66ef014545" containerName="maas-api"
Jul 12 08:38:14.831719 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.831676    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf1577d-8100-4b6b-b134-dd66ef014545" containerName="maas-api"
Jul 12 08:38:14.831799 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.831788    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf1577d-8100-4b6b-b134-dd66ef014545" containerName="maas-api"
Jul 12 08:38:14.835870 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.835850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:14.838201 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.838178    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-050284-serving-cert\""
Jul 12 08:38:14.845488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.845452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"]
Jul 12 08:38:14.974820 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.974782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39ed0a3-01ab-4d08-96cd-53b6435150c4-maas-api-tls\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:14.975036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.974841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582vt\" (UniqueName: \"kubernetes.io/projected/a39ed0a3-01ab-4d08-96cd-53b6435150c4-kube-api-access-582vt\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:14.975036 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:14.974905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39ed0a3-01ab-4d08-96cd-53b6435150c4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.075787 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.075753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39ed0a3-01ab-4d08-96cd-53b6435150c4-maas-api-tls\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.075978 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.075813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582vt\" (UniqueName: \"kubernetes.io/projected/a39ed0a3-01ab-4d08-96cd-53b6435150c4-kube-api-access-582vt\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.075978 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.075858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39ed0a3-01ab-4d08-96cd-53b6435150c4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.076597 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.076550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39ed0a3-01ab-4d08-96cd-53b6435150c4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.078167 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.078144    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39ed0a3-01ab-4d08-96cd-53b6435150c4-maas-api-tls\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.086227 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.086177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-582vt\" (UniqueName: \"kubernetes.io/projected/a39ed0a3-01ab-4d08-96cd-53b6435150c4-kube-api-access-582vt\") pod \"maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.150967 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.150897    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:15.295813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.295789    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"]
Jul 12 08:38:15.298220 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:38:15.298188    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39ed0a3_01ab_4d08_96cd_53b6435150c4.slice/crio-d8b48d6fb50ee8d62225ab9057fe3ab2a89c858645eaa6cc9b8c1366e34acf08 WatchSource:0}: Error finding container d8b48d6fb50ee8d62225ab9057fe3ab2a89c858645eaa6cc9b8c1366e34acf08: Status 404 returned error can't find the container with id d8b48d6fb50ee8d62225ab9057fe3ab2a89c858645eaa6cc9b8c1366e34acf08
Jul 12 08:38:15.299765 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.299749    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:38:15.408419 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:15.408321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg" event={"ID":"a39ed0a3-01ab-4d08-96cd-53b6435150c4","Type":"ContainerStarted","Data":"d8b48d6fb50ee8d62225ab9057fe3ab2a89c858645eaa6cc9b8c1366e34acf08"}
Jul 12 08:38:16.414758 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:16.414726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg" event={"ID":"a39ed0a3-01ab-4d08-96cd-53b6435150c4","Type":"ContainerStarted","Data":"776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc"}
Jul 12 08:38:16.415180 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:16.414854    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:16.430745 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:16.430689    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg" podStartSLOduration=2.003323032 podStartE2EDuration="2.430672159s" totalImagesPullingTime="427.349127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:38:16.429928844 +0000 UTC m=+1893.212929211" watchObservedRunningTime="2026-07-12 08:38:16.430672159 +0000 UTC m=+1893.213672504"
Jul 12 08:38:22.425136 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:22.425106    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:38:22.870892 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:22.867685    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"]
Jul 12 08:38:22.873488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:22.873458    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:22.876074 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:22.876048    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-34847c-serving-cert\""
Jul 12 08:38:22.878265 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:22.878237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"]
Jul 12 08:38:23.053144 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.053094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hb47\" (UniqueName: \"kubernetes.io/projected/8fb832e5-665c-42a9-a7a4-9b3691e2f815-kube-api-access-6hb47\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.053375 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.053183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.053375 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.053318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb832e5-665c-42a9-a7a4-9b3691e2f815-openshift-service-ca\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.154494 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.154401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hb47\" (UniqueName: \"kubernetes.io/projected/8fb832e5-665c-42a9-a7a4-9b3691e2f815-kube-api-access-6hb47\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.154494 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.154470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.154724 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.154547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb832e5-665c-42a9-a7a4-9b3691e2f815-openshift-service-ca\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.154724 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:38:23.154624    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-serving-cert: secret "maas-api-e2e-inf-b-34847c-serving-cert" not found
Jul 12 08:38:23.154724 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:38:23.154716    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls podName:8fb832e5-665c-42a9-a7a4-9b3691e2f815 nodeName:}" failed. No retries permitted until 2026-07-12 08:38:23.654699263 +0000 UTC m=+1900.437699585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls") pod "maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" (UID: "8fb832e5-665c-42a9-a7a4-9b3691e2f815") : secret "maas-api-e2e-inf-b-34847c-serving-cert" not found
Jul 12 08:38:23.155317 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.155294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb832e5-665c-42a9-a7a4-9b3691e2f815-openshift-service-ca\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.163547 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.163517    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hb47\" (UniqueName: \"kubernetes.io/projected/8fb832e5-665c-42a9-a7a4-9b3691e2f815-kube-api-access-6hb47\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.659081 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.659046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.661696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.661673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls\") pod \"maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.787768 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.787726    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:23.927679 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:23.927650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"]
Jul 12 08:38:23.930200 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:38:23.930175    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb832e5_665c_42a9_a7a4_9b3691e2f815.slice/crio-15fc750961d93dcf70e06599455db7ca2e347ca26896fc1b6de531093b95751a WatchSource:0}: Error finding container 15fc750961d93dcf70e06599455db7ca2e347ca26896fc1b6de531093b95751a: Status 404 returned error can't find the container with id 15fc750961d93dcf70e06599455db7ca2e347ca26896fc1b6de531093b95751a
Jul 12 08:38:24.458206 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:24.458172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" event={"ID":"8fb832e5-665c-42a9-a7a4-9b3691e2f815","Type":"ContainerStarted","Data":"be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7"}
Jul 12 08:38:24.458411 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:24.458226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" event={"ID":"8fb832e5-665c-42a9-a7a4-9b3691e2f815","Type":"ContainerStarted","Data":"15fc750961d93dcf70e06599455db7ca2e347ca26896fc1b6de531093b95751a"}
Jul 12 08:38:24.458411 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:24.458304    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:38:24.477520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:24.477463    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" podStartSLOduration=2.128630548 podStartE2EDuration="2.477445961s" totalImagesPullingTime="348.815413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:38:24.476153467 +0000 UTC m=+1901.259153811" watchObservedRunningTime="2026-07-12 08:38:24.477445961 +0000 UTC m=+1901.260446304"
Jul 12 08:38:30.470568 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:38:30.470525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:39:05.884551 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.884518    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"]
Jul 12 08:39:05.888514 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.888497    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:05.891874 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.891851    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-34847c\"/\"openshift-service-ca.crt\""
Jul 12 08:39:05.892001 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.891882    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-34847c\"/\"kube-root-ca.crt\""
Jul 12 08:39:05.892001 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.891855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-34847c\"/\"test-model-34847c-kserve-self-signed-certs\""
Jul 12 08:39:05.892001 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.891952    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-34847c\"/\"default-dockercfg-dz77m\""
Jul 12 08:39:05.897191 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.897167    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"]
Jul 12 08:39:05.965990 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.965954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-dshm\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:05.965990 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.965991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-tmp-dir\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:05.966266 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.966014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt6cr\" (UniqueName: \"kubernetes.io/projected/087feeb6-9675-4bed-a2b6-64a6aa05733f-kube-api-access-xt6cr\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:05.966266 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.966035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-model-cache\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:05.966266 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.966052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/087feeb6-9675-4bed-a2b6-64a6aa05733f-tls-certs\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:05.966266 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:05.966188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-home\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067515 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-home\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067722 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-dshm\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067722 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-tmp-dir\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067722 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt6cr\" (UniqueName: \"kubernetes.io/projected/087feeb6-9675-4bed-a2b6-64a6aa05733f-kube-api-access-xt6cr\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067880 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-model-cache\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067880 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/087feeb6-9675-4bed-a2b6-64a6aa05733f-tls-certs\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.067982 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-home\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.068030 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.067987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-tmp-dir\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.068070 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.068046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-model-cache\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.069960 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.069935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-dshm\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.070262 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.070245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/087feeb6-9675-4bed-a2b6-64a6aa05733f-tls-certs\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.075646 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.075625    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt6cr\" (UniqueName: \"kubernetes.io/projected/087feeb6-9675-4bed-a2b6-64a6aa05733f-kube-api-access-xt6cr\") pod \"test-model-34847c-kserve-558c6475bc-lqgz8\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") " pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.198269 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.198188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:06.336796 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.336767    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"]
Jul 12 08:39:06.338614 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:39:06.338585    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod087feeb6_9675_4bed_a2b6_64a6aa05733f.slice/crio-d6b3a0ea60ec2f0930a75219648e9aee789f41c1131d92247192a23c812d2474 WatchSource:0}: Error finding container d6b3a0ea60ec2f0930a75219648e9aee789f41c1131d92247192a23c812d2474: Status 404 returned error can't find the container with id d6b3a0ea60ec2f0930a75219648e9aee789f41c1131d92247192a23c812d2474
Jul 12 08:39:06.684565 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.684526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8" event={"ID":"087feeb6-9675-4bed-a2b6-64a6aa05733f","Type":"ContainerStarted","Data":"aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33"}
Jul 12 08:39:06.684757 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.684576    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8" event={"ID":"087feeb6-9675-4bed-a2b6-64a6aa05733f","Type":"ContainerStarted","Data":"d6b3a0ea60ec2f0930a75219648e9aee789f41c1131d92247192a23c812d2474"}
Jul 12 08:39:06.702886 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:06.702836    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8" podStartSLOduration=1.702820173 podStartE2EDuration="1.702820173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:39:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:39:06.701800145 +0000 UTC m=+1943.484800489" watchObservedRunningTime="2026-07-12 08:39:06.702820173 +0000 UTC m=+1943.485820517"
Jul 12 08:39:16.198349 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:16.198319    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:16.198900 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:16.198616    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:16.211384 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:16.211355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:16.750929 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:16.750897    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:26.470913 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:26.470879    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"]
Jul 12 08:39:27.433251 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.433220    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"]
Jul 12 08:39:27.433537 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.433509    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg" podUID="a39ed0a3-01ab-4d08-96cd-53b6435150c4" containerName="maas-api" containerID="cri-o://776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc" gracePeriod=30
Jul 12 08:39:27.688950 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.688894    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:39:27.786268 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.786242    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39ed0a3-01ab-4d08-96cd-53b6435150c4-maas-api-tls\") pod \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") "
Jul 12 08:39:27.786454 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.786357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-582vt\" (UniqueName: \"kubernetes.io/projected/a39ed0a3-01ab-4d08-96cd-53b6435150c4-kube-api-access-582vt\") pod \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") "
Jul 12 08:39:27.786454 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.786425    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39ed0a3-01ab-4d08-96cd-53b6435150c4-openshift-service-ca\") pod \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\" (UID: \"a39ed0a3-01ab-4d08-96cd-53b6435150c4\") "
Jul 12 08:39:27.786779 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.786753    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a39ed0a3-01ab-4d08-96cd-53b6435150c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a39ed0a3-01ab-4d08-96cd-53b6435150c4" (UID: "a39ed0a3-01ab-4d08-96cd-53b6435150c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:39:27.788516 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.788490    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39ed0a3-01ab-4d08-96cd-53b6435150c4-kube-api-access-582vt" (OuterVolumeSpecName: "kube-api-access-582vt") pod "a39ed0a3-01ab-4d08-96cd-53b6435150c4" (UID: "a39ed0a3-01ab-4d08-96cd-53b6435150c4"). InnerVolumeSpecName "kube-api-access-582vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:39:27.788731 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.788712    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39ed0a3-01ab-4d08-96cd-53b6435150c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a39ed0a3-01ab-4d08-96cd-53b6435150c4" (UID: "a39ed0a3-01ab-4d08-96cd-53b6435150c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:39:27.793581 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.793555    2558 generic.go:356] "Generic (PLEG): container finished" podID="a39ed0a3-01ab-4d08-96cd-53b6435150c4" containerID="776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc" exitCode=0
Jul 12 08:39:27.793689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.793600    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"
Jul 12 08:39:27.793760 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.793705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg" event={"ID":"a39ed0a3-01ab-4d08-96cd-53b6435150c4","Type":"ContainerDied","Data":"776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc"}
Jul 12 08:39:27.794311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.794213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg" event={"ID":"a39ed0a3-01ab-4d08-96cd-53b6435150c4","Type":"ContainerDied","Data":"d8b48d6fb50ee8d62225ab9057fe3ab2a89c858645eaa6cc9b8c1366e34acf08"}
Jul 12 08:39:27.794311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.794310    2558 scope.go:117] "RemoveContainer" containerID="776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc"
Jul 12 08:39:27.813359 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.813338    2558 scope.go:117] "RemoveContainer" containerID="776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc"
Jul 12 08:39:27.813639 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:39:27.813619    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc\": container with ID starting with 776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc not found: ID does not exist" containerID="776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc"
Jul 12 08:39:27.813704 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.813648    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc"} err="failed to get container status \"776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc\": rpc error: code = NotFound desc = could not find container \"776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc\": container with ID starting with 776af8abda0bd2cf36e555ee183e3d4fa285bcbef0a37f5d3d84565c4b6377cc not found: ID does not exist"
Jul 12 08:39:27.822921 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.822894    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"]
Jul 12 08:39:27.826600 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.826580    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-050284-db4d5cfc9-2wxkg"]
Jul 12 08:39:27.887915 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.887885    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-582vt\" (UniqueName: \"kubernetes.io/projected/a39ed0a3-01ab-4d08-96cd-53b6435150c4-kube-api-access-582vt\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:27.887915 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.887910    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a39ed0a3-01ab-4d08-96cd-53b6435150c4-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:27.888104 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:27.887923    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a39ed0a3-01ab-4d08-96cd-53b6435150c4-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:29.756209 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:29.756175    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a39ed0a3-01ab-4d08-96cd-53b6435150c4" path="/var/lib/kubelet/pods/a39ed0a3-01ab-4d08-96cd-53b6435150c4/volumes"
Jul 12 08:39:41.493176 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.493130    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8" podUID="087feeb6-9675-4bed-a2b6-64a6aa05733f" containerName="main" containerID="cri-o://aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33" gracePeriod=45
Jul 12 08:39:41.747456 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.747395    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:41.869256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.869217    2558 generic.go:356] "Generic (PLEG): container finished" podID="087feeb6-9675-4bed-a2b6-64a6aa05733f" containerID="aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33" exitCode=0
Jul 12 08:39:41.869256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.869258    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"
Jul 12 08:39:41.869492 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.869319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8" event={"ID":"087feeb6-9675-4bed-a2b6-64a6aa05733f","Type":"ContainerDied","Data":"aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33"}
Jul 12 08:39:41.869492 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.869365    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8" event={"ID":"087feeb6-9675-4bed-a2b6-64a6aa05733f","Type":"ContainerDied","Data":"d6b3a0ea60ec2f0930a75219648e9aee789f41c1131d92247192a23c812d2474"}
Jul 12 08:39:41.869492 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.869386    2558 scope.go:117] "RemoveContainer" containerID="aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33"
Jul 12 08:39:41.878208 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.878178    2558 scope.go:117] "RemoveContainer" containerID="aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33"
Jul 12 08:39:41.878505 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:39:41.878484    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33\": container with ID starting with aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33 not found: ID does not exist" containerID="aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33"
Jul 12 08:39:41.878562 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.878515    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33"} err="failed to get container status \"aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33\": rpc error: code = NotFound desc = could not find container \"aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33\": container with ID starting with aec32fec365c8ce082f49c638f9ee520472840905380155a283e713e1afbab33 not found: ID does not exist"
Jul 12 08:39:41.920551 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920521    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-model-cache\") pod \"087feeb6-9675-4bed-a2b6-64a6aa05733f\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") "
Jul 12 08:39:41.920691 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920566    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-tmp-dir\") pod \"087feeb6-9675-4bed-a2b6-64a6aa05733f\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") "
Jul 12 08:39:41.920691 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920587    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-home\") pod \"087feeb6-9675-4bed-a2b6-64a6aa05733f\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") "
Jul 12 08:39:41.920691 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-dshm\") pod \"087feeb6-9675-4bed-a2b6-64a6aa05733f\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") "
Jul 12 08:39:41.920813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920710    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/087feeb6-9675-4bed-a2b6-64a6aa05733f-tls-certs\") pod \"087feeb6-9675-4bed-a2b6-64a6aa05733f\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") "
Jul 12 08:39:41.920813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920755    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt6cr\" (UniqueName: \"kubernetes.io/projected/087feeb6-9675-4bed-a2b6-64a6aa05733f-kube-api-access-xt6cr\") pod \"087feeb6-9675-4bed-a2b6-64a6aa05733f\" (UID: \"087feeb6-9675-4bed-a2b6-64a6aa05733f\") "
Jul 12 08:39:41.920813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920791    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-model-cache" (OuterVolumeSpecName: "model-cache") pod "087feeb6-9675-4bed-a2b6-64a6aa05733f" (UID: "087feeb6-9675-4bed-a2b6-64a6aa05733f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:39:41.920951 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920807    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "087feeb6-9675-4bed-a2b6-64a6aa05733f" (UID: "087feeb6-9675-4bed-a2b6-64a6aa05733f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:39:41.920951 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.920863    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-home" (OuterVolumeSpecName: "home") pod "087feeb6-9675-4bed-a2b6-64a6aa05733f" (UID: "087feeb6-9675-4bed-a2b6-64a6aa05733f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:39:41.921122 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.921106    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-model-cache\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:41.921195 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.921124    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-tmp-dir\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:41.921195 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.921132    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-home\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:41.923005 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.922979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087feeb6-9675-4bed-a2b6-64a6aa05733f-kube-api-access-xt6cr" (OuterVolumeSpecName: "kube-api-access-xt6cr") pod "087feeb6-9675-4bed-a2b6-64a6aa05733f" (UID: "087feeb6-9675-4bed-a2b6-64a6aa05733f"). InnerVolumeSpecName "kube-api-access-xt6cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:39:41.923112 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.923004    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/087feeb6-9675-4bed-a2b6-64a6aa05733f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "087feeb6-9675-4bed-a2b6-64a6aa05733f" (UID: "087feeb6-9675-4bed-a2b6-64a6aa05733f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:39:41.923112 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:41.923025    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-dshm" (OuterVolumeSpecName: "dshm") pod "087feeb6-9675-4bed-a2b6-64a6aa05733f" (UID: "087feeb6-9675-4bed-a2b6-64a6aa05733f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:39:42.021934 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:42.021895    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt6cr\" (UniqueName: \"kubernetes.io/projected/087feeb6-9675-4bed-a2b6-64a6aa05733f-kube-api-access-xt6cr\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:42.021934 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:42.021928    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/087feeb6-9675-4bed-a2b6-64a6aa05733f-dshm\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:42.022128 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:42.021942    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/087feeb6-9675-4bed-a2b6-64a6aa05733f-tls-certs\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:39:42.192182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:42.192147    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"]
Jul 12 08:39:42.196440 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:42.196414    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-34847c/test-model-34847c-kserve-558c6475bc-lqgz8"]
Jul 12 08:39:43.757651 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:39:43.757611    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087feeb6-9675-4bed-a2b6-64a6aa05733f" path="/var/lib/kubelet/pods/087feeb6-9675-4bed-a2b6-64a6aa05733f/volumes"
Jul 12 08:40:10.289256 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.289216    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"]
Jul 12 08:40:10.290558 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.290520    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" podUID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" containerName="maas-api" containerID="cri-o://be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7" gracePeriod=30
Jul 12 08:40:10.543836 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.543771    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:40:10.697346 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.697266    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls\") pod \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") "
Jul 12 08:40:10.697526 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.697500    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb832e5-665c-42a9-a7a4-9b3691e2f815-openshift-service-ca\") pod \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") "
Jul 12 08:40:10.697583 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.697535    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hb47\" (UniqueName: \"kubernetes.io/projected/8fb832e5-665c-42a9-a7a4-9b3691e2f815-kube-api-access-6hb47\") pod \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\" (UID: \"8fb832e5-665c-42a9-a7a4-9b3691e2f815\") "
Jul 12 08:40:10.697854 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.697820    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb832e5-665c-42a9-a7a4-9b3691e2f815-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fb832e5-665c-42a9-a7a4-9b3691e2f815" (UID: "8fb832e5-665c-42a9-a7a4-9b3691e2f815"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:40:10.699506 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.699481    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fb832e5-665c-42a9-a7a4-9b3691e2f815" (UID: "8fb832e5-665c-42a9-a7a4-9b3691e2f815"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:40:10.699705 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.699683    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb832e5-665c-42a9-a7a4-9b3691e2f815-kube-api-access-6hb47" (OuterVolumeSpecName: "kube-api-access-6hb47") pod "8fb832e5-665c-42a9-a7a4-9b3691e2f815" (UID: "8fb832e5-665c-42a9-a7a4-9b3691e2f815"). InnerVolumeSpecName "kube-api-access-6hb47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:40:10.798365 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.798238    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb832e5-665c-42a9-a7a4-9b3691e2f815-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:40:10.798365 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.798304    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hb47\" (UniqueName: \"kubernetes.io/projected/8fb832e5-665c-42a9-a7a4-9b3691e2f815-kube-api-access-6hb47\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:40:10.798365 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:10.798320    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb832e5-665c-42a9-a7a4-9b3691e2f815-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:40:11.016474 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.016432    2558 generic.go:356] "Generic (PLEG): container finished" podID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" containerID="be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7" exitCode=0
Jul 12 08:40:11.016651 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.016484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" event={"ID":"8fb832e5-665c-42a9-a7a4-9b3691e2f815","Type":"ContainerDied","Data":"be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7"}
Jul 12 08:40:11.016651 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.016525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" event={"ID":"8fb832e5-665c-42a9-a7a4-9b3691e2f815","Type":"ContainerDied","Data":"15fc750961d93dcf70e06599455db7ca2e347ca26896fc1b6de531093b95751a"}
Jul 12 08:40:11.016651 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.016548    2558 scope.go:117] "RemoveContainer" containerID="be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7"
Jul 12 08:40:11.016651 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.016485    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"
Jul 12 08:40:11.028612 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.028551    2558 scope.go:117] "RemoveContainer" containerID="be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7"
Jul 12 08:40:11.029040 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:40:11.029016    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7\": container with ID starting with be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7 not found: ID does not exist" containerID="be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7"
Jul 12 08:40:11.029156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.029049    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7"} err="failed to get container status \"be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7\": rpc error: code = NotFound desc = could not find container \"be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7\": container with ID starting with be0f0fc64b494bfe1db423641032171ca71d6729926da44bb4aca9f09a3465d7 not found: ID does not exist"
Jul 12 08:40:11.038813 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.038786    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"]
Jul 12 08:40:11.042670 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.042643    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd"]
Jul 12 08:40:11.756702 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:11.756668    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" path="/var/lib/kubelet/pods/8fb832e5-665c-42a9-a7a4-9b3691e2f815/volumes"
Jul 12 08:40:13.464459 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:13.464410    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34847c-5bdbf49b98-8z2pd" podUID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.56:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 12 08:40:20.501331 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501267    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"]
Jul 12 08:40:20.501788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501771    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" containerName="maas-api"
Jul 12 08:40:20.501788 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501786    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" containerName="maas-api"
Jul 12 08:40:20.501859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501802    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39ed0a3-01ab-4d08-96cd-53b6435150c4" containerName="maas-api"
Jul 12 08:40:20.501859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501807    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39ed0a3-01ab-4d08-96cd-53b6435150c4" containerName="maas-api"
Jul 12 08:40:20.501859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501821    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087feeb6-9675-4bed-a2b6-64a6aa05733f" containerName="main"
Jul 12 08:40:20.501859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501828    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="087feeb6-9675-4bed-a2b6-64a6aa05733f" containerName="main"
Jul 12 08:40:20.501980 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501898    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb832e5-665c-42a9-a7a4-9b3691e2f815" containerName="maas-api"
Jul 12 08:40:20.501980 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501907    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="087feeb6-9675-4bed-a2b6-64a6aa05733f" containerName="main"
Jul 12 08:40:20.501980 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.501915    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39ed0a3-01ab-4d08-96cd-53b6435150c4" containerName="maas-api"
Jul 12 08:40:20.505033 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.505017    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.507464 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.507441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-449923-serving-cert\""
Jul 12 08:40:20.515248 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.515225    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"]
Jul 12 08:40:20.589738 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.589702    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqv95\" (UniqueName: \"kubernetes.io/projected/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-kube-api-access-kqv95\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.589920 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.589770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.589920 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.589798    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-openshift-service-ca\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.691200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.691163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.691430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.691205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-openshift-service-ca\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.691430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.691310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqv95\" (UniqueName: \"kubernetes.io/projected/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-kube-api-access-kqv95\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.691430 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:40:20.691342    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-449923-serving-cert: secret "maas-api-e2e-api-a-449923-serving-cert" not found
Jul 12 08:40:20.691430 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:40:20.691413    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls podName:15b355a6-c6d0-4a1f-89b3-f28ab2b291d8 nodeName:}" failed. No retries permitted until 2026-07-12 08:40:21.191395818 +0000 UTC m=+2017.974396145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls") pod "maas-api-e2e-api-a-449923-6f587c8b64-d9lql" (UID: "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8") : secret "maas-api-e2e-api-a-449923-serving-cert" not found
Jul 12 08:40:20.691967 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.691942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-openshift-service-ca\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:20.701228 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:20.701202    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqv95\" (UniqueName: \"kubernetes.io/projected/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-kube-api-access-kqv95\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:21.197159 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:21.197119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:21.199761 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:21.199733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls\") pod \"maas-api-e2e-api-a-449923-6f587c8b64-d9lql\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:21.417020 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:21.416979    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:21.566045 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:21.565994    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"]
Jul 12 08:40:21.568702 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:40:21.568666    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b355a6_c6d0_4a1f_89b3_f28ab2b291d8.slice/crio-d5ee69bdd7d0bb5ec03d9f8603444eafa110ec356fc34c1db85d1defb76ba8ec WatchSource:0}: Error finding container d5ee69bdd7d0bb5ec03d9f8603444eafa110ec356fc34c1db85d1defb76ba8ec: Status 404 returned error can't find the container with id d5ee69bdd7d0bb5ec03d9f8603444eafa110ec356fc34c1db85d1defb76ba8ec
Jul 12 08:40:22.076140 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:22.076105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" event={"ID":"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8","Type":"ContainerStarted","Data":"d5ee69bdd7d0bb5ec03d9f8603444eafa110ec356fc34c1db85d1defb76ba8ec"}
Jul 12 08:40:23.082234 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:23.082194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" event={"ID":"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8","Type":"ContainerStarted","Data":"8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831"}
Jul 12 08:40:23.082629 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:23.082314    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:23.099733 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:23.099672    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" podStartSLOduration=2.625981725 podStartE2EDuration="3.099656767s" totalImagesPullingTime="473.675042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:40:23.097107533 +0000 UTC m=+2019.880107877" watchObservedRunningTime="2026-07-12 08:40:23.099656767 +0000 UTC m=+2019.882657110"
Jul 12 08:40:25.519223 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.519187    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"]
Jul 12 08:40:25.523605 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.523578    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.526253 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.526235    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 08:40:25.526431 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.526378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-68ebf4-openshift-default-dockercfg-msqjh\""
Jul 12 08:40:25.533835 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.533812    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"]
Jul 12 08:40:25.641124 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istiod-ca-cert\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spq25\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-kube-api-access-spq25\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-data\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641342 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-socket\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-certs\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-token\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-envoy\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-credential-socket\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.641660 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.641510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-podinfo\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.742973 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.742941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istiod-ca-cert\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spq25\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-kube-api-access-spq25\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-data\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-socket\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-certs\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-token\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743468 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-envoy\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743468 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-credential-socket\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743468 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-podinfo\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-socket\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743685 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-certs\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743685 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-data\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.743862 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istiod-ca-cert\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.744003 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.743985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-credential-socket\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.745803 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.745779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-envoy\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.746126 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.746104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-podinfo\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.751500 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.751470    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spq25\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-kube-api-access-spq25\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.751612 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.751541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-token\") pod \"e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") " pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.835013 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.834919    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:25.984703 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:25.984678    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"]
Jul 12 08:40:25.986760 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:40:25.986732    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8b96ff_a055_469d_bbbe_6f19f32f1b87.slice/crio-8179e39a7f25b2b09c630c3bade41f946d372bdfd648b1edd74ae451458050b5 WatchSource:0}: Error finding container 8179e39a7f25b2b09c630c3bade41f946d372bdfd648b1edd74ae451458050b5: Status 404 returned error can't find the container with id 8179e39a7f25b2b09c630c3bade41f946d372bdfd648b1edd74ae451458050b5
Jul 12 08:40:26.098394 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:26.098312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" event={"ID":"6e8b96ff-a055-469d-bbbe-6f19f32f1b87","Type":"ContainerStarted","Data":"8179e39a7f25b2b09c630c3bade41f946d372bdfd648b1edd74ae451458050b5"}
Jul 12 08:40:28.584520 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:28.584488    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:40:28.584770 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:28.584554    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:40:28.584770 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:28.584582    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:40:29.092770 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:29.092741    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:29.117205 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:29.117161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" event={"ID":"6e8b96ff-a055-469d-bbbe-6f19f32f1b87","Type":"ContainerStarted","Data":"853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"}
Jul 12 08:40:29.135692 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:29.135628    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" podStartSLOduration=1.540269038 podStartE2EDuration="4.13560654s" totalImagesPullingTime="2.595337502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:40:29.134541556 +0000 UTC m=+2025.917541903" watchObservedRunningTime="2026-07-12 08:40:29.13560654 +0000 UTC m=+2025.918606885"
Jul 12 08:40:29.835321 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:29.835264    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:29.841516 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:29.841493    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:30.122708 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:30.122626    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:30.123715 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:30.123693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:43.888841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:43.888811    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"]
Jul 12 08:40:43.889328 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:43.889038    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" podUID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" containerName="maas-api" containerID="cri-o://8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831" gracePeriod=30
Jul 12 08:40:44.152827 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.152766    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:44.204696 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.204618    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerID="853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522" exitCode=0
Jul 12 08:40:44.204849 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.204690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" event={"ID":"6e8b96ff-a055-469d-bbbe-6f19f32f1b87","Type":"ContainerDied","Data":"853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"}
Jul 12 08:40:44.205177 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.205157    2558 scope.go:117] "RemoveContainer" containerID="853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"
Jul 12 08:40:44.206033 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206016    2558 generic.go:356] "Generic (PLEG): container finished" podID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" containerID="8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831" exitCode=0
Jul 12 08:40:44.206141 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" event={"ID":"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8","Type":"ContainerDied","Data":"8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831"}
Jul 12 08:40:44.206141 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206078    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"
Jul 12 08:40:44.206141 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" event={"ID":"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8","Type":"ContainerDied","Data":"d5ee69bdd7d0bb5ec03d9f8603444eafa110ec356fc34c1db85d1defb76ba8ec"}
Jul 12 08:40:44.206141 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206131    2558 scope.go:117] "RemoveContainer" containerID="8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831"
Jul 12 08:40:44.206305 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206250    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:40:44.206355 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206336    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:40:44.206398 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.206374    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 12 08:40:44.218859 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.218838    2558 scope.go:117] "RemoveContainer" containerID="8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831"
Jul 12 08:40:44.219128 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:40:44.219109    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831\": container with ID starting with 8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831 not found: ID does not exist" containerID="8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831"
Jul 12 08:40:44.219218 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.219134    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831"} err="failed to get container status \"8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831\": rpc error: code = NotFound desc = could not find container \"8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831\": container with ID starting with 8dd45c27182ad6ed40fd664583037113c62fc3e100fc60e4a381637a0d29f831 not found: ID does not exist"
Jul 12 08:40:44.235163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.235136    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqv95\" (UniqueName: \"kubernetes.io/projected/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-kube-api-access-kqv95\") pod \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") "
Jul 12 08:40:44.235321 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.235211    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-openshift-service-ca\") pod \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") "
Jul 12 08:40:44.235321 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.235295    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls\") pod \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\" (UID: \"15b355a6-c6d0-4a1f-89b3-f28ab2b291d8\") "
Jul 12 08:40:44.235630 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.235604    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" (UID: "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:40:44.237554 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.237525    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-kube-api-access-kqv95" (OuterVolumeSpecName: "kube-api-access-kqv95") pod "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" (UID: "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8"). InnerVolumeSpecName "kube-api-access-kqv95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:40:44.237798 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.237771    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" (UID: "15b355a6-c6d0-4a1f-89b3-f28ab2b291d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:40:44.336636 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.336590    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:40:44.336636 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.336635    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqv95\" (UniqueName: \"kubernetes.io/projected/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-kube-api-access-kqv95\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:40:44.337215 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.336650    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:40:44.528854 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.528818    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"]
Jul 12 08:40:44.533141 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:44.533115    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql"]
Jul 12 08:40:45.123240 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:45.123207    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:45.214200 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:45.214115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" event={"ID":"6e8b96ff-a055-469d-bbbe-6f19f32f1b87","Type":"ContainerStarted","Data":"a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055"}
Jul 12 08:40:45.763198 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:45.763157    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" path="/var/lib/kubelet/pods/15b355a6-c6d0-4a1f-89b3-f28ab2b291d8/volumes"
Jul 12 08:40:45.836161 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:45.836125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:45.837486 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:45.837455    2558 patch_prober.go:28] interesting pod/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 12 08:40:45.837689 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:45.837665    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 12 08:40:46.836470 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:46.836430    2558 patch_prober.go:28] interesting pod/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 12 08:40:46.837074 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:46.837039    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 12 08:40:47.087740 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:47.087645    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-449923-6f587c8b64-d9lql" podUID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.58:8443/health\": context deadline exceeded"
Jul 12 08:40:47.835731 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:47.835695    2558 patch_prober.go:28] interesting pod/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 12 08:40:47.835921 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:47.835755    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 12 08:40:48.835718 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:48.835678    2558 patch_prober.go:28] interesting pod/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 12 08:40:48.836098 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:48.835741    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 12 08:40:49.840288 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:49.840241    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:49.840709 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:49.840646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:49.841373 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:49.841354    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:40:56.833316 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:56.833258    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"]
Jul 12 08:40:56.833699 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:40:56.833528    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy" containerID="cri-o://a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055" gracePeriod=30
Jul 12 08:41:00.549772 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.549731    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"]
Jul 12 08:41:00.550444 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.550423    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" containerName="maas-api"
Jul 12 08:41:00.550444 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.550443    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" containerName="maas-api"
Jul 12 08:41:00.550634 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.550570    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b355a6-c6d0-4a1f-89b3-f28ab2b291d8" containerName="maas-api"
Jul 12 08:41:00.557836 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.557810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.560625 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.560593    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-23d4ae-serving-cert\""
Jul 12 08:41:00.562457 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.562434    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"]
Jul 12 08:41:00.585779 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.585744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.585949 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.585857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgzn\" (UniqueName: \"kubernetes.io/projected/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-kube-api-access-xrgzn\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.585949 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.585894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-maas-api-tls\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.686907 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.686870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-maas-api-tls\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.687159 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.686959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.687159 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.687025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgzn\" (UniqueName: \"kubernetes.io/projected/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-kube-api-access-xrgzn\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.687754 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.687734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.689538 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.689520    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-maas-api-tls\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.696565 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.696542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgzn\" (UniqueName: \"kubernetes.io/projected/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-kube-api-access-xrgzn\") pod \"maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:00.873145 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:00.873059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:01.019377 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:01.019347    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"]
Jul 12 08:41:01.021494 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:41:01.021465    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc12a7fd_e55e_4ddb_9bb5_9a425558d2a7.slice/crio-7f6ffd017d2aa1100fa7823f4ad82d9c48aa89d6f542456cacb0c4ed0f90a6ef WatchSource:0}: Error finding container 7f6ffd017d2aa1100fa7823f4ad82d9c48aa89d6f542456cacb0c4ed0f90a6ef: Status 404 returned error can't find the container with id 7f6ffd017d2aa1100fa7823f4ad82d9c48aa89d6f542456cacb0c4ed0f90a6ef
Jul 12 08:41:01.304854 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:01.304817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88" event={"ID":"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7","Type":"ContainerStarted","Data":"7f6ffd017d2aa1100fa7823f4ad82d9c48aa89d6f542456cacb0c4ed0f90a6ef"}
Jul 12 08:41:02.102692 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.102624    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:41:02.200168 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200135    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-token\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200184    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spq25\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-kube-api-access-spq25\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200210    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-envoy\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200256    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istiod-ca-cert\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200311    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-data\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200355    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-credential-socket\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200410 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200397    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-socket\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200736 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-podinfo\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200736 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200467    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-certs\") pod \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\" (UID: \"6e8b96ff-a055-469d-bbbe-6f19f32f1b87\") "
Jul 12 08:41:02.200736 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200685    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:41:02.200908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200795    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:41:02.200908 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200896    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istiod-ca-cert\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.201015 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200915    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-socket\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.201015 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200942    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:41:02.201015 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.200965    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:41:02.201311 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.201259    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:41:02.202701 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.202642    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 08:41:02.202823 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.202737    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-kube-api-access-spq25" (OuterVolumeSpecName: "kube-api-access-spq25") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "kube-api-access-spq25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:41:02.202823 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.202752    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:41:02.203008 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.202991    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e8b96ff-a055-469d-bbbe-6f19f32f1b87" (UID: "6e8b96ff-a055-469d-bbbe-6f19f32f1b87"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 08:41:02.301564 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301526    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-envoy\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.301564 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301557    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-data\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.301564 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301566    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-credential-socket\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.301564 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301576    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-podinfo\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.301830 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301584    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-workload-certs\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.301830 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301592    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-istio-token\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.301830 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.301600    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spq25\" (UniqueName: \"kubernetes.io/projected/6e8b96ff-a055-469d-bbbe-6f19f32f1b87-kube-api-access-spq25\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:41:02.311768 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.311738    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88" event={"ID":"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7","Type":"ContainerStarted","Data":"c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83"}
Jul 12 08:41:02.311963 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.311802    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:02.313400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.313371    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerID="a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055" exitCode=0
Jul 12 08:41:02.313505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.313402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" event={"ID":"6e8b96ff-a055-469d-bbbe-6f19f32f1b87","Type":"ContainerDied","Data":"a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055"}
Jul 12 08:41:02.313505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.313414    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"
Jul 12 08:41:02.313505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.313451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw" event={"ID":"6e8b96ff-a055-469d-bbbe-6f19f32f1b87","Type":"ContainerDied","Data":"8179e39a7f25b2b09c630c3bade41f946d372bdfd648b1edd74ae451458050b5"}
Jul 12 08:41:02.313505 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.313476    2558 scope.go:117] "RemoveContainer" containerID="a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055"
Jul 12 08:41:02.322753 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.322734    2558 scope.go:117] "RemoveContainer" containerID="853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"
Jul 12 08:41:02.329195 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.329129    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88" podStartSLOduration=2.00010873 podStartE2EDuration="2.32910948s" totalImagesPullingTime="329.00075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:41:02.328129226 +0000 UTC m=+2059.111129583" watchObservedRunningTime="2026-07-12 08:41:02.32910948 +0000 UTC m=+2059.112109825"
Jul 12 08:41:02.332111 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.332085    2558 scope.go:117] "RemoveContainer" containerID="a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055"
Jul 12 08:41:02.332414 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:41:02.332393    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055\": container with ID starting with a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055 not found: ID does not exist" containerID="a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055"
Jul 12 08:41:02.332503 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.332426    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055"} err="failed to get container status \"a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055\": rpc error: code = NotFound desc = could not find container \"a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055\": container with ID starting with a85b635786cfd5cab74fb762427cbfff77528afe017bb33ac589548cd0f14055 not found: ID does not exist"
Jul 12 08:41:02.332503 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.332449    2558 scope.go:117] "RemoveContainer" containerID="853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"
Jul 12 08:41:02.332712 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:41:02.332694    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522\": container with ID starting with 853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522 not found: ID does not exist" containerID="853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"
Jul 12 08:41:02.332760 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.332718    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522"} err="failed to get container status \"853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522\": rpc error: code = NotFound desc = could not find container \"853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522\": container with ID starting with 853680f36967334d2482e7e8e9245e1e36a09d8b00ee5bb828bda1a9ce9dd522 not found: ID does not exist"
Jul 12 08:41:02.341864 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.341829    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"]
Jul 12 08:41:02.347907 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:02.347873    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-68ebf4-openshift-default-5b54f798ff-nsttw"]
Jul 12 08:41:03.756721 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:03.756689    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" path="/var/lib/kubelet/pods/6e8b96ff-a055-469d-bbbe-6f19f32f1b87/volumes"
Jul 12 08:41:08.328430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:08.328351    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:41:43.840423 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:43.840387    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:41:43.848454 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:43.848430    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:41:43.854430 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:43.854403    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:41:43.861664 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:41:43.861643    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdd7m_c40c28da-2de4-4ec8-b784-9c677149aa67/ovn-acl-logging/0.log"
Jul 12 08:44:18.437125 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.437027    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"]
Jul 12 08:44:18.437746 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.437264    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88" podUID="fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" containerName="maas-api" containerID="cri-o://c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83" gracePeriod=30
Jul 12 08:44:18.693365 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.693299    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:44:18.801127 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.801090    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrgzn\" (UniqueName: \"kubernetes.io/projected/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-kube-api-access-xrgzn\") pod \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") "
Jul 12 08:44:18.801350 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.801156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-openshift-service-ca\") pod \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") "
Jul 12 08:44:18.801350 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.801226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-maas-api-tls\") pod \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\" (UID: \"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7\") "
Jul 12 08:44:18.801592 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.801566    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" (UID: "fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 08:44:18.801735 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.801717    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-openshift-service-ca\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:44:18.803461 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.803437    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-kube-api-access-xrgzn" (OuterVolumeSpecName: "kube-api-access-xrgzn") pod "fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" (UID: "fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7"). InnerVolumeSpecName "kube-api-access-xrgzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 08:44:18.803544 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.803508    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" (UID: "fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 08:44:18.902382 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.902348    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-maas-api-tls\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:44:18.902382 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:18.902380    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrgzn\" (UniqueName: \"kubernetes.io/projected/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7-kube-api-access-xrgzn\") on node \"ip-10-0-128-71.ec2.internal\" DevicePath \"\""
Jul 12 08:44:19.323403 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.323370    2558 generic.go:356] "Generic (PLEG): container finished" podID="fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" containerID="c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83" exitCode=0
Jul 12 08:44:19.323615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.323423    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"
Jul 12 08:44:19.323615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.323455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88" event={"ID":"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7","Type":"ContainerDied","Data":"c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83"}
Jul 12 08:44:19.323615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.323540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88" event={"ID":"fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7","Type":"ContainerDied","Data":"7f6ffd017d2aa1100fa7823f4ad82d9c48aa89d6f542456cacb0c4ed0f90a6ef"}
Jul 12 08:44:19.323615 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.323570    2558 scope.go:117] "RemoveContainer" containerID="c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83"
Jul 12 08:44:19.333476 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.333460    2558 scope.go:117] "RemoveContainer" containerID="c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83"
Jul 12 08:44:19.333732 ip-10-0-128-71 kubenswrapper[2558]: E0712 08:44:19.333714    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83\": container with ID starting with c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83 not found: ID does not exist" containerID="c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83"
Jul 12 08:44:19.333786 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.333740    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83"} err="failed to get container status \"c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83\": rpc error: code = NotFound desc = could not find container \"c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83\": container with ID starting with c20a8d041de7545e4b5ab660ebb2a94663302c8341dd42333a8fea618b385b83 not found: ID does not exist"
Jul 12 08:44:19.348052 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.348002    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"]
Jul 12 08:44:19.352022 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.351988    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-23d4ae-c986c97d9-tff88"]
Jul 12 08:44:19.756327 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:19.756226    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" path="/var/lib/kubelet/pods/fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7/volumes"
Jul 12 08:44:36.341680 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:36.341648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cff869cd6-xxw8b_b8ba6590-351f-41eb-bce7-28d5c84e9377/manager/0.log"
Jul 12 08:44:36.946786 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:36.946753    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-zfkgd_13d2c36d-b172-46f3-b761-c5c9376a807d/copy-manifests/0.log"
Jul 12 08:44:36.953182 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:36.953156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-zfkgd_13d2c36d-b172-46f3-b761-c5c9376a807d/manager/0.log"
Jul 12 08:44:38.292536 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:38.292504    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fhnd5_9a5570b9-7d70-4e52-b5f3-4cf2f0587c05/manager/0.log"
Jul 12 08:44:38.401838 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:38.401800    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-td4m7_40da0f5c-df8a-4427-93d2-8065dee6f6b5/manager/0.log"
Jul 12 08:44:38.507676 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:38.507648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cg7lv_6f645e32-a22f-444d-b62e-11cfeebfd70d/kuadrant-console-plugin/0.log"
Jul 12 08:44:38.620802 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:38.620712    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sjmtn_17967d60-bfee-476f-8136-083311fe35d2/registry-server/0.log"
Jul 12 08:44:38.739117 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:38.739091    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cvntj_8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b/manager/0.log"
Jul 12 08:44:39.857674 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:39.857637    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-b6l6j_3847b8f1-c0f2-4839-9974-4bad50b815d5/payload-pre-processing/0.log"
Jul 12 08:44:39.968517 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:39.968481    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kxqv8_b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c/payload-processing/0.log"
Jul 12 08:44:40.074138 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:40.074106    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc544f466-pw5ml_4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357/router/0.log"
Jul 12 08:44:40.402779 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:40.402752    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nfdd9_9c0b20b8-5b2f-4a06-98c5-cd49fc1f059e/main/0.log"
Jul 12 08:44:40.620911 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:40.620881    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jsljb_84283585-2bdc-4967-865e-8db0c8478538/main/0.log"
Jul 12 08:44:48.178574 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:48.178526    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r6jrm_43681a57-c89a-4a78-be3e-d4193f14f14a/global-pull-secret-syncer/0.log"
Jul 12 08:44:48.291857 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:48.291823    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ztwc8_bd4996a8-c882-42b8-a249-66d69834c4d5/konnectivity-agent/0.log"
Jul 12 08:44:48.334733 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:48.334705    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-71.ec2.internal_2f62b47d48c505e45174394dfbbead6a/haproxy/0.log"
Jul 12 08:44:53.253353 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:53.253320    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fhnd5_9a5570b9-7d70-4e52-b5f3-4cf2f0587c05/manager/0.log"
Jul 12 08:44:53.277428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:53.277405    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-td4m7_40da0f5c-df8a-4427-93d2-8065dee6f6b5/manager/0.log"
Jul 12 08:44:53.304205 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:53.304177    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cg7lv_6f645e32-a22f-444d-b62e-11cfeebfd70d/kuadrant-console-plugin/0.log"
Jul 12 08:44:53.340607 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:53.340575    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sjmtn_17967d60-bfee-476f-8136-083311fe35d2/registry-server/0.log"
Jul 12 08:44:53.436259 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:53.436222    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cvntj_8e6248eb-aa07-4c98-b9d1-6ea9b6fef29b/manager/0.log"
Jul 12 08:44:55.685474 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:55.685389    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-trcrn_0b5f887b-f46f-423c-bc98-ef1857715bb5/cluster-monitoring-operator/0.log"
Jul 12 08:44:55.785367 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:55.785337    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b795f75fd-qbpt5_2804ea04-cb80-4c3a-89eb-7b11801d4559/metrics-server/0.log"
Jul 12 08:44:55.811990 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:55.811955    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-zfqm9_08525908-ac75-4326-a749-e8c95c1a3168/monitoring-plugin/0.log"
Jul 12 08:44:55.994916 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:55.994837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xdfjb_d071e0cf-676f-4b50-a629-49761c12fe6d/node-exporter/0.log"
Jul 12 08:44:56.020960 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.020940    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xdfjb_d071e0cf-676f-4b50-a629-49761c12fe6d/kube-rbac-proxy/0.log"
Jul 12 08:44:56.043092 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.043069    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xdfjb_d071e0cf-676f-4b50-a629-49761c12fe6d/init-textfile/0.log"
Jul 12 08:44:56.164261 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.164233    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/prometheus/0.log"
Jul 12 08:44:56.183779 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.183753    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/config-reloader/0.log"
Jul 12 08:44:56.203570 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.203544    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/thanos-sidecar/0.log"
Jul 12 08:44:56.238156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.238127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/kube-rbac-proxy-web/0.log"
Jul 12 08:44:56.260188 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.260114    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/kube-rbac-proxy/0.log"
Jul 12 08:44:56.294731 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.294698    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/kube-rbac-proxy-thanos/0.log"
Jul 12 08:44:56.317892 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.317871    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_43f8eaec-45a5-421c-bcb8-4216a13e6513/init-config-reloader/0.log"
Jul 12 08:44:56.387443 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.387413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-bvr8j_7e19f4c5-0592-4af2-bab6-34a2e7a3e877/prometheus-operator-admission-webhook/0.log"
Jul 12 08:44:56.485522 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.485494    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-598d6677ff-chpp6_0a3542c3-623c-40fa-acae-a2cc43e7204d/thanos-query/0.log"
Jul 12 08:44:56.506831 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.506797    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-598d6677ff-chpp6_0a3542c3-623c-40fa-acae-a2cc43e7204d/kube-rbac-proxy-web/0.log"
Jul 12 08:44:56.525998 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.525973    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-598d6677ff-chpp6_0a3542c3-623c-40fa-acae-a2cc43e7204d/kube-rbac-proxy/0.log"
Jul 12 08:44:56.549975 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.549948    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-598d6677ff-chpp6_0a3542c3-623c-40fa-acae-a2cc43e7204d/prom-label-proxy/0.log"
Jul 12 08:44:56.568969 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.568938    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-598d6677ff-chpp6_0a3542c3-623c-40fa-acae-a2cc43e7204d/kube-rbac-proxy-rules/0.log"
Jul 12 08:44:56.587317 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:56.587290    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-598d6677ff-chpp6_0a3542c3-623c-40fa-acae-a2cc43e7204d/kube-rbac-proxy-metrics/0.log"
Jul 12 08:44:57.724286 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:57.724252    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-l8zwc_a1c2761b-44b7-40d6-a7a5-bfc5abadd3ca/networking-console-plugin/0.log"
Jul 12 08:44:58.066947 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.066913    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"]
Jul 12 08:44:58.067377 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.067363    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" containerName="maas-api"
Jul 12 08:44:58.067428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.067379    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" containerName="maas-api"
Jul 12 08:44:58.067428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.067402    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy"
Jul 12 08:44:58.067428 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.067407    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy"
Jul 12 08:44:58.067530 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.067464    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy"
Jul 12 08:44:58.067530 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.067473    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc12a7fd-e55e-4ddb-9bb5-9a425558d2a7" containerName="maas-api"
Jul 12 08:44:58.070772 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.070751    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.073042 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.073024    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ndtc\"/\"openshift-service-ca.crt\""
Jul 12 08:44:58.073175 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.073155    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5ndtc\"/\"default-dockercfg-9k25p\""
Jul 12 08:44:58.073775 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.073758    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ndtc\"/\"kube-root-ca.crt\""
Jul 12 08:44:58.081512 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.081488    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"]
Jul 12 08:44:58.181139 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.181093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx2r9\" (UniqueName: \"kubernetes.io/projected/76d2b7c2-9f02-44da-b8c3-80d16ab74719-kube-api-access-vx2r9\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.181139 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.181140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-podres\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.181400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.181210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-sys\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.181400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.181244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-proc\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.181400 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.181266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-lib-modules\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282435 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282393    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-sys\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282435 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-proc\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-lib-modules\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-sys\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-proc\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx2r9\" (UniqueName: \"kubernetes.io/projected/76d2b7c2-9f02-44da-b8c3-80d16ab74719-kube-api-access-vx2r9\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-podres\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282652 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-lib-modules\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.282852 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.282753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76d2b7c2-9f02-44da-b8c3-80d16ab74719-podres\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.290439 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.290416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx2r9\" (UniqueName: \"kubernetes.io/projected/76d2b7c2-9f02-44da-b8c3-80d16ab74719-kube-api-access-vx2r9\") pod \"perf-node-gather-daemonset-lkgvr\" (UID: \"76d2b7c2-9f02-44da-b8c3-80d16ab74719\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.345694 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.345618    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/1.log"
Jul 12 08:44:58.350189 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.350160    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x42kf_be0ebd2e-d226-485e-aea7-5e39cd02104f/console-operator/2.log"
Jul 12 08:44:58.382404 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.382373    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:58.519605 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:58.519578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"]
Jul 12 08:44:58.522550 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:44:58.522524    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76d2b7c2_9f02_44da_b8c3_80d16ab74719.slice/crio-e49cdcdfed0aa5f3d6c487394bb5ce13dca66b2f3a82dfb1bda9816672c7d713 WatchSource:0}: Error finding container e49cdcdfed0aa5f3d6c487394bb5ce13dca66b2f3a82dfb1bda9816672c7d713: Status 404 returned error can't find the container with id e49cdcdfed0aa5f3d6c487394bb5ce13dca66b2f3a82dfb1bda9816672c7d713
Jul 12 08:44:59.503636 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:59.503608    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-wjsd7_8215fe18-bcb5-4887-b124-3ea8f81e5e96/volume-data-source-validator/0.log"
Jul 12 08:44:59.532108 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:59.532066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr" event={"ID":"76d2b7c2-9f02-44da-b8c3-80d16ab74719","Type":"ContainerStarted","Data":"9a71f70488ec6b571fe0973ce012a767b160a6e99492cc4c02980120c9a217c7"}
Jul 12 08:44:59.532322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:59.532127    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr" event={"ID":"76d2b7c2-9f02-44da-b8c3-80d16ab74719","Type":"ContainerStarted","Data":"e49cdcdfed0aa5f3d6c487394bb5ce13dca66b2f3a82dfb1bda9816672c7d713"}
Jul 12 08:44:59.532322 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:59.532181    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:44:59.548795 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:44:59.548737    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr" podStartSLOduration=1.5487165470000002 podStartE2EDuration="1.548716547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:44:59.548305377 +0000 UTC m=+2296.331305721" watchObservedRunningTime="2026-07-12 08:44:59.548716547 +0000 UTC m=+2296.331716884"
Jul 12 08:45:00.135517 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.135481    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"]
Jul 12 08:45:00.135953 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.135941    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy"
Jul 12 08:45:00.136000 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.135956    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy"
Jul 12 08:45:00.136035 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.136028    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8b96ff-a055-469d-bbbe-6f19f32f1b87" containerName="istio-proxy"
Jul 12 08:45:00.140416 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.140398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"
Jul 12 08:45:00.145865 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.145839    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"]
Jul 12 08:45:00.199662 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.199620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95z4j\" (UniqueName: \"kubernetes.io/projected/c709f921-b774-4a8a-9a91-8592465fcc82-kube-api-access-95z4j\") pod \"maas-api-key-cleanup-29730765-cnmbx\" (UID: \"c709f921-b774-4a8a-9a91-8592465fcc82\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"
Jul 12 08:45:00.300549 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.300510    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95z4j\" (UniqueName: \"kubernetes.io/projected/c709f921-b774-4a8a-9a91-8592465fcc82-kube-api-access-95z4j\") pod \"maas-api-key-cleanup-29730765-cnmbx\" (UID: \"c709f921-b774-4a8a-9a91-8592465fcc82\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"
Jul 12 08:45:00.309079 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.309053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95z4j\" (UniqueName: \"kubernetes.io/projected/c709f921-b774-4a8a-9a91-8592465fcc82-kube-api-access-95z4j\") pod \"maas-api-key-cleanup-29730765-cnmbx\" (UID: \"c709f921-b774-4a8a-9a91-8592465fcc82\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"
Jul 12 08:45:00.452156 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.452067    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"
Jul 12 08:45:00.477461 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.477437    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qnlwb_8cb1f0a8-8440-45f6-9f00-ac7624c693d7/dns/0.log"
Jul 12 08:45:00.496832 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.496805    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qnlwb_8cb1f0a8-8440-45f6-9f00-ac7624c693d7/kube-rbac-proxy/0.log"
Jul 12 08:45:00.559745 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.559706    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jqm8v_3188ee17-e04d-4f46-be29-8cefefe19602/dns-node-resolver/0.log"
Jul 12 08:45:00.599098 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.599071    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx"]
Jul 12 08:45:00.601199 ip-10-0-128-71 kubenswrapper[2558]: W0712 08:45:00.601170    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc709f921_b774_4a8a_9a91_8592465fcc82.slice/crio-5aa929a7c5fbda4a3fcca6c14f80a0ff2d5bf8f7e3f70b95a76a1b6f55e584a9 WatchSource:0}: Error finding container 5aa929a7c5fbda4a3fcca6c14f80a0ff2d5bf8f7e3f70b95a76a1b6f55e584a9: Status 404 returned error can't find the container with id 5aa929a7c5fbda4a3fcca6c14f80a0ff2d5bf8f7e3f70b95a76a1b6f55e584a9
Jul 12 08:45:00.603737 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:00.603718    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 08:45:01.117407 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:01.117382    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9mggq_85e5d712-8a13-4116-b27f-90ee36e4bcc3/node-ca/0.log"
Jul 12 08:45:01.544825 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:01.544790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx" event={"ID":"c709f921-b774-4a8a-9a91-8592465fcc82","Type":"ContainerStarted","Data":"5aa929a7c5fbda4a3fcca6c14f80a0ff2d5bf8f7e3f70b95a76a1b6f55e584a9"}
Jul 12 08:45:02.382396 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:02.382362    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-b6l6j_3847b8f1-c0f2-4839-9974-4bad50b815d5/payload-pre-processing/0.log"
Jul 12 08:45:02.433523 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:02.433489    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kxqv8_b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c/payload-processing/0.log"
Jul 12 08:45:02.454654 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:02.454624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc544f466-pw5ml_4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357/router/0.log"
Jul 12 08:45:03.148117 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:03.148088    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx7lg_d3e80c24-675f-4c82-9dd4-45a2f5561f85/serve-healthcheck-canary/0.log"
Jul 12 08:45:03.618171 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:03.618136    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-kflgs_33dc61bb-6dbf-44a8-a793-5882af9def06/insights-operator/0.log"
Jul 12 08:45:03.618783 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:03.618766    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-kflgs_33dc61bb-6dbf-44a8-a793-5882af9def06/insights-operator/1.log"
Jul 12 08:45:03.653642 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:03.653615    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7npxg_391fb1b0-580e-490d-9968-92b46c392c05/kube-rbac-proxy/0.log"
Jul 12 08:45:03.689598 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:03.689569    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7npxg_391fb1b0-580e-490d-9968-92b46c392c05/exporter/0.log"
Jul 12 08:45:03.710446 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:03.710420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7npxg_391fb1b0-580e-490d-9968-92b46c392c05/extractor/0.log"
Jul 12 08:45:04.561912 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:04.561880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx" event={"ID":"c709f921-b774-4a8a-9a91-8592465fcc82","Type":"ContainerStarted","Data":"b2ff1aa1a47e4a1a872b91c378aad8b159fe9d7f73fd41d7db0d91090b467540"}
Jul 12 08:45:04.577841 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:04.577781    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730765-cnmbx" podStartSLOduration=1.6367167710000001 podStartE2EDuration="4.577761155s" totalImagesPullingTime="2.941044384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:45:04.577167466 +0000 UTC m=+2301.360167809" watchObservedRunningTime="2026-07-12 08:45:04.577761155 +0000 UTC m=+2301.360761499"
Jul 12 08:45:05.551626 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:05.551592    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-lkgvr"
Jul 12 08:45:06.171525 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:06.171497    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cff869cd6-xxw8b_b8ba6590-351f-41eb-bce7-28d5c84e9377/manager/0.log"
Jul 12 08:45:06.453582 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:06.453498    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-zfkgd_13d2c36d-b172-46f3-b761-c5c9376a807d/manager/0.log"
Jul 12 08:45:06.476502 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:06.476475    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-zfkgd_13d2c36d-b172-46f3-b761-c5c9376a807d/copy-manifests/0.log"
Jul 12 08:45:07.894737 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:07.894650    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59795878b4-85gm8_2a757b48-9848-4a33-9055-45e374dfc8d3/manager/0.log"
Jul 12 08:45:08.684576 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:08.684547    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-b6l6j_3847b8f1-c0f2-4839-9974-4bad50b815d5/payload-pre-processing/0.log"
Jul 12 08:45:08.718163 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:08.718139    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kxqv8_b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c/payload-processing/0.log"
Jul 12 08:45:08.731673 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:08.731649    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc544f466-pw5ml_4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357/router/0.log"
Jul 12 08:45:10.208488 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:10.208392    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-b6l6j_3847b8f1-c0f2-4839-9974-4bad50b815d5/payload-pre-processing/0.log"
Jul 12 08:45:10.243708 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:10.243677    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kxqv8_b9ddbf81-483b-48b4-8308-3a3f1ce5bf4c/payload-processing/0.log"
Jul 12 08:45:10.263583 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:10.263556    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bc544f466-pw5ml_4f9809bc-4b01-4cbe-8c43-ae4e0a3cf357/router/0.log"
Jul 12 08:45:13.237293 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:13.237236    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6dc9m_3003ddb7-f5e4-47c9-9493-181850171749/kube-storage-version-migrator-operator/0.log"
Jul 12 08:45:13.238599 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:13.238578    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6dc9m_3003ddb7-f5e4-47c9-9493-181850171749/kube-storage-version-migrator-operator/1.log"
Jul 12 08:45:14.540808 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.540775    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/kube-multus-additional-cni-plugins/0.log"
Jul 12 08:45:14.560451 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.560426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/egress-router-binary-copy/0.log"
Jul 12 08:45:14.579490 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.579467    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/cni-plugins/0.log"
Jul 12 08:45:14.597743 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.597715    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/bond-cni-plugin/0.log"
Jul 12 08:45:14.616895 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.616869    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/routeoverride-cni/0.log"
Jul 12 08:45:14.636369 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.636345    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/whereabouts-cni-bincopy/0.log"
Jul 12 08:45:14.655807 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.655781    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zxhsp_25a2e3c4-3dbd-415f-bd66-1c3b96adfba4/whereabouts-cni/0.log"
Jul 12 08:45:14.686974 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.686936    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x5xrc_21f9b64e-f7a3-472f-b3b9-50aa3dbfc330/kube-multus/0.log"
Jul 12 08:45:14.785465 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.785434    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bvx29_50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46/network-metrics-daemon/0.log"
Jul 12 08:45:14.802237 ip-10-0-128-71 kubenswrapper[2558]: I0712 08:45:14.802166    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bvx29_50cb95ab-0dbe-4f5f-9a85-5d89fccc6a46/kube-rbac-proxy/0.log"