Jun 05 15:34:21.960086 ip-10-0-129-173 systemd[1]: Starting Kubernetes Kubelet... Jun 05 15:34:22.372967 ip-10-0-129-173 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:34:22.372967 ip-10-0-129-173 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 15:34:22.372967 ip-10-0-129-173 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:34:22.372967 ip-10-0-129-173 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 15:34:22.372967 ip-10-0-129-173 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 15:34:22.373641 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.373046 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 15:34:22.379117 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379093 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:34:22.379117 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379112 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:34:22.379117 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379117 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:34:22.379117 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379120 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:34:22.379117 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379122 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:34:22.379117 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379125 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379129 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379132 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379134 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379137 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379140 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379142 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379145 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379148 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379150 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379153 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379155 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379158 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379160 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379163 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379165 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379168 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379170 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379175 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:34:22.379339 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379179 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379182 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379185 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379187 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379190 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379193 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379195 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379197 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379200 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379202 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379206 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379208 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379210 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379213 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379215 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379219 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379221 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379224 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379226 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379229 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:34:22.379795 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379231 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379234 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379236 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379239 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379242 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379244 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379247 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379249 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379252 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379254 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379257 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379259 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379262 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379264 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379267 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379271 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379274 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379277 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379280 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379282 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:34:22.380305 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379285 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379287 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379289 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379293 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379297 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379299 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379302 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379306 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379308 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379311 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379314 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379317 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379319 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379322 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379324 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379326 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379329 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379331 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379334 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:34:22.380792 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379342 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379345 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379347 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379350 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379353 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379356 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379358 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379361 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379363 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379365 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379368 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379370 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379372 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379375 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379377 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.379379 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380141 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380149 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380155 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:34:22.381260 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380158 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380161 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380164 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380167 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380170 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380172 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380175 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380178 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380181 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380183 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380186 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380188 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380191 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380194 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380197 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380199 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380202 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380204 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380207 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380209 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:34:22.381723 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380212 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380214 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380217 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380219 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380223 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380225 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380228 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380232 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380235 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380237 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380240 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380243 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380246 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380249 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380252 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380254 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380257 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380259 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380261 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380264 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:34:22.382234 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380266 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380269 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380271 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380274 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380276 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380279 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380282 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380284 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380287 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380289 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380291 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380294 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380296 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380298 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380301 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380303 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380305 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380308 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380311 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380313 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:34:22.382758 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380317 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380321 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380325 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380327 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380331 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380334 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380336 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380338 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380341 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380343 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380346 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380348 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380350 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380353 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380355 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380357 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380360 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380363 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380367 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:34:22.383244 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380370 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380372 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380375 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380377 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380380 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380382 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380385 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380387 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380390 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380392 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380395 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380397 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380399 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380401 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380404 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380406 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380787 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380796 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380799 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380802 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:34:22.383713 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380805 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380808 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380810 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380813 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380815 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380818 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380821 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380823 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380826 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380828 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380831 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380833 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380836 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380839 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380841 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380845 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380849 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380852 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380854 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380857 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:34:22.384210 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380860 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380863 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380866 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380868 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380871 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380874 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380876 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380879 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380881 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380885 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380888 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380890 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380893 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380895 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380898 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380900 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380902 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380905 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380907 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:34:22.384679 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380911 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380914 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380917 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380919 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380922 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380924 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380927 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380930 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380932 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380934 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380936 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380939 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380941 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380944 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380946 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380949 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380951 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380953 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380956 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380959 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:34:22.385156 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380961 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380963 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380966 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380969 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380972 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380974 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380976 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380979 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380981 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380983 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380985 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380988 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380990 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380992 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380996 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.380998 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381001 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381003 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381006 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381008 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:34:22.385615 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381011 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381013 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381015 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381018 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381020 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381022 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381025 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381027 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381029 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381032 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381043 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381047 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381050 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381052 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381055 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381057 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381135 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381150 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381160 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381166 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381173 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 15:34:22.386144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381177 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381181 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381185 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381188 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381191 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381194 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381198 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381200 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381203 2579 flags.go:64] FLAG: --cgroup-root="" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381206 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381208 2579 flags.go:64] FLAG: --client-ca-file="" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381212 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381215 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381219 2579 flags.go:64] FLAG: --cluster-domain="" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381221 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381224 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381227 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381230 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381234 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381237 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381239 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381244 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381247 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381249 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 15:34:22.386642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381252 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381255 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381258 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381262 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381265 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381268 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381271 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381274 2579 flags.go:64] FLAG: --enable-server="true" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381276 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381282 2579 flags.go:64] FLAG: --event-burst="100" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381284 2579 flags.go:64] FLAG: --event-qps="50" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381287 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381290 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381293 2579 flags.go:64] FLAG: --eviction-hard="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381297 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381300 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381303 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381305 2579 flags.go:64] FLAG: --eviction-soft="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381308 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381310 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381314 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381317 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381320 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381323 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381325 2579 flags.go:64] FLAG: --feature-gates="" Jun 05 15:34:22.387224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381329 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381331 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381334 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381338 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381342 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381344 2579 flags.go:64] FLAG: --help="false" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381347 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381350 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381354 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381357 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381360 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381363 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381366 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381368 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381371 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381373 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381376 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381379 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381381 2579 flags.go:64] FLAG: --kube-reserved="" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381384 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381386 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381389 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381392 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381394 2579 flags.go:64] FLAG: --lock-file="" Jun 05 15:34:22.387850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381397 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381399 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381402 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381407 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381410 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381413 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381415 2579 flags.go:64] FLAG: --logging-format="text" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381418 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381421 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381424 2579 flags.go:64] FLAG: --manifest-url="" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381426 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381430 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381434 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381438 2579 flags.go:64] FLAG: --max-pods="110" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381441 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381444 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381447 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381450 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381452 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381455 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381458 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381465 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381468 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381471 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 15:34:22.388461 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381473 2579 flags.go:64] FLAG: --pod-cidr="" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381476 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381481 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381483 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381487 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381489 2579 flags.go:64] FLAG: --port="10250" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381492 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381494 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0121227c6a93aff20" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381497 2579 flags.go:64] FLAG: --qos-reserved="" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381500 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381503 2579 flags.go:64] FLAG: --register-node="true" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381506 2579 flags.go:64] FLAG: --register-with-taints="" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381509 2579 flags.go:64] FLAG: --registry-burst="10" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381512 2579 flags.go:64] FLAG: --registry-qps="5" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381515 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381518 2579 flags.go:64] FLAG: --reserved-memory="" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381521 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381524 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381527 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381529 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381532 2579 flags.go:64] FLAG: --runonce="false" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381536 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381539 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381541 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381545 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 15:34:22.389146 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381548 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381550 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381553 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381556 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381559 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381562 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381565 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381568 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381570 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381573 2579 flags.go:64] FLAG: --system-cgroups="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381576 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381581 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381583 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381586 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381592 2579 flags.go:64] FLAG: --tls-min-version="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381595 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381597 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381600 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381603 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381605 2579 flags.go:64] FLAG: --v="2" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381609 2579 flags.go:64] FLAG: --version="false" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381614 2579 flags.go:64] FLAG: --vmodule="" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381617 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.381620 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381732 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:34:22.389786 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381736 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381739 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381742 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381759 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381762 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381764 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381768 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381771 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381774 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381776 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381779 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381781 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381784 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381786 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381789 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381791 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381793 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381796 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381798 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381801 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:34:22.390385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381803 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381805 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381808 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381810 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381813 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381815 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381817 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381820 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381822 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381826 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381828 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381830 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381833 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381837 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381840 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381844 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381847 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381850 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381853 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:34:22.390970 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381855 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381859 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381862 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381865 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381867 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381870 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381873 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381876 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381878 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381881 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381883 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381886 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381888 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381891 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381893 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381896 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381898 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381900 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381903 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:34:22.391430 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381905 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381908 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381910 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381913 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381916 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381918 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381921 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381923 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381926 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381929 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381932 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381934 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381937 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381940 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381942 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381945 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381947 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381949 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381952 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381955 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:34:22.391904 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381957 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381959 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381962 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381964 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381967 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381969 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381972 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381974 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381978 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381981 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381984 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381987 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381989 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381991 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381994 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381996 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.381999 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.382002 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.382004 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:34:22.392385 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.382006 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.382651 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.389857 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.389976 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.389996 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.390003 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390058 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390063 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390066 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390069 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390072 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390075 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390080 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390085 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390088 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:34:22.392864 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390091 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390094 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390098 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390101 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390104 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390107 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390109 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390112 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390115 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390118 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390121 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390123 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390126 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390128 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390131 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390133 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390136 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390138 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390140 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:34:22.393253 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390143 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390147 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390149 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390155 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390157 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390159 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390162 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390164 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390167 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390169 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390171 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390174 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390176 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390178 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390181 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390183 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390186 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390188 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390191 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:34:22.393712 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390193 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390195 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390198 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390200 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390203 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390205 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390208 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390210 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390213 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390215 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390217 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390220 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390222 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390225 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390228 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390230 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390233 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390236 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390238 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390240 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:34:22.394196 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390244 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390246 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390249 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390251 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390253 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390256 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390258 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390260 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390263 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390265 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390268 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390270 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390273 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390275 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390277 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390280 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390282 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390284 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390287 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390289 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:34:22.394662 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390291 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390293 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390296 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390300 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390303 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390306 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390309 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390312 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390315 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390317 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390320 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.390325 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390450 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390454 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390457 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 15:34:22.395191 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390460 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390462 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390465 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390467 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390470 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390472 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390475 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390478 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390481 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390483 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390486 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390488 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390491 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390493 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390496 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390498 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390500 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390503 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390505 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390508 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 15:34:22.395549 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390510 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390512 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390514 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390517 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390520 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390524 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390528 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390531 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390534 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390537 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390541 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390543 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390546 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390549 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390551 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390554 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390556 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390559 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390561 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390564 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 15:34:22.396045 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390566 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390569 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390571 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390573 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390576 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390578 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390580 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390582 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390585 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390587 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390589 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390592 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390594 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390596 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390598 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390601 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390603 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390606 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390609 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390611 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 15:34:22.396503 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390613 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390616 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390618 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390620 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390623 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390625 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390627 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390630 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390632 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390635 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390637 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390640 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390643 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390645 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390648 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390650 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390652 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390655 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390657 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390659 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 15:34:22.396998 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390662 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390664 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390667 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390670 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390673 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390676 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390679 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390681 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390684 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390687 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390689 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390692 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390694 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390697 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390699 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 15:34:22.397500 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:22.390701 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.390705 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.390827 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.393114 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.394583 2579 server.go:1019] "Starting client certificate rotation" Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.394682 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.394718 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 15:34:22.397884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.397109 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:34:22.407488 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.407465 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 15:34:22.419021 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.419001 2579 log.go:25] "Validated CRI v1 runtime API" Jun 05 15:34:22.421623 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.421597 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:34:22.422368 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.422356 2579 log.go:25] "Validated CRI v1 image API" Jun 05 15:34:22.424285 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.424268 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 15:34:22.426876 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.426850 2579 fs.go:135] Filesystem UUIDs: map[5456f025-bc9d-4302-8cd6-5dbf7bca03a0:/dev/nvme0n1p3 6e85601a-1b4c-4c1d-9863-09846106fef4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 05 15:34:22.426937 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.426875 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 15:34:22.431912 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.431806 2579 manager.go:216] Machine: {Timestamp:2026-06-05 15:34:22.430446355 +0000 UTC m=+0.349538464 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199635 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27af609e00c3f31f35f1fc67ec8a9b SystemUUID:ec27af60-9e00-c3f3-1f35-f1fc67ec8a9b BootID:59d950be-7dcf-4ca9-a3f2-acf2fc3b5761 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:89:86:4b:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:89:86:4b:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:14:c7:ba:fe:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 15:34:22.431912 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.431908 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 15:34:22.432021 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.431989 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 15:34:22.435180 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.435153 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 15:34:22.435354 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.435183 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 15:34:22.436090 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.436078 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 15:34:22.436143 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.436096 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 15:34:22.436143 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.436107 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:34:22.436828 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.436816 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 15:34:22.437787 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.437775 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 15:34:22.441004 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.440990 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:34:22.441171 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441160 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 15:34:22.441236 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441201 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 05 15:34:22.441236 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441216 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 15:34:22.441236 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441235 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 15:34:22.441365 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441251 2579 kubelet.go:398] "Adding apiserver pod source" Jun 05 15:34:22.441365 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441264 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 15:34:22.441644 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441630 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:34:22.441705 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.441653 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 15:34:22.443857 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.443833 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sj2lv" Jun 05 15:34:22.443977 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.443964 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 15:34:22.446043 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.446029 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 15:34:22.446095 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.446059 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 15:34:22.447255 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447245 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 15:34:22.447286 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447261 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 15:34:22.447286 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447267 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 15:34:22.447286 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447272 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 15:34:22.447286 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447282 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447288 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447296 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447302 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447307 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447319 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447333 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 15:34:22.447389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.447339 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 15:34:22.448288 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.448278 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 15:34:22.448288 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.448288 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 15:34:22.450652 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.450634 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sj2lv" Jun 05 15:34:22.452145 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.452132 2579 server.go:1268] "Started kubelet" Jun 05 15:34:22.452472 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.452449 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 15:34:22.456331 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.456307 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 15:34:22.456823 ip-10-0-129-173 systemd[1]: Started Kubernetes Kubelet. Jun 05 15:34:22.457562 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.457453 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 15:34:22.458496 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.458471 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 15:34:22.458576 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.458546 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 15:34:22.459142 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.459104 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 15:34:22.460201 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.460181 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 15:34:22.460529 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.460516 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 05 15:34:22.463421 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.463406 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:34:22.463932 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.463911 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 15:34:22.463932 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.463923 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 15:34:22.464070 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.463987 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jun 05 15:34:22.464715 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464698 2579 factory.go:55] Registering systemd factory Jun 05 15:34:22.464715 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464717 2579 factory.go:223] Registration of the systemd container factory successfully Jun 05 15:34:22.464865 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464826 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 15:34:22.464865 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464837 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 15:34:22.464865 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464846 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 15:34:22.465010 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464935 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 05 15:34:22.465010 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.464943 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 05 15:34:22.465300 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.465282 2579 factory.go:153] Registering CRI-O factory Jun 05 15:34:22.465300 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.465300 2579 factory.go:223] Registration of the crio container factory successfully Jun 05 15:34:22.465390 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.465358 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 15:34:22.465390 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.465379 2579 factory.go:103] Registering Raw factory Jun 05 15:34:22.465390 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.465389 2579 manager.go:1196] Started watching for new ooms in manager Jun 05 15:34:22.465667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.465658 2579 manager.go:349] Starting recovery of all containers Jun 05 15:34:22.466481 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.466463 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:34:22.469132 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.469109 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-173.ec2.internal\" not found" node="ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.476337 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.476320 2579 manager.go:354] Recovery completed Jun 05 15:34:22.477863 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.477844 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 05 15:34:22.480507 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.480496 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:34:22.483494 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.483478 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:34:22.483549 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.483511 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:34:22.483549 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.483527 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:34:22.484015 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.483999 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 15:34:22.484015 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.484015 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:34:22.484150 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.484014 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 15:34:22.484150 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.484079 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 05 15:34:22.484779 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.484738 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:34:22.484826 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.484796 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:34:22.484826 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.484810 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:34:22.485444 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.485432 2579 policy_none.go:49] "None policy: Start" Jun 05 15:34:22.485504 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.485450 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 15:34:22.485504 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.485463 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 15:34:22.486549 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.486535 2579 policy_none.go:47] "Start" Jun 05 15:34:22.521356 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521340 2579 manager.go:337] "Starting Device Plugin manager" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.521399 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521410 2579 server.go:87] "Starting device plugin registration server" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521654 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521666 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521777 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521853 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.521862 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.522836 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.522894 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-173.ec2.internal\" not found" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.533780 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.535092 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.535126 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.535147 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.535221 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 15:34:22.537987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.537848 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:34:22.621992 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.621951 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 15:34:22.624341 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.624285 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jun 05 15:34:22.624341 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.624322 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 15:34:22.624341 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.624337 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jun 05 15:34:22.624509 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.624372 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.633184 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.633155 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.635737 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.635718 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal"] Jun 05 15:34:22.637198 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.637184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.638196 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.638178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.660325 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.660301 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.663788 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.663773 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.664737 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.664725 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.666246 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.666232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e526b697a6660df1e5f8b7328ff1328f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"e526b697a6660df1e5f8b7328ff1328f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.666310 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.666253 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e526b697a6660df1e5f8b7328ff1328f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"e526b697a6660df1e5f8b7328ff1328f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.666310 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.666273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8b459a3fd9ef4dc8ea70f1ef3af0ad8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" (UID: \"a8b459a3fd9ef4dc8ea70f1ef3af0ad8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.671832 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.671817 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:34:22.675557 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.675541 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:34:22.681059 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.681043 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:34:22.681150 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.681087 2579 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.681150 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.681103 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.691065 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.691042 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 15:34:22.691143 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:22.691084 2579 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.766547 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.766523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e526b697a6660df1e5f8b7328ff1328f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"e526b697a6660df1e5f8b7328ff1328f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.766688 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.766553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e526b697a6660df1e5f8b7328ff1328f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"e526b697a6660df1e5f8b7328ff1328f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.766688 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.766569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8b459a3fd9ef4dc8ea70f1ef3af0ad8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" (UID: \"a8b459a3fd9ef4dc8ea70f1ef3af0ad8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.766688 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.766613 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8b459a3fd9ef4dc8ea70f1ef3af0ad8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" (UID: \"a8b459a3fd9ef4dc8ea70f1ef3af0ad8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.766688 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.766641 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e526b697a6660df1e5f8b7328ff1328f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"e526b697a6660df1e5f8b7328ff1328f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.766688 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.766653 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e526b697a6660df1e5f8b7328ff1328f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"e526b697a6660df1e5f8b7328ff1328f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.977829 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.977713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jun 05 15:34:22.979995 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:22.979973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jun 05 15:34:23.394273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.394241 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 15:34:23.394907 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.394410 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:34:23.394907 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.394423 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 15:34:23.441590 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.441560 2579 apiserver.go:52] "Watching apiserver" Jun 05 15:34:23.445565 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.445542 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 15:34:23.448912 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.448887 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-llg2l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal","openshift-multus/multus-mznbg","openshift-network-diagnostics/network-check-target-9shx6","openshift-network-operator/iptables-alerter-2z696","kube-system/global-pull-secret-syncer-zltth","kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls","openshift-cluster-node-tuning-operator/tuned-pm4jd","openshift-dns/node-resolver-l8tct","openshift-multus/multus-additional-cni-plugins-847rs","openshift-multus/network-metrics-daemon-w5gjm","openshift-ovn-kubernetes/ovnkube-node-g8dcq","kube-system/konnectivity-agent-9ffjc"] Jun 05 15:34:23.450202 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.450187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.451650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.451624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.451978 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.451950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.451978 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.451950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 15:34:23.452129 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.452041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h77n6\"" Jun 05 15:34:23.452129 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.452098 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.452965 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.452951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:23.453043 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.453019 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:23.453532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.453512 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 15:34:23.453691 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.453654 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-67tnp\"" Jun 05 15:34:23.454392 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.454187 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.454392 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.454338 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.454392 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.454355 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 15:34:23.455699 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.455678 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.456714 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.456669 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 15:29:22 +0000 UTC" deadline="2028-01-21 05:43:52.899321908 +0000 UTC" Jun 05 15:34:23.456810 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.456716 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14270h9m29.442610421s" Jun 05 15:34:23.457311 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.457292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 15:34:23.457390 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.457331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vrlwj\"" Jun 05 15:34:23.457390 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.457292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.457489 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.457410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.457489 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.457470 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:23.457618 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.457603 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.458726 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.458706 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.459981 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.459933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.459981 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.459959 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 15:34:23.460108 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.460056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.460159 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.460105 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.460253 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.460237 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ch92l\"" Jun 05 15:34:23.461608 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.461591 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.461608 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.461605 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.461738 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.461655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.461738 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.461696 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5s82s\"" Jun 05 15:34:23.463073 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.463055 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.463164 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.463074 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tss42\"" Jun 05 15:34:23.463227 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.463177 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.463276 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.463238 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.464003 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.463987 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 15:34:23.464605 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.464588 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 15:34:23.464605 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.464602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 15:34:23.464743 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.464602 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lm4q5\"" Jun 05 15:34:23.464743 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.464707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:23.464871 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.464853 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:23.466602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.466587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.468082 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468389 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468402 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468419 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468475 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468559 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468636 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8z26m\"" Jun 05 15:34:23.468850 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.468651 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 15:34:23.469335 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-sys-fs\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.469398 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysctl-conf\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.469398 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469392 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-systemd-units\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.469463 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-os-release\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.469463 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-kubelet\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.469523 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-hostroot\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.469523 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b32239f-f857-49a6-a92d-e90b5d020a90-tmp-dir\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.469578 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwnql\" (UniqueName: \"kubernetes.io/projected/2b32239f-f857-49a6-a92d-e90b5d020a90-kube-api-access-pwnql\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.469578 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.469578 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-cnibin\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.469683 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.469683 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.469683 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-ovnkube-script-lib\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.469683 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469661 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6nkjl\"" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02f11721-7bdd-4820-80b1-873f4d5d3257-cni-binary-copy\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2d9n\" (UniqueName: \"kubernetes.io/projected/02f11721-7bdd-4820-80b1-873f4d5d3257-kube-api-access-d2d9n\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-host\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-registration-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-cni-bin\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-ovnkube-config\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.469902 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysctl-d\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469925 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-tmp\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b84a0963-1f66-42a9-bdb9-d33025194d67-host-slash\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.469996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-run-netns\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-etc-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-netns\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-run-ovn-kubernetes\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-system-cni-dir\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.470133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cnibin\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c96334d-a9ef-4c89-8977-3755b9e40b35-dbus\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9nt\" (UniqueName: \"kubernetes.io/projected/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-kube-api-access-cb9nt\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-system-cni-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-cni-multus\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b32239f-f857-49a6-a92d-e90b5d020a90-hosts-file\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-ovn\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-log-socket\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-tuned\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgzl\" (UniqueName: \"kubernetes.io/projected/a31ab34b-a195-4e7a-bccb-93cc46162468-kube-api-access-pvgzl\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-systemd\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-var-lib-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470460 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-node-log\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.470591 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-conf-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-multus-certs\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-kubernetes\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-lib-modules\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-kubelet\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-slash\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470603 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsh6x\" (UniqueName: \"kubernetes.io/projected/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-kube-api-access-zsh6x\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4948a870-b955-4925-b7df-f7633aeafb1f-host\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.471182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.470650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhvzz\" (UniqueName: \"kubernetes.io/projected/4948a870-b955-4925-b7df-f7633aeafb1f-kube-api-access-lhvzz\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-socket-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-etc-selinux\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwh5s\" (UniqueName: \"kubernetes.io/projected/7157dd9f-0f16-4758-b8af-03dbc44d7b15-kube-api-access-gwh5s\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-socket-dir-parent\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-k8s-cni-cncf-io\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-etc-kubernetes\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4948a870-b955-4925-b7df-f7633aeafb1f-serviceca\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-cni-netd\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-os-release\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-systemd\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxwfp\" (UniqueName: \"kubernetes.io/projected/3927e035-69f3-46fc-9786-3450d72d0281-kube-api-access-xxwfp\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-daemon-config\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471565 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-device-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-cni-bin\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-sys\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-var-lib-kubelet\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c96334d-a9ef-4c89-8977-3755b9e40b35-kubelet-config\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471692 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3927e035-69f3-46fc-9786-3450d72d0281-ovn-node-metrics-cert\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-modprobe-d\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysconfig\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-run\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b84a0963-1f66-42a9-bdb9-d33025194d67-iptables-alerter-script\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-env-overrides\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-cni-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgjpq\" (UniqueName: \"kubernetes.io/projected/b84a0963-1f66-42a9-bdb9-d33025194d67-kube-api-access-pgjpq\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.471866 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.471838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.474569 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.474554 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 15:34:23.499788 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.499568 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b459a3fd9ef4dc8ea70f1ef3af0ad8.slice/crio-8bb2d2fcbabd1b0c722d40a4d2e7d94724b660e10e23fc4735885c4d80e210a7 WatchSource:0}: Error finding container 8bb2d2fcbabd1b0c722d40a4d2e7d94724b660e10e23fc4735885c4d80e210a7: Status 404 returned error can't find the container with id 8bb2d2fcbabd1b0c722d40a4d2e7d94724b660e10e23fc4735885c4d80e210a7 Jun 05 15:34:23.500213 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.500191 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode526b697a6660df1e5f8b7328ff1328f.slice/crio-5e9fb6d0e681e96b7e1bd3c0d49f343abca7d8fc4a43268e5f60b6d23e6d2dcc WatchSource:0}: Error finding container 5e9fb6d0e681e96b7e1bd3c0d49f343abca7d8fc4a43268e5f60b6d23e6d2dcc: Status 404 returned error can't find the container with id 5e9fb6d0e681e96b7e1bd3c0d49f343abca7d8fc4a43268e5f60b6d23e6d2dcc Jun 05 15:34:23.507118 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.504861 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:34:23.511907 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.511890 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bmn8" Jun 05 15:34:23.519467 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.519448 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bmn8" Jun 05 15:34:23.538510 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.538460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" event={"ID":"a8b459a3fd9ef4dc8ea70f1ef3af0ad8","Type":"ContainerStarted","Data":"8bb2d2fcbabd1b0c722d40a4d2e7d94724b660e10e23fc4735885c4d80e210a7"} Jun 05 15:34:23.539699 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.539677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" event={"ID":"e526b697a6660df1e5f8b7328ff1328f","Type":"ContainerStarted","Data":"5e9fb6d0e681e96b7e1bd3c0d49f343abca7d8fc4a43268e5f60b6d23e6d2dcc"} Jun 05 15:34:23.566001 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.565974 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 15:34:23.573039 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.572996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-registration-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.573116 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-cni-bin\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573116 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-ovnkube-config\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573116 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysctl-d\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.573116 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-tmp\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b84a0963-1f66-42a9-bdb9-d33025194d67-host-slash\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-registration-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b84a0963-1f66-42a9-bdb9-d33025194d67-host-slash\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-cni-bin\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-run-netns\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-etc-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-run-netns\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysctl-d\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-netns\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573281 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-etc-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:23.573350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-run-ovn-kubernetes\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-system-cni-dir\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573378 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-netns\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cnibin\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c96334d-a9ef-4c89-8977-3755b9e40b35-dbus\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573431 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-run-ovn-kubernetes\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9nt\" (UniqueName: \"kubernetes.io/projected/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-kube-api-access-cb9nt\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573473 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-system-cni-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cnibin\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-cni-multus\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573497 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c96334d-a9ef-4c89-8977-3755b9e40b35-dbus\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573550 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b32239f-f857-49a6-a92d-e90b5d020a90-hosts-file\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-system-cni-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe3f1993-9f70-4234-b0d8-978332c951a7-konnectivity-ca\") pod \"konnectivity-agent-9ffjc\" (UID: \"fe3f1993-9f70-4234-b0d8-978332c951a7\") " pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-cni-multus\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-system-cni-dir\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.573915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b32239f-f857-49a6-a92d-e90b5d020a90-hosts-file\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-ovn\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-log-socket\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573774 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-ovnkube-config\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-tuned\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573824 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-ovn\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgzl\" (UniqueName: \"kubernetes.io/projected/a31ab34b-a195-4e7a-bccb-93cc46162468-kube-api-access-pvgzl\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573845 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-log-socket\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-systemd\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573866 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-var-lib-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-systemd\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-node-log\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-conf-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.574706 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573937 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-var-lib-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-multus-certs\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-conf-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573983 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-multus-certs\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.573988 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-node-log\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-kubernetes\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-lib-modules\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-kubelet\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-slash\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsh6x\" (UniqueName: \"kubernetes.io/projected/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-kube-api-access-zsh6x\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4948a870-b955-4925-b7df-f7633aeafb1f-host\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574107 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-kubernetes\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhvzz\" (UniqueName: \"kubernetes.io/projected/4948a870-b955-4925-b7df-f7633aeafb1f-kube-api-access-lhvzz\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-slash\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-socket-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-kubelet\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-lib-modules\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-etc-selinux\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.575471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-etc-selinux\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwh5s\" (UniqueName: \"kubernetes.io/projected/7157dd9f-0f16-4758-b8af-03dbc44d7b15-kube-api-access-gwh5s\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-socket-dir-parent\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-k8s-cni-cncf-io\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-etc-kubernetes\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4948a870-b955-4925-b7df-f7633aeafb1f-serviceca\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574428 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-socket-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-cni-netd\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574445 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cni-binary-copy\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-run-k8s-cni-cncf-io\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.574524 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-os-release\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-systemd\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.574609 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:24.074568724 +0000 UTC m=+1.993660841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574582 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-host-cni-netd\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574609 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-systemd\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576273 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4948a870-b955-4925-b7df-f7633aeafb1f-host\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-etc-kubernetes\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxwfp\" (UniqueName: \"kubernetes.io/projected/3927e035-69f3-46fc-9786-3450d72d0281-kube-api-access-xxwfp\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-socket-dir-parent\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-daemon-config\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-device-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-cni-bin\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-sys\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574832 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-os-release\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-var-lib-kubelet\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c96334d-a9ef-4c89-8977-3755b9e40b35-kubelet-config\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574897 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-device-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-run-openvswitch\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-sys\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4948a870-b955-4925-b7df-f7633aeafb1f-serviceca\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-var-lib-kubelet\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3927e035-69f3-46fc-9786-3450d72d0281-ovn-node-metrics-cert\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.576852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574995 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-cni-bin\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.574993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c96334d-a9ef-4c89-8977-3755b9e40b35-kubelet-config\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-modprobe-d\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysconfig\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-run\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575113 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-modprobe-d\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b84a0963-1f66-42a9-bdb9-d33025194d67-iptables-alerter-script\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-daemon-config\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-env-overrides\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-run\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-cni-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysconfig\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgjpq\" (UniqueName: \"kubernetes.io/projected/b84a0963-1f66-42a9-bdb9-d33025194d67-kube-api-access-pgjpq\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575288 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-multus-cni-dir\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-sys-fs\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe3f1993-9f70-4234-b0d8-978332c951a7-agent-certs\") pod \"konnectivity-agent-9ffjc\" (UID: \"fe3f1993-9f70-4234-b0d8-978332c951a7\") " pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.577471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysctl-conf\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-systemd-units\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-sys-fs\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3927e035-69f3-46fc-9786-3450d72d0281-systemd-units\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-os-release\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575617 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-kubelet\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b84a0963-1f66-42a9-bdb9-d33025194d67-iptables-alerter-script\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-hostroot\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-sysctl-conf\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b32239f-f857-49a6-a92d-e90b5d020a90-tmp-dir\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575693 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-os-release\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwnql\" (UniqueName: \"kubernetes.io/projected/2b32239f-f857-49a6-a92d-e90b5d020a90-kube-api-access-pwnql\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.575712 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-hostroot\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-cnibin\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.578064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-cnibin\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02f11721-7bdd-4820-80b1-873f4d5d3257-host-var-lib-kubelet\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-ovnkube-script-lib\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02f11721-7bdd-4820-80b1-873f4d5d3257-cni-binary-copy\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7157dd9f-0f16-4758-b8af-03dbc44d7b15-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.575587 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-env-overrides\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.576033 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:24.076009371 +0000 UTC m=+1.995101458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2d9n\" (UniqueName: \"kubernetes.io/projected/02f11721-7bdd-4820-80b1-873f4d5d3257-kube-api-access-d2d9n\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-host\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-host\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576468 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b32239f-f857-49a6-a92d-e90b5d020a90-tmp-dir\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3927e035-69f3-46fc-9786-3450d72d0281-ovnkube-script-lib\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-tmp\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.576971 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.577078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-etc-tuned\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.577740 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3927e035-69f3-46fc-9786-3450d72d0281-ovn-node-metrics-cert\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.578564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.578335 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02f11721-7bdd-4820-80b1-873f4d5d3257-cni-binary-copy\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.580416 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.580397 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:23.580416 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.580415 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:23.580544 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.580425 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:23.580544 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:23.580474 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:34:24.080461732 +0000 UTC m=+1.999553817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:23.583219 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.583197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9nt\" (UniqueName: \"kubernetes.io/projected/2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6-kube-api-access-cb9nt\") pod \"multus-additional-cni-plugins-847rs\" (UID: \"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6\") " pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.583796 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.583713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsh6x\" (UniqueName: \"kubernetes.io/projected/fdedb3ba-23ff-4244-b083-d7d7d76cfb97-kube-api-access-zsh6x\") pod \"tuned-pm4jd\" (UID: \"fdedb3ba-23ff-4244-b083-d7d7d76cfb97\") " pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.583796 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.583727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhvzz\" (UniqueName: \"kubernetes.io/projected/4948a870-b955-4925-b7df-f7633aeafb1f-kube-api-access-lhvzz\") pod \"node-ca-llg2l\" (UID: \"4948a870-b955-4925-b7df-f7633aeafb1f\") " pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.583796 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.583727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwh5s\" (UniqueName: \"kubernetes.io/projected/7157dd9f-0f16-4758-b8af-03dbc44d7b15-kube-api-access-gwh5s\") pod \"aws-ebs-csi-driver-node-7p7ls\" (UID: \"7157dd9f-0f16-4758-b8af-03dbc44d7b15\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.583796 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.583729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxwfp\" (UniqueName: \"kubernetes.io/projected/3927e035-69f3-46fc-9786-3450d72d0281-kube-api-access-xxwfp\") pod \"ovnkube-node-g8dcq\" (UID: \"3927e035-69f3-46fc-9786-3450d72d0281\") " pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.584141 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.584121 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgjpq\" (UniqueName: \"kubernetes.io/projected/b84a0963-1f66-42a9-bdb9-d33025194d67-kube-api-access-pgjpq\") pod \"iptables-alerter-2z696\" (UID: \"b84a0963-1f66-42a9-bdb9-d33025194d67\") " pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.584455 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.584440 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwnql\" (UniqueName: \"kubernetes.io/projected/2b32239f-f857-49a6-a92d-e90b5d020a90-kube-api-access-pwnql\") pod \"node-resolver-l8tct\" (UID: \"2b32239f-f857-49a6-a92d-e90b5d020a90\") " pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.584840 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.584826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2d9n\" (UniqueName: \"kubernetes.io/projected/02f11721-7bdd-4820-80b1-873f4d5d3257-kube-api-access-d2d9n\") pod \"multus-mznbg\" (UID: \"02f11721-7bdd-4820-80b1-873f4d5d3257\") " pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.585104 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.585088 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgzl\" (UniqueName: \"kubernetes.io/projected/a31ab34b-a195-4e7a-bccb-93cc46162468-kube-api-access-pvgzl\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:23.677516 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.677409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe3f1993-9f70-4234-b0d8-978332c951a7-agent-certs\") pod \"konnectivity-agent-9ffjc\" (UID: \"fe3f1993-9f70-4234-b0d8-978332c951a7\") " pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.677516 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.677465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe3f1993-9f70-4234-b0d8-978332c951a7-konnectivity-ca\") pod \"konnectivity-agent-9ffjc\" (UID: \"fe3f1993-9f70-4234-b0d8-978332c951a7\") " pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.678042 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.678026 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fe3f1993-9f70-4234-b0d8-978332c951a7-konnectivity-ca\") pod \"konnectivity-agent-9ffjc\" (UID: \"fe3f1993-9f70-4234-b0d8-978332c951a7\") " pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.680166 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.680147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fe3f1993-9f70-4234-b0d8-978332c951a7-agent-certs\") pod \"konnectivity-agent-9ffjc\" (UID: \"fe3f1993-9f70-4234-b0d8-978332c951a7\") " pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.778377 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.778346 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-llg2l" Jun 05 15:34:23.787647 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.787603 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4948a870_b955_4925_b7df_f7633aeafb1f.slice/crio-003319e2b75c9a743e59301da4c659c3edffbd337f88bc0ef8fa02c8d45165cd WatchSource:0}: Error finding container 003319e2b75c9a743e59301da4c659c3edffbd337f88bc0ef8fa02c8d45165cd: Status 404 returned error can't find the container with id 003319e2b75c9a743e59301da4c659c3edffbd337f88bc0ef8fa02c8d45165cd Jun 05 15:34:23.800208 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.800002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mznbg" Jun 05 15:34:23.807221 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.807198 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f11721_7bdd_4820_80b1_873f4d5d3257.slice/crio-6a5ae5ae7d9605ce34cf88ad00ab1381b3ae67c0ca0f154cd7242ed8662b78af WatchSource:0}: Error finding container 6a5ae5ae7d9605ce34cf88ad00ab1381b3ae67c0ca0f154cd7242ed8662b78af: Status 404 returned error can't find the container with id 6a5ae5ae7d9605ce34cf88ad00ab1381b3ae67c0ca0f154cd7242ed8662b78af Jun 05 15:34:23.810082 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.810052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2z696" Jun 05 15:34:23.815702 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.815687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" Jun 05 15:34:23.817007 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.816983 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84a0963_1f66_42a9_bdb9_d33025194d67.slice/crio-ae6b77dd54caf84b05ea168bcaffd0a57b71e192d22c552c42d71e9777df4c6f WatchSource:0}: Error finding container ae6b77dd54caf84b05ea168bcaffd0a57b71e192d22c552c42d71e9777df4c6f: Status 404 returned error can't find the container with id ae6b77dd54caf84b05ea168bcaffd0a57b71e192d22c552c42d71e9777df4c6f Jun 05 15:34:23.820101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.820054 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" Jun 05 15:34:23.823622 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.823598 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7157dd9f_0f16_4758_b8af_03dbc44d7b15.slice/crio-f33c5e9082d51516a3278ed8c504d8f1bbc6e062686d5e9a46e6dfa7dd974a22 WatchSource:0}: Error finding container f33c5e9082d51516a3278ed8c504d8f1bbc6e062686d5e9a46e6dfa7dd974a22: Status 404 returned error can't find the container with id f33c5e9082d51516a3278ed8c504d8f1bbc6e062686d5e9a46e6dfa7dd974a22 Jun 05 15:34:23.826331 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.826306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8tct" Jun 05 15:34:23.827623 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.827605 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdedb3ba_23ff_4244_b083_d7d7d76cfb97.slice/crio-c8dbac90371a2b05504511ac64c012ae26763330ce4411f43c1d03bb7810e0c7 WatchSource:0}: Error finding container c8dbac90371a2b05504511ac64c012ae26763330ce4411f43c1d03bb7810e0c7: Status 404 returned error can't find the container with id c8dbac90371a2b05504511ac64c012ae26763330ce4411f43c1d03bb7810e0c7 Jun 05 15:34:23.830803 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.830743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-847rs" Jun 05 15:34:23.834012 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.833992 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b32239f_f857_49a6_a92d_e90b5d020a90.slice/crio-10297d786335b25f9071bdfea8b4bcfae6c77d515a0426249cd5c997c71989ea WatchSource:0}: Error finding container 10297d786335b25f9071bdfea8b4bcfae6c77d515a0426249cd5c997c71989ea: Status 404 returned error can't find the container with id 10297d786335b25f9071bdfea8b4bcfae6c77d515a0426249cd5c997c71989ea Jun 05 15:34:23.836944 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.836924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:23.838287 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.838255 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dde1b38_29b4_43b1_86ef_d3a73b2ec6b6.slice/crio-45251116508e32896c9d18453b3ffb47b53839ce30cecf5eda8d55b145d393f3 WatchSource:0}: Error finding container 45251116508e32896c9d18453b3ffb47b53839ce30cecf5eda8d55b145d393f3: Status 404 returned error can't find the container with id 45251116508e32896c9d18453b3ffb47b53839ce30cecf5eda8d55b145d393f3 Jun 05 15:34:23.841056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:23.841011 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:23.844448 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.844427 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3927e035_69f3_46fc_9786_3450d72d0281.slice/crio-6555ae301c1514db4edbff0b9e6370679c814527f7c90a769857fa1689cd3c83 WatchSource:0}: Error finding container 6555ae301c1514db4edbff0b9e6370679c814527f7c90a769857fa1689cd3c83: Status 404 returned error can't find the container with id 6555ae301c1514db4edbff0b9e6370679c814527f7c90a769857fa1689cd3c83 Jun 05 15:34:23.849331 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:23.849308 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3f1993_9f70_4234_b0d8_978332c951a7.slice/crio-1b89d489c66f2926917613625de7cec140bfd5fd6cfafde926d04e1a91ba0a09 WatchSource:0}: Error finding container 1b89d489c66f2926917613625de7cec140bfd5fd6cfafde926d04e1a91ba0a09: Status 404 returned error can't find the container with id 1b89d489c66f2926917613625de7cec140bfd5fd6cfafde926d04e1a91ba0a09 Jun 05 15:34:24.058683 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.058597 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:34:24.080711 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.080650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:24.080711 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.080701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:24.080911 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.080737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:24.080911 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080851 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:24.080911 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080875 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:24.080911 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080892 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:24.080911 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080906 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:24.080911 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080916 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:24.081154 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080917 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:25.08090117 +0000 UTC m=+2.999993259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:24.081154 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080962 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:25.080951261 +0000 UTC m=+3.000043347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:24.081154 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.080973 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:34:25.080966719 +0000 UTC m=+3.000058804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:24.374225 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.373979 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:34:24.522274 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.522173 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:29:23 +0000 UTC" deadline="2027-11-07 07:27:42.955569061 +0000 UTC" Jun 05 15:34:24.522274 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.522211 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12471h53m18.433362922s" Jun 05 15:34:24.535553 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.535523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:24.535699 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:24.535662 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:24.547507 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.547415 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2z696" event={"ID":"b84a0963-1f66-42a9-bdb9-d33025194d67","Type":"ContainerStarted","Data":"ae6b77dd54caf84b05ea168bcaffd0a57b71e192d22c552c42d71e9777df4c6f"} Jun 05 15:34:24.550980 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.550947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9ffjc" event={"ID":"fe3f1993-9f70-4234-b0d8-978332c951a7","Type":"ContainerStarted","Data":"1b89d489c66f2926917613625de7cec140bfd5fd6cfafde926d04e1a91ba0a09"} Jun 05 15:34:24.564339 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.564304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"6555ae301c1514db4edbff0b9e6370679c814527f7c90a769857fa1689cd3c83"} Jun 05 15:34:24.573829 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.573771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerStarted","Data":"45251116508e32896c9d18453b3ffb47b53839ce30cecf5eda8d55b145d393f3"} Jun 05 15:34:24.576410 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.576380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" event={"ID":"fdedb3ba-23ff-4244-b083-d7d7d76cfb97","Type":"ContainerStarted","Data":"c8dbac90371a2b05504511ac64c012ae26763330ce4411f43c1d03bb7810e0c7"} Jun 05 15:34:24.584705 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.584681 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 15:34:24.587380 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.587342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mznbg" event={"ID":"02f11721-7bdd-4820-80b1-873f4d5d3257","Type":"ContainerStarted","Data":"6a5ae5ae7d9605ce34cf88ad00ab1381b3ae67c0ca0f154cd7242ed8662b78af"} Jun 05 15:34:24.613773 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.591333 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-llg2l" event={"ID":"4948a870-b955-4925-b7df-f7633aeafb1f","Type":"ContainerStarted","Data":"003319e2b75c9a743e59301da4c659c3edffbd337f88bc0ef8fa02c8d45165cd"} Jun 05 15:34:24.613773 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.599485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8tct" event={"ID":"2b32239f-f857-49a6-a92d-e90b5d020a90","Type":"ContainerStarted","Data":"10297d786335b25f9071bdfea8b4bcfae6c77d515a0426249cd5c997c71989ea"} Jun 05 15:34:24.613773 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:24.603135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" event={"ID":"7157dd9f-0f16-4758-b8af-03dbc44d7b15","Type":"ContainerStarted","Data":"f33c5e9082d51516a3278ed8c504d8f1bbc6e062686d5e9a46e6dfa7dd974a22"} Jun 05 15:34:25.090884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.090329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:25.090884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.090393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:25.090884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.090439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:25.090884 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.090600 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:25.090884 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.090668 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:27.090646854 +0000 UTC m=+5.009738941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:25.091277 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.091105 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:25.091277 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.091180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:27.091165035 +0000 UTC m=+5.010257135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:25.091277 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.091259 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:25.091277 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.091274 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:25.091469 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.091286 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:25.091469 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.091320 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:34:27.091309327 +0000 UTC m=+5.010401414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:25.522562 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.522469 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 15:29:23 +0000 UTC" deadline="2028-03-15 06:12:20.672618944 +0000 UTC" Jun 05 15:34:25.522562 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.522523 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15566h37m55.150102125s" Jun 05 15:34:25.536148 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.536117 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:25.536317 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.536277 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:25.536690 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:25.536671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:25.536829 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:25.536808 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:26.536403 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:26.536305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:26.537947 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:26.537913 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:27.107918 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:27.107874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:27.108102 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:27.107954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:27.108102 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:27.108022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:27.108220 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108161 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:27.108271 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108228 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:31.108207147 +0000 UTC m=+9.027299252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:27.108896 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108644 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:27.108896 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108667 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:27.108896 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108681 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:27.108896 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:34:31.108709797 +0000 UTC m=+9.027801885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:27.108896 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108820 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:27.108896 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.108854 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:31.108841865 +0000 UTC m=+9.027933968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:27.536370 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:27.536293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:27.536525 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.536407 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:27.536879 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:27.536797 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:27.536948 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:27.536875 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:28.538506 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:28.538417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:28.538881 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:28.538548 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:29.536315 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:29.536282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:29.536507 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:29.536419 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:29.536744 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:29.536727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:29.536839 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:29.536827 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:30.535964 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:30.535931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:30.537953 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:30.537913 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:31.145093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:31.145049 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:31.145280 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:31.145105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:31.145280 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:31.145138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:31.145280 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145251 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:31.145438 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145298 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:39.145284963 +0000 UTC m=+17.064377048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:31.145438 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145338 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:31.145438 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145358 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:39.145352103 +0000 UTC m=+17.064444188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:31.145438 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145419 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:31.145438 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145430 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:31.145438 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145439 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:31.145723 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.145461 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:34:39.145453983 +0000 UTC m=+17.064546081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:31.535817 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:31.535495 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:31.535817 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:31.535540 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:31.535817 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.535620 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:31.535817 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:31.535713 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:32.537141 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:32.537111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:32.537616 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:32.537201 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:33.536276 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:33.536240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:33.536443 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:33.536367 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:33.536738 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:33.536715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:33.536873 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:33.536828 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:34.536387 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:34.536345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:34.536815 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:34.536502 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:35.535852 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:35.535767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:35.536000 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:35.535767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:35.536000 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:35.535891 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:35.536000 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:35.535982 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:36.536430 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:36.536402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:36.536941 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:36.536512 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:37.536359 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:37.536328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:37.536545 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:37.536369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:37.536545 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:37.536466 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:37.536951 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:37.536550 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:38.535721 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:38.535684 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:38.535920 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:38.535862 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:39.204138 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:39.204048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:39.204138 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:39.204103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:39.204634 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:39.204142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:39.204634 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204287 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:39.204634 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204307 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:39.204634 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204321 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:39.204634 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204379 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:34:55.204361304 +0000 UTC m=+33.123453389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:39.204905 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204817 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:39.204905 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204869 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:55.204853771 +0000 UTC m=+33.123945867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:39.205027 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204925 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:39.205027 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.204959 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:55.204947983 +0000 UTC m=+33.124040088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:39.536362 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:39.536277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:39.536615 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:39.536277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:39.536615 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.536411 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:39.536615 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:39.536493 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:40.535877 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:40.535837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:40.536330 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:40.535976 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:41.536123 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:41.536085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:41.536621 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:41.536085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:41.536621 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:41.536211 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:41.536621 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:41.536304 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:42.536987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:42.536955 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:42.537447 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:42.537062 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:43.535958 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:43.535927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:43.536040 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:43.535927 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:43.536078 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:43.536034 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:43.536112 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:43.536099 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:44.536671 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.536284 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:44.537482 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:44.536688 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:44.646270 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.646206 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" event={"ID":"fdedb3ba-23ff-4244-b083-d7d7d76cfb97","Type":"ContainerStarted","Data":"a9f7b1aa998f73bfbf6ca0691c6666296426385191355ddc196d54787cbe8d7a"} Jun 05 15:34:44.647584 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.647559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mznbg" event={"ID":"02f11721-7bdd-4820-80b1-873f4d5d3257","Type":"ContainerStarted","Data":"f7aae220f5ac06e7d9f7a2e4cf1632eea1a52372dc81a20e845b1d99a196a211"} Jun 05 15:34:44.648964 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.648939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" event={"ID":"a8b459a3fd9ef4dc8ea70f1ef3af0ad8","Type":"ContainerStarted","Data":"88b9b1306d33b788547b84c3fdce47980c70fb1a7f3f1d27a971c0d1ad932af6"} Jun 05 15:34:44.651614 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.651598 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:34:44.651935 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.651916 2579 generic.go:356] "Generic (PLEG): container finished" podID="3927e035-69f3-46fc-9786-3450d72d0281" containerID="d71eb8fb7145980fb5807d5bd2f4484a5eab687844d6d4e05de0d3432c0a3a13" exitCode=1 Jun 05 15:34:44.651992 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.651949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"be59c230491f5490947db739bdfd371701a4110dfa959d985743b2bb8abe64b2"} Jun 05 15:34:44.652030 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.651998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"5bb31348c1105a6ef08ee33b6ee772d6f3f16fd4d1fe08ed710818c8efff7aeb"} Jun 05 15:34:44.652030 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.652027 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"3ce93ea8fd352dc0da095c1accfdfca2093eefcc6ac16e018859204522e8e20f"} Jun 05 15:34:44.652086 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.652052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"0457ea2cda87aa54b14da7369c82fe5130d6fd33429d27e64cf5fc0e46f35f41"} Jun 05 15:34:44.652086 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.652080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerDied","Data":"d71eb8fb7145980fb5807d5bd2f4484a5eab687844d6d4e05de0d3432c0a3a13"} Jun 05 15:34:44.652143 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.652109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"8b56f789c7c192fef3c5574aef183c2d7e0af71d8a4e4cbaea12bdb327ccbeaa"} Jun 05 15:34:44.675224 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.675180 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" podStartSLOduration=22.675164081 podStartE2EDuration="22.675164081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:44.674799779 +0000 UTC m=+22.593891886" watchObservedRunningTime="2026-06-05 15:34:44.675164081 +0000 UTC m=+22.594256188" Jun 05 15:34:44.675345 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.675316 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pm4jd" podStartSLOduration=3.095437918 podStartE2EDuration="22.675310025s" totalImagesPullingTime="19.579872107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:44.660953375 +0000 UTC m=+22.580045487" watchObservedRunningTime="2026-06-05 15:34:44.675310025 +0000 UTC m=+22.594402133" Jun 05 15:34:44.689444 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:44.689404 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mznbg" podStartSLOduration=3.030835328 podStartE2EDuration="22.689389696s" totalImagesPullingTime="19.658554368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:44.68894081 +0000 UTC m=+22.608032916" watchObservedRunningTime="2026-06-05 15:34:44.689389696 +0000 UTC m=+22.608481803" Jun 05 15:34:45.536117 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.536085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:45.536280 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.536129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:45.536280 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:45.536221 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:45.536379 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:45.536327 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:45.655981 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.655936 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6" containerID="8041190a4a15540b0de24b450b56266522b57dd3c334db5739018aa12307fb61" exitCode=0 Jun 05 15:34:45.656452 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.655998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerDied","Data":"8041190a4a15540b0de24b450b56266522b57dd3c334db5739018aa12307fb61"} Jun 05 15:34:45.658306 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.658279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-llg2l" event={"ID":"4948a870-b955-4925-b7df-f7633aeafb1f","Type":"ContainerStarted","Data":"bde41e6ae15bf2ec285bbf1794a496a32c5161dfde9b1450695081a839471c61"} Jun 05 15:34:45.659777 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.659740 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8tct" event={"ID":"2b32239f-f857-49a6-a92d-e90b5d020a90","Type":"ContainerStarted","Data":"79c35ab0745b3d8c8345f4137e0306d874e71bc59e9e0508ff6c9364061bcdd6"} Jun 05 15:34:45.661357 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.661304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" event={"ID":"7157dd9f-0f16-4758-b8af-03dbc44d7b15","Type":"ContainerStarted","Data":"7e663c593cff746af56385adcdc1ab416c17330fc1b8ca2a07d587a0dd849808"} Jun 05 15:34:45.663707 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.663671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2z696" event={"ID":"b84a0963-1f66-42a9-bdb9-d33025194d67","Type":"ContainerStarted","Data":"cc400ea60ccb228c28cd9cfca39237b5adf76360e77a12fe583a64930fb93ac5"} Jun 05 15:34:45.666843 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.666822 2579 generic.go:356] "Generic (PLEG): container finished" podID="e526b697a6660df1e5f8b7328ff1328f" containerID="88d0ca1a305ce0e281456636813b28d9a4a703ededd5dcc854e6422780713b93" exitCode=0 Jun 05 15:34:45.666935 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.666887 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" event={"ID":"e526b697a6660df1e5f8b7328ff1328f","Type":"ContainerDied","Data":"88d0ca1a305ce0e281456636813b28d9a4a703ededd5dcc854e6422780713b93"} Jun 05 15:34:45.668395 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.668296 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9ffjc" event={"ID":"fe3f1993-9f70-4234-b0d8-978332c951a7","Type":"ContainerStarted","Data":"0905cf785d545741f010d820cff6bb51d1cfc24ef9c7d3c47c68022ea47c65bc"} Jun 05 15:34:45.684406 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.684364 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2z696" podStartSLOduration=4.032113861 podStartE2EDuration="23.684350059s" totalImagesPullingTime="19.652236198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:45.683875437 +0000 UTC m=+23.602967543" watchObservedRunningTime="2026-06-05 15:34:45.684350059 +0000 UTC m=+23.603442175" Jun 05 15:34:45.695462 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.695416 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l8tct" podStartSLOduration=4.121608959 podStartE2EDuration="23.6954015s" totalImagesPullingTime="19.573792541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:45.694998282 +0000 UTC m=+23.614090389" watchObservedRunningTime="2026-06-05 15:34:45.6954015 +0000 UTC m=+23.614493605" Jun 05 15:34:45.707365 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.707318 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9ffjc" podStartSLOduration=4.094665251 podStartE2EDuration="23.707299396s" totalImagesPullingTime="19.612634145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:45.707213707 +0000 UTC m=+23.626305812" watchObservedRunningTime="2026-06-05 15:34:45.707299396 +0000 UTC m=+23.626391503" Jun 05 15:34:45.732935 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:45.732886 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-llg2l" podStartSLOduration=4.059061699 podStartE2EDuration="23.732869175s" totalImagesPullingTime="19.673807476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:45.732292306 +0000 UTC m=+23.651384412" watchObservedRunningTime="2026-06-05 15:34:45.732869175 +0000 UTC m=+23.651961466" Jun 05 15:34:46.143915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.143743 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 15:34:46.533028 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.532909 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T15:34:46.14390964Z","UUID":"6c617ff9-81f4-4bf9-9dc5-84f28b2d0467","Handler":null,"Name":"","Endpoint":""} Jun 05 15:34:46.534533 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.534502 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 15:34:46.534533 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.534539 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 15:34:46.535547 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.535529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:46.535672 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:46.535645 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:46.673207 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.673169 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" event={"ID":"7157dd9f-0f16-4758-b8af-03dbc44d7b15","Type":"ContainerStarted","Data":"516678e48fbdf4e11b96b379edfb04da560a642baf0fd892e00cedc509c98891"} Jun 05 15:34:46.675278 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.675243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" event={"ID":"e526b697a6660df1e5f8b7328ff1328f","Type":"ContainerStarted","Data":"657e9848e45a51fa01063eab94db919f4c39d3919a1f27722b71aed3d092a0d2"} Jun 05 15:34:46.678544 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.678485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:34:46.678880 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.678858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"76347c1c19d61564a08d29541aea014bea1a5cb7d9801d92de68aa8a9c5940ab"} Jun 05 15:34:46.686973 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:46.686927 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" podStartSLOduration=24.686909178 podStartE2EDuration="24.686909178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:46.6864168 +0000 UTC m=+24.605508907" watchObservedRunningTime="2026-06-05 15:34:46.686909178 +0000 UTC m=+24.606001285" Jun 05 15:34:47.338440 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.338416 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:47.338941 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.338926 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:47.536245 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.536161 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:47.536468 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:47.536287 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:47.536468 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.536336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:47.536468 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:47.536437 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:47.683151 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.683115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" event={"ID":"7157dd9f-0f16-4758-b8af-03dbc44d7b15","Type":"ContainerStarted","Data":"1686551edc72666f18f9b4fcddd5944814d9218f2b1f7fa7fc003e3d996fcce7"} Jun 05 15:34:47.683857 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.683451 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:47.683857 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.683844 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9ffjc" Jun 05 15:34:47.698458 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:47.698414 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7p7ls" podStartSLOduration=4.029936316 podStartE2EDuration="25.698401432s" totalImagesPullingTime="21.668465116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:47.697900243 +0000 UTC m=+25.616992350" watchObservedRunningTime="2026-06-05 15:34:47.698401432 +0000 UTC m=+25.617493538" Jun 05 15:34:48.536058 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:48.536025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:48.536240 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:48.536153 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:49.536091 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.535897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:49.536537 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.535938 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:49.536537 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:49.536200 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:49.536537 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:49.536225 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:49.691541 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.691512 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:34:49.691899 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.691875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"6224d8de0937c8c8cbe5d555a3bf66c68dce38e8e537b10ffcf2870056682d4d"} Jun 05 15:34:49.692155 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.692128 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:49.692258 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.692200 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:49.692258 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.692247 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:49.692338 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.692293 2579 scope.go:117] "RemoveContainer" containerID="d71eb8fb7145980fb5807d5bd2f4484a5eab687844d6d4e05de0d3432c0a3a13" Jun 05 15:34:49.711976 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.711947 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:49.712804 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:49.712781 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:34:50.536352 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.536100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:50.536713 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:50.536481 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:50.645198 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.645167 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zltth"] Jun 05 15:34:50.649262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.649238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9shx6"] Jun 05 15:34:50.649401 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.649355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:50.649493 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:50.649461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:50.649940 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.649921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5gjm"] Jun 05 15:34:50.650054 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.650029 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:50.650141 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:50.650115 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:50.698293 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.698224 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:34:50.698634 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.698616 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" event={"ID":"3927e035-69f3-46fc-9786-3450d72d0281","Type":"ContainerStarted","Data":"ad5c542acf1244330740479f327693736f482c35f79a525d2b68d142b2b4ddaa"} Jun 05 15:34:50.698745 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.698725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:50.699045 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:50.699012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:50.723360 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:50.723310 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" podStartSLOduration=8.847707141 podStartE2EDuration="28.723286543s" totalImagesPullingTime="19.875579402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:34:50.72252685 +0000 UTC m=+28.641618958" watchObservedRunningTime="2026-06-05 15:34:50.723286543 +0000 UTC m=+28.642378629" Jun 05 15:34:52.535704 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:52.535666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:52.536276 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:52.535889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:52.536276 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:52.535891 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:52.536276 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:52.535982 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:52.539053 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:52.539010 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:52.539448 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:52.538902 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:54.536035 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:54.536002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:54.536742 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:54.536006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:54.536742 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:54.536136 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:54.536742 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:54.536002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:54.536742 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:54.536183 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:54.536742 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:54.536245 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:54.709672 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:54.709637 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6" containerID="1df141862e3c8c8b017911b48da86bdab97720cf452a7d15389cc0d63b589141" exitCode=0 Jun 05 15:34:54.709820 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:54.709690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerDied","Data":"1df141862e3c8c8b017911b48da86bdab97720cf452a7d15389cc0d63b589141"} Jun 05 15:34:55.222306 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:55.222101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:55.222463 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:55.222325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:55.222463 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222269 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:55.222463 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:55.222369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:55.222463 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222426 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:35:27.222404055 +0000 UTC m=+65.141496154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 15:34:55.222463 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222459 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:55.222719 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222481 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 15:34:55.222719 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222499 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 15:34:55.222719 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222511 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nx6w for pod openshift-network-diagnostics/network-check-target-9shx6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:55.222719 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222518 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret podName:0c96334d-a9ef-4c89-8977-3755b9e40b35 nodeName:}" failed. No retries permitted until 2026-06-05 15:35:27.222501943 +0000 UTC m=+65.141594047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret") pod "global-pull-secret-syncer-zltth" (UID: "0c96334d-a9ef-4c89-8977-3755b9e40b35") : object "kube-system"/"original-pull-secret" not registered Jun 05 15:34:55.222719 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:55.222547 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w podName:83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff nodeName:}" failed. No retries permitted until 2026-06-05 15:35:27.222536314 +0000 UTC m=+65.141628400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nx6w" (UniqueName: "kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w") pod "network-check-target-9shx6" (UID: "83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 15:34:55.714533 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:55.714452 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6" containerID="ec42f9f9c0529bfe6b93b0976b0fed7003602f3ab646ba8a808b70b4a39113ab" exitCode=0 Jun 05 15:34:55.714533 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:55.714494 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerDied","Data":"ec42f9f9c0529bfe6b93b0976b0fed7003602f3ab646ba8a808b70b4a39113ab"} Jun 05 15:34:56.535606 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.535569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:56.535742 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:56.535668 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zltth" podUID="0c96334d-a9ef-4c89-8977-3755b9e40b35" Jun 05 15:34:56.535742 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.535574 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:56.535742 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.535740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:56.535941 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:56.535836 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:34:56.535941 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:56.535898 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9shx6" podUID="83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff" Jun 05 15:34:56.719395 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.719308 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6" containerID="c12ddd519a0013aa0dc218c274d9fcf57e2763b59f052d98d51b735610c8d22a" exitCode=0 Jun 05 15:34:56.719395 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.719353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerDied","Data":"c12ddd519a0013aa0dc218c274d9fcf57e2763b59f052d98d51b735610c8d22a"} Jun 05 15:34:56.939950 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.939920 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeReady" Jun 05 15:34:56.940107 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.940068 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 15:34:56.978572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.978494 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6dmmw"] Jun 05 15:34:56.980606 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.980579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:56.983392 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.982228 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cflnl"] Jun 05 15:34:56.983707 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.983683 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 15:34:56.983951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.983931 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 15:34:56.984025 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.983961 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dm5g6\"" Jun 05 15:34:56.984668 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.984509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:56.985986 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.985967 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-44z5b\"" Jun 05 15:34:56.986191 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.986176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 15:34:56.986344 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.986324 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 15:34:56.986512 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.986496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 15:34:56.989867 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.989513 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6dmmw"] Jun 05 15:34:56.999916 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:56.999895 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cflnl"] Jun 05 15:34:57.134656 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.134611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6-kube-api-access-tfzqh\") pod \"ingress-canary-cflnl\" (UID: \"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6\") " pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.134656 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.134664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6-cert\") pod \"ingress-canary-cflnl\" (UID: \"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6\") " pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.134949 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.134683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.134949 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.134734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47d21d45-c80a-49d3-ac41-f886c4daffb0-config-volume\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.134949 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.134809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4f9k\" (UniqueName: \"kubernetes.io/projected/47d21d45-c80a-49d3-ac41-f886c4daffb0-kube-api-access-v4f9k\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.134949 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.134867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d21d45-c80a-49d3-ac41-f886c4daffb0-tmp-dir\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.235673 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.235585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6-kube-api-access-tfzqh\") pod \"ingress-canary-cflnl\" (UID: \"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6\") " pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.235673 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.235633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6-cert\") pod \"ingress-canary-cflnl\" (UID: \"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6\") " pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.235673 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.235653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.235947 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.235680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47d21d45-c80a-49d3-ac41-f886c4daffb0-config-volume\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.235947 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.235709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4f9k\" (UniqueName: \"kubernetes.io/projected/47d21d45-c80a-49d3-ac41-f886c4daffb0-kube-api-access-v4f9k\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.235947 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.235770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d21d45-c80a-49d3-ac41-f886c4daffb0-tmp-dir\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.236125 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.236104 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47d21d45-c80a-49d3-ac41-f886c4daffb0-tmp-dir\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.236206 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:57.236192 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:34:57.236264 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:57.236244 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:57.736228602 +0000 UTC m=+35.655320688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:34:57.236402 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.236383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47d21d45-c80a-49d3-ac41-f886c4daffb0-config-volume\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.240929 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.240905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6-cert\") pod \"ingress-canary-cflnl\" (UID: \"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6\") " pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.244097 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.244073 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4f9k\" (UniqueName: \"kubernetes.io/projected/47d21d45-c80a-49d3-ac41-f886c4daffb0-kube-api-access-v4f9k\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.244929 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.244898 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6-kube-api-access-tfzqh\") pod \"ingress-canary-cflnl\" (UID: \"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6\") " pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.297936 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.297900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cflnl" Jun 05 15:34:57.448049 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.448014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cflnl"] Jun 05 15:34:57.452897 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:34:57.452863 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda659e16b_8ef8_4c28_9a8a_7c3c1bc9a9e6.slice/crio-dfdb2c898c00a7dcbee318380d46e7653c9306d619807e427189060e852bcc33 WatchSource:0}: Error finding container dfdb2c898c00a7dcbee318380d46e7653c9306d619807e427189060e852bcc33: Status 404 returned error can't find the container with id dfdb2c898c00a7dcbee318380d46e7653c9306d619807e427189060e852bcc33 Jun 05 15:34:57.722849 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.722743 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cflnl" event={"ID":"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6","Type":"ContainerStarted","Data":"dfdb2c898c00a7dcbee318380d46e7653c9306d619807e427189060e852bcc33"} Jun 05 15:34:57.741106 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:57.741062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:57.741270 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:57.741246 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:34:57.741339 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:57.741325 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:34:58.741303862 +0000 UTC m=+36.660395951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:34:58.536922 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.536889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:34:58.537113 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.536888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:34:58.537113 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.537037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:34:58.539159 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.538833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:34:58.539159 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.538863 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:34:58.539159 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.538940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wbl4\"" Jun 05 15:34:58.539392 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.539220 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:34:58.539506 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.539480 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:34:58.539608 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.539518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hw5f\"" Jun 05 15:34:58.750480 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:34:58.750442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:34:58.751070 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:58.750612 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:34:58.751070 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:34:58.750685 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:35:00.750665007 +0000 UTC m=+38.669757093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:35:00.768978 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:00.768734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:35:00.769441 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:00.768915 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:35:00.769441 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:00.769141 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:35:04.769114373 +0000 UTC m=+42.688206472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:35:02.738109 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:02.738069 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6" containerID="a901dd008d34d2996d20f5ac4828d3df63c689af00a7d5e434ca1a97d81c6156" exitCode=0 Jun 05 15:35:02.738918 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:02.738153 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerDied","Data":"a901dd008d34d2996d20f5ac4828d3df63c689af00a7d5e434ca1a97d81c6156"} Jun 05 15:35:02.739770 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:02.739728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cflnl" event={"ID":"a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6","Type":"ContainerStarted","Data":"556038bd8bb6022605125c7cc67e978fa98c2123c9a9f42ddc512bda56d1bbfb"} Jun 05 15:35:02.769202 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:02.769145 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cflnl" podStartSLOduration=2.6177349789999997 podStartE2EDuration="6.76912354s" totalImagesPullingTime="4.151388561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:35:02.768944738 +0000 UTC m=+40.688036884" watchObservedRunningTime="2026-06-05 15:35:02.76912354 +0000 UTC m=+40.688215661" Jun 05 15:35:03.744838 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:03.744799 2579 generic.go:356] "Generic (PLEG): container finished" podID="2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6" containerID="a6b15ee5b862a0d6f2fc478f643c7bc458bb27a0dc2f0dee7d310b9165d78ee5" exitCode=0 Jun 05 15:35:03.745262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:03.744886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerDied","Data":"a6b15ee5b862a0d6f2fc478f643c7bc458bb27a0dc2f0dee7d310b9165d78ee5"} Jun 05 15:35:04.750090 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:04.750055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-847rs" event={"ID":"2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6","Type":"ContainerStarted","Data":"75c73252ef88e18c77b66ba289e715571002b5b72285441aae83d8cb048373f8"} Jun 05 15:35:04.768765 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:04.768693 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-847rs" podStartSLOduration=8.709053087000001 podStartE2EDuration="42.768678635s" totalImagesPullingTime="34.059625548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:35:04.767165543 +0000 UTC m=+42.686257651" watchObservedRunningTime="2026-06-05 15:35:04.768678635 +0000 UTC m=+42.687770743" Jun 05 15:35:04.800406 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:04.800370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:35:04.800587 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:04.800518 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:35:04.800629 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:04.800587 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:35:12.800572251 +0000 UTC m=+50.719664340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:35:12.863479 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:12.863439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:35:12.863932 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:12.863565 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:35:12.863932 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:12.863620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:35:28.86360438 +0000 UTC m=+66.782696469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:35:21.712447 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:21.712417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g8dcq" Jun 05 15:35:27.257389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.257335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:35:27.257389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.257397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:35:27.257912 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.257424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:35:27.259282 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.259262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 15:35:27.259351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.259335 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 15:35:27.259385 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.259336 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 15:35:27.268641 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:27.268616 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:35:27.268720 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:27.268706 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:31.268683805 +0000 UTC m=+129.187775892 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : secret "metrics-daemon-secret" not found Jun 05 15:35:27.269742 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.269726 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 15:35:27.271997 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.271979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c96334d-a9ef-4c89-8977-3755b9e40b35-original-pull-secret\") pod \"global-pull-secret-syncer-zltth\" (UID: \"0c96334d-a9ef-4c89-8977-3755b9e40b35\") " pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:35:27.281120 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.281098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nx6w\" (UniqueName: \"kubernetes.io/projected/83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff-kube-api-access-9nx6w\") pod \"network-check-target-9shx6\" (UID: \"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff\") " pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:35:27.351342 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.351305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zltth" Jun 05 15:35:27.367625 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.367601 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hw5f\"" Jun 05 15:35:27.376973 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.376943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:35:27.481332 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.481251 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zltth"] Jun 05 15:35:27.486118 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:35:27.486094 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c96334d_a9ef_4c89_8977_3755b9e40b35.slice/crio-39382e2b0085d3e50db768a6c69dc8a3c3346e96f03c04997131507d51d4e327 WatchSource:0}: Error finding container 39382e2b0085d3e50db768a6c69dc8a3c3346e96f03c04997131507d51d4e327: Status 404 returned error can't find the container with id 39382e2b0085d3e50db768a6c69dc8a3c3346e96f03c04997131507d51d4e327 Jun 05 15:35:27.506188 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.506157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9shx6"] Jun 05 15:35:27.510132 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:35:27.510102 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c6feaf_eac3_4c44_8cb2_c7cc6910c1ff.slice/crio-60c62ebbd965567db1a4c4ce3daf157f0537c52cb0d5e768b1c552e200fa5d27 WatchSource:0}: Error finding container 60c62ebbd965567db1a4c4ce3daf157f0537c52cb0d5e768b1c552e200fa5d27: Status 404 returned error can't find the container with id 60c62ebbd965567db1a4c4ce3daf157f0537c52cb0d5e768b1c552e200fa5d27 Jun 05 15:35:27.803333 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.803250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9shx6" event={"ID":"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff","Type":"ContainerStarted","Data":"60c62ebbd965567db1a4c4ce3daf157f0537c52cb0d5e768b1c552e200fa5d27"} Jun 05 15:35:27.804310 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:27.804286 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zltth" event={"ID":"0c96334d-a9ef-4c89-8977-3755b9e40b35","Type":"ContainerStarted","Data":"39382e2b0085d3e50db768a6c69dc8a3c3346e96f03c04997131507d51d4e327"} Jun 05 15:35:28.869587 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:28.869543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:35:28.870133 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:28.869720 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:35:28.870133 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:35:28.869815 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:36:00.869794283 +0000 UTC m=+98.788886372 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:35:32.817875 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:32.817826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9shx6" event={"ID":"83c6feaf-eac3-4c44-8cb2-c7cc6910c1ff","Type":"ContainerStarted","Data":"6ab8441924b9f377fa461ba7ab16dd296cc0e24376add839da209da45cb4dab5"} Jun 05 15:35:32.818345 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:32.817964 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:35:32.819282 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:32.819259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zltth" event={"ID":"0c96334d-a9ef-4c89-8977-3755b9e40b35","Type":"ContainerStarted","Data":"1e143a70c30c6fe9428158c11baa103a050f45efdb0425a3db226ea8f003ac21"} Jun 05 15:35:32.831809 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:32.831736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9shx6" podStartSLOduration=65.909147836 podStartE2EDuration="1m10.831720427s" totalImagesPullingTime="4.922572591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:35:32.830911239 +0000 UTC m=+70.750003346" watchObservedRunningTime="2026-06-05 15:35:32.831720427 +0000 UTC m=+70.750812535" Jun 05 15:35:32.843592 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:35:32.843529 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zltth" podStartSLOduration=65.88536529 podStartE2EDuration="1m10.843507172s" totalImagesPullingTime="4.958141882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:35:32.843062821 +0000 UTC m=+70.762154930" watchObservedRunningTime="2026-06-05 15:35:32.843507172 +0000 UTC m=+70.762599278" Jun 05 15:36:00.890220 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:00.890189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:36:00.890636 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:36:00.890290 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:36:00.890636 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:36:00.890343 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:04.890330674 +0000 UTC m=+162.809422760 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:36:03.824463 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:03.824431 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9shx6" Jun 05 15:36:14.517679 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.517641 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr"] Jun 05 15:36:14.519456 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.519439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.521227 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.521196 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 15:36:14.521629 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.521282 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 15:36:14.522808 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.522785 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 15:36:14.523552 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.523527 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 15:36:14.526833 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.526810 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr"] Jun 05 15:36:14.579764 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.579715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzxpg\" (UniqueName: \"kubernetes.io/projected/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-kube-api-access-lzxpg\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.579918 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.579779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-tmp\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.579918 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.579858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.680723 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.680689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzxpg\" (UniqueName: \"kubernetes.io/projected/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-kube-api-access-lzxpg\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.680723 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.680727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-tmp\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.680907 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.680767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.681156 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.681137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-tmp\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.683580 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.683554 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.688171 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.688144 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzxpg\" (UniqueName: \"kubernetes.io/projected/d2463b04-0463-4ef9-b3a5-89e8230ce9cb-kube-api-access-lzxpg\") pod \"klusterlet-addon-workmgr-5c97599b69-d8jsr\" (UID: \"d2463b04-0463-4ef9-b3a5-89e8230ce9cb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.832478 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.832386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:14.954976 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:14.954940 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr"] Jun 05 15:36:14.958289 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:36:14.958264 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2463b04_0463_4ef9_b3a5_89e8230ce9cb.slice/crio-0fe04443487e6fcd3c4b18cb8fb1729bdeb4eb5396042510166170a45bcba18b WatchSource:0}: Error finding container 0fe04443487e6fcd3c4b18cb8fb1729bdeb4eb5396042510166170a45bcba18b: Status 404 returned error can't find the container with id 0fe04443487e6fcd3c4b18cb8fb1729bdeb4eb5396042510166170a45bcba18b Jun 05 15:36:15.924849 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:15.924805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" event={"ID":"d2463b04-0463-4ef9-b3a5-89e8230ce9cb","Type":"ContainerStarted","Data":"0fe04443487e6fcd3c4b18cb8fb1729bdeb4eb5396042510166170a45bcba18b"} Jun 05 15:36:21.944614 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:21.944578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" event={"ID":"d2463b04-0463-4ef9-b3a5-89e8230ce9cb","Type":"ContainerStarted","Data":"91e0e39b1b472dcc5cae9a49e607f6655db3baf3464c3f5f5c0c627c1d1c0c29"} Jun 05 15:36:21.945028 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:21.944703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:21.946328 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:21.946309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:36:21.958064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:21.958015 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" podStartSLOduration=1.7398208899999998 podStartE2EDuration="7.957999167s" totalImagesPullingTime="6.218178277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:36:21.956459807 +0000 UTC m=+119.875551926" watchObservedRunningTime="2026-06-05 15:36:21.957999167 +0000 UTC m=+119.877091266" Jun 05 15:36:31.297656 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:36:31.297604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:36:31.298094 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:36:31.297816 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 15:36:31.298094 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:36:31.297901 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs podName:a31ab34b-a195-4e7a-bccb-93cc46162468 nodeName:}" failed. No retries permitted until 2026-06-05 15:38:33.297883436 +0000 UTC m=+251.216975525 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs") pod "network-metrics-daemon-w5gjm" (UID: "a31ab34b-a195-4e7a-bccb-93cc46162468") : secret "metrics-daemon-secret" not found Jun 05 15:36:59.993241 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:36:59.993196 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6dmmw" podUID="47d21d45-c80a-49d3-ac41-f886c4daffb0" Jun 05 15:37:00.035720 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:00.033546 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dmmw" Jun 05 15:37:01.559631 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:01.559580 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w5gjm" podUID="a31ab34b-a195-4e7a-bccb-93cc46162468" Jun 05 15:37:04.919521 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:04.919475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:37:04.919947 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:04.919625 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 15:37:04.919947 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:04.919692 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls podName:47d21d45-c80a-49d3-ac41-f886c4daffb0 nodeName:}" failed. No retries permitted until 2026-06-05 15:39:06.919672798 +0000 UTC m=+284.838764886 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls") pod "dns-default-6dmmw" (UID: "47d21d45-c80a-49d3-ac41-f886c4daffb0") : secret "dns-default-metrics-tls" not found Jun 05 15:37:14.535653 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:14.535563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:37:21.483071 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.483040 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-589d6fbc4f-q7srj"] Jun 05 15:37:21.484863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.484847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.487937 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.487903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 15:37:21.488077 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.488005 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 15:37:21.489160 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.488199 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 15:37:21.489160 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.488318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q4f99\"" Jun 05 15:37:21.489160 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.488407 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 15:37:21.489160 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.488448 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 15:37:21.489160 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.489036 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 15:37:21.508064 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.508030 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-589d6fbc4f-q7srj"] Jun 05 15:37:21.578916 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.578875 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h"] Jun 05 15:37:21.580875 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.580853 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-nzvnd"] Jun 05 15:37:21.581010 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.580990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.582578 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.582546 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bfb5b4d94-9jf4v"] Jun 05 15:37:21.582704 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.582677 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.582841 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.582679 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-69k8g\"" Jun 05 15:37:21.582841 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.582773 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 15:37:21.582963 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.582907 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 15:37:21.583229 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.583214 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 15:37:21.583458 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.583442 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:37:21.584301 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.584286 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.584726 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.584699 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 15:37:21.584812 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.584776 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:37:21.585279 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.585260 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 15:37:21.585380 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.585297 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 15:37:21.585694 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.585679 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2cvbh\"" Jun 05 15:37:21.586515 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.586495 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 15:37:21.586615 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.586500 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vgmzz\"" Jun 05 15:37:21.586615 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.586530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 15:37:21.586615 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.586569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 15:37:21.591579 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.591560 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 15:37:21.591891 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.591874 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 15:37:21.596499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.596236 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-nzvnd"] Jun 05 15:37:21.596657 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.596636 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h"] Jun 05 15:37:21.597566 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.597545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bfb5b4d94-9jf4v"] Jun 05 15:37:21.627496 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.627468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-default-certificate\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.627496 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.627498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzqhh\" (UniqueName: \"kubernetes.io/projected/85847081-1304-405d-a9cf-4d0decc9cab3-kube-api-access-zzqhh\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.627687 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.627535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-stats-auth\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.627687 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.627555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.627687 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.627582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.727990 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.727948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.728169 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.727998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728169 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-default-certificate\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.728169 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-registry-certificates\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728169 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzqhh\" (UniqueName: \"kubernetes.io/projected/85847081-1304-405d-a9cf-4d0decc9cab3-kube-api-access-zzqhh\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.728169 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-trusted-ca\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728169 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:21.728149 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:22.228123507 +0000 UTC m=+180.147215593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : configmap references non-existent config key: service-ca.crt Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4239cbb-0504-4628-a711-d3a82c680b26-ca-trust-extracted\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-stats-auth\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-bound-sa-token\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpqxw\" (UniqueName: \"kubernetes.io/projected/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-kube-api-access-tpqxw\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.728427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8da5c00e-4dec-4658-9e5e-da9689963c80-serving-cert\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8da5c00e-4dec-4658-9e5e-da9689963c80-config\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da5c00e-4dec-4658-9e5e-da9689963c80-trusted-ca\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728547 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-installation-pull-secrets\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pl5c\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-kube-api-access-8pl5c\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2jx\" (UniqueName: \"kubernetes.io/projected/8da5c00e-4dec-4658-9e5e-da9689963c80-kube-api-access-ml2jx\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.728696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-image-registry-private-configuration\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.728824 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:21.728781 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 15:37:21.729069 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:21.728835 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:22.228818184 +0000 UTC m=+180.147910290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : secret "router-metrics-certs-default" not found Jun 05 15:37:21.730643 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.730623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-default-certificate\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.730724 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.730649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-stats-auth\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.735495 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.735434 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzqhh\" (UniqueName: \"kubernetes.io/projected/85847081-1304-405d-a9cf-4d0decc9cab3-kube-api-access-zzqhh\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:21.829728 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pl5c\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-kube-api-access-8pl5c\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2jx\" (UniqueName: \"kubernetes.io/projected/8da5c00e-4dec-4658-9e5e-da9689963c80-kube-api-access-ml2jx\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-image-registry-private-configuration\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-registry-certificates\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-trusted-ca\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.829921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4239cbb-0504-4628-a711-d3a82c680b26-ca-trust-extracted\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-bound-sa-token\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:21.829945 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:21.829971 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfb5b4d94-9jf4v: secret "image-registry-tls" not found Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.829972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpqxw\" (UniqueName: \"kubernetes.io/projected/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-kube-api-access-tpqxw\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:21.830046 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls podName:c4239cbb-0504-4628-a711-d3a82c680b26 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:22.330025459 +0000 UTC m=+180.249117564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls") pod "image-registry-6bfb5b4d94-9jf4v" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26") : secret "image-registry-tls" not found Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8da5c00e-4dec-4658-9e5e-da9689963c80-serving-cert\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8da5c00e-4dec-4658-9e5e-da9689963c80-config\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da5c00e-4dec-4658-9e5e-da9689963c80-trusted-ca\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.830266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-installation-pull-secrets\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.830738 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-registry-certificates\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.830819 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.830986 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.830961 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-trusted-ca\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.831267 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.831234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4239cbb-0504-4628-a711-d3a82c680b26-ca-trust-extracted\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.831379 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.831362 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8da5c00e-4dec-4658-9e5e-da9689963c80-config\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.831688 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.831665 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8da5c00e-4dec-4658-9e5e-da9689963c80-trusted-ca\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.833085 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.833063 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.833181 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.833128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-image-registry-private-configuration\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.833181 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.833173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8da5c00e-4dec-4658-9e5e-da9689963c80-serving-cert\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.833288 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.833269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-installation-pull-secrets\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.840739 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.840711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2jx\" (UniqueName: \"kubernetes.io/projected/8da5c00e-4dec-4658-9e5e-da9689963c80-kube-api-access-ml2jx\") pod \"console-operator-668fdbf85c-nzvnd\" (UID: \"8da5c00e-4dec-4658-9e5e-da9689963c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:21.840887 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.840797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-bound-sa-token\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.841168 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.841134 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpqxw\" (UniqueName: \"kubernetes.io/projected/ef3ada5e-8af7-4d56-a76c-3639a4f3836c-kube-api-access-tpqxw\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-br29h\" (UID: \"ef3ada5e-8af7-4d56-a76c-3639a4f3836c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.841238 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.841172 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pl5c\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-kube-api-access-8pl5c\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:21.892110 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.892077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" Jun 05 15:37:21.899135 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:21.899108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:22.019594 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.019554 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h"] Jun 05 15:37:22.022704 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:22.022677 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3ada5e_8af7_4d56_a76c_3639a4f3836c.slice/crio-a75dcad3489481bffce00b0b19e80852f8377448691f9e086054d769a9ab411d WatchSource:0}: Error finding container a75dcad3489481bffce00b0b19e80852f8377448691f9e086054d769a9ab411d: Status 404 returned error can't find the container with id a75dcad3489481bffce00b0b19e80852f8377448691f9e086054d769a9ab411d Jun 05 15:37:22.042242 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.042215 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-nzvnd"] Jun 05 15:37:22.045489 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:22.045465 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da5c00e_4dec_4658_9e5e_da9689963c80.slice/crio-d693d6be6eb7223f4afa17ad38704aeef89b595ee3c7bddda951bb83ad66ab0e WatchSource:0}: Error finding container d693d6be6eb7223f4afa17ad38704aeef89b595ee3c7bddda951bb83ad66ab0e: Status 404 returned error can't find the container with id d693d6be6eb7223f4afa17ad38704aeef89b595ee3c7bddda951bb83ad66ab0e Jun 05 15:37:22.090587 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.090535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" event={"ID":"8da5c00e-4dec-4658-9e5e-da9689963c80","Type":"ContainerStarted","Data":"d693d6be6eb7223f4afa17ad38704aeef89b595ee3c7bddda951bb83ad66ab0e"} Jun 05 15:37:22.091521 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.091496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" event={"ID":"ef3ada5e-8af7-4d56-a76c-3639a4f3836c","Type":"ContainerStarted","Data":"a75dcad3489481bffce00b0b19e80852f8377448691f9e086054d769a9ab411d"} Jun 05 15:37:22.233533 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.233479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:22.233533 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.233534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:22.233841 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:22.233652 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 15:37:22.233841 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:22.233661 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:23.233646968 +0000 UTC m=+181.152739055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : configmap references non-existent config key: service-ca.crt Jun 05 15:37:22.233841 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:22.233730 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:23.233712317 +0000 UTC m=+181.152804405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : secret "router-metrics-certs-default" not found Jun 05 15:37:22.334123 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:22.334025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:22.334278 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:22.334178 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:37:22.334278 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:22.334200 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfb5b4d94-9jf4v: secret "image-registry-tls" not found Jun 05 15:37:22.334278 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:22.334258 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls podName:c4239cbb-0504-4628-a711-d3a82c680b26 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:23.334242847 +0000 UTC m=+181.253334937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls") pod "image-registry-6bfb5b4d94-9jf4v" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26") : secret "image-registry-tls" not found Jun 05 15:37:23.242590 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:23.242548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:23.243078 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:23.242600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:23.243078 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:23.242741 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 15:37:23.243078 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:23.242793 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:25.24277243 +0000 UTC m=+183.161864520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : configmap references non-existent config key: service-ca.crt Jun 05 15:37:23.243078 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:23.242826 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:25.242805863 +0000 UTC m=+183.161897952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : secret "router-metrics-certs-default" not found Jun 05 15:37:23.343201 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:23.343159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:23.343391 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:23.343328 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:37:23.343391 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:23.343348 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfb5b4d94-9jf4v: secret "image-registry-tls" not found Jun 05 15:37:23.343505 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:23.343416 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls podName:c4239cbb-0504-4628-a711-d3a82c680b26 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:25.343395446 +0000 UTC m=+183.262487544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls") pod "image-registry-6bfb5b4d94-9jf4v" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26") : secret "image-registry-tls" not found Jun 05 15:37:25.100802 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.100771 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/0.log" Jun 05 15:37:25.101262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.100816 2579 generic.go:356] "Generic (PLEG): container finished" podID="8da5c00e-4dec-4658-9e5e-da9689963c80" containerID="ecc41b71e486e007127c503310073fdb1a326b258a2eeae030ef19448faaffa0" exitCode=255 Jun 05 15:37:25.101262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.100910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" event={"ID":"8da5c00e-4dec-4658-9e5e-da9689963c80","Type":"ContainerDied","Data":"ecc41b71e486e007127c503310073fdb1a326b258a2eeae030ef19448faaffa0"} Jun 05 15:37:25.101262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.101117 2579 scope.go:117] "RemoveContainer" containerID="ecc41b71e486e007127c503310073fdb1a326b258a2eeae030ef19448faaffa0" Jun 05 15:37:25.102480 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.102448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" event={"ID":"ef3ada5e-8af7-4d56-a76c-3639a4f3836c","Type":"ContainerStarted","Data":"bb2f2a01a3ccae8d5d21ac2dd9ff62b46b2c3bbbd0f8fd8fb320fc6e9ded8ff6"} Jun 05 15:37:25.156204 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.156145 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" podStartSLOduration=1.750974835 podStartE2EDuration="4.156125622s" totalImagesPullingTime="2.405150787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:25.155465136 +0000 UTC m=+183.074557256" watchObservedRunningTime="2026-06-05 15:37:25.156125622 +0000 UTC m=+183.075217732" Jun 05 15:37:25.259368 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.259332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:25.259541 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.259376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:25.259541 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:25.259491 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 15:37:25.259646 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:25.259558 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:29.25953812 +0000 UTC m=+187.178630208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : secret "router-metrics-certs-default" not found Jun 05 15:37:25.259646 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:25.259608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:29.259588037 +0000 UTC m=+187.178680138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : configmap references non-existent config key: service-ca.crt Jun 05 15:37:25.360110 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:25.360025 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:25.360247 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:25.360164 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:37:25.360247 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:25.360183 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfb5b4d94-9jf4v: secret "image-registry-tls" not found Jun 05 15:37:25.360247 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:25.360242 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls podName:c4239cbb-0504-4628-a711-d3a82c680b26 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:29.360225403 +0000 UTC m=+187.279317493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls") pod "image-registry-6bfb5b4d94-9jf4v" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26") : secret "image-registry-tls" not found Jun 05 15:37:26.106930 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:26.106902 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:37:26.107318 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:26.107282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/0.log" Jun 05 15:37:26.107367 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:26.107314 2579 generic.go:356] "Generic (PLEG): container finished" podID="8da5c00e-4dec-4658-9e5e-da9689963c80" containerID="55ec65a9b000c179148e055d1ddc29e4def68fd72f0a4149a52f31c47f1a067b" exitCode=255 Jun 05 15:37:26.107416 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:26.107395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" event={"ID":"8da5c00e-4dec-4658-9e5e-da9689963c80","Type":"ContainerDied","Data":"55ec65a9b000c179148e055d1ddc29e4def68fd72f0a4149a52f31c47f1a067b"} Jun 05 15:37:26.107496 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:26.107485 2579 scope.go:117] "RemoveContainer" containerID="ecc41b71e486e007127c503310073fdb1a326b258a2eeae030ef19448faaffa0" Jun 05 15:37:26.107826 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:26.107811 2579 scope.go:117] "RemoveContainer" containerID="55ec65a9b000c179148e055d1ddc29e4def68fd72f0a4149a52f31c47f1a067b" Jun 05 15:37:26.108012 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:26.107995 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nzvnd_openshift-console-operator(8da5c00e-4dec-4658-9e5e-da9689963c80)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" podUID="8da5c00e-4dec-4658-9e5e-da9689963c80" Jun 05 15:37:27.111593 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:27.111561 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:37:27.112175 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:27.111959 2579 scope.go:117] "RemoveContainer" containerID="55ec65a9b000c179148e055d1ddc29e4def68fd72f0a4149a52f31c47f1a067b" Jun 05 15:37:27.112175 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:27.112136 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nzvnd_openshift-console-operator(8da5c00e-4dec-4658-9e5e-da9689963c80)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" podUID="8da5c00e-4dec-4658-9e5e-da9689963c80" Jun 05 15:37:28.104896 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:28.104869 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8tct_2b32239f-f857-49a6-a92d-e90b5d020a90/dns-node-resolver/0.log" Jun 05 15:37:29.106116 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:29.106092 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-llg2l_4948a870-b955-4925-b7df-f7633aeafb1f/node-ca/0.log" Jun 05 15:37:29.291187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:29.291150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:29.291187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:29.291193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:29.291414 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:29.291332 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 15:37:29.291414 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:29.291353 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:37.291335598 +0000 UTC m=+195.210427706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : configmap references non-existent config key: service-ca.crt Jun 05 15:37:29.291414 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:29.291386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs podName:85847081-1304-405d-a9cf-4d0decc9cab3 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:37.291375517 +0000 UTC m=+195.210467603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs") pod "router-default-589d6fbc4f-q7srj" (UID: "85847081-1304-405d-a9cf-4d0decc9cab3") : secret "router-metrics-certs-default" not found Jun 05 15:37:29.392565 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:29.392473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:29.392707 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:29.392638 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 15:37:29.392707 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:29.392659 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfb5b4d94-9jf4v: secret "image-registry-tls" not found Jun 05 15:37:29.392819 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:29.392767 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls podName:c4239cbb-0504-4628-a711-d3a82c680b26 nodeName:}" failed. No retries permitted until 2026-06-05 15:37:37.392730423 +0000 UTC m=+195.311822510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls") pod "image-registry-6bfb5b4d94-9jf4v" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26") : secret "image-registry-tls" not found Jun 05 15:37:29.706019 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:29.705990 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cflnl_a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6/serve-healthcheck-canary/0.log" Jun 05 15:37:31.899481 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:31.899429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:31.899915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:31.899501 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:31.899915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:31.899851 2579 scope.go:117] "RemoveContainer" containerID="55ec65a9b000c179148e055d1ddc29e4def68fd72f0a4149a52f31c47f1a067b" Jun 05 15:37:31.900013 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:37:31.899995 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-nzvnd_openshift-console-operator(8da5c00e-4dec-4658-9e5e-da9689963c80)\"" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" podUID="8da5c00e-4dec-4658-9e5e-da9689963c80" Jun 05 15:37:37.354410 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.354365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:37.354410 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.354407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:37.355085 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.355063 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85847081-1304-405d-a9cf-4d0decc9cab3-service-ca-bundle\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:37.356942 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.356921 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85847081-1304-405d-a9cf-4d0decc9cab3-metrics-certs\") pod \"router-default-589d6fbc4f-q7srj\" (UID: \"85847081-1304-405d-a9cf-4d0decc9cab3\") " pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:37.397651 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.397612 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q4f99\"" Jun 05 15:37:37.406951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.406912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:37.455111 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.455069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:37.458795 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.458769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"image-registry-6bfb5b4d94-9jf4v\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:37.506725 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.506692 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vgmzz\"" Jun 05 15:37:37.516039 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.516013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:37.538255 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.538216 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-589d6fbc4f-q7srj"] Jun 05 15:37:37.542991 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:37.542958 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85847081_1304_405d_a9cf_4d0decc9cab3.slice/crio-eaba571f06f0e36a004c84fe40839b24e5b5b510efe27c8272e17edfdc7d0ab0 WatchSource:0}: Error finding container eaba571f06f0e36a004c84fe40839b24e5b5b510efe27c8272e17edfdc7d0ab0: Status 404 returned error can't find the container with id eaba571f06f0e36a004c84fe40839b24e5b5b510efe27c8272e17edfdc7d0ab0 Jun 05 15:37:37.650881 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:37.650846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bfb5b4d94-9jf4v"] Jun 05 15:37:37.654006 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:37.653981 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4239cbb_0504_4628_a711_d3a82c680b26.slice/crio-338f50fd8c2b108103d1f01b529696e53e99891776af3e90f9b7ce7e281b2d62 WatchSource:0}: Error finding container 338f50fd8c2b108103d1f01b529696e53e99891776af3e90f9b7ce7e281b2d62: Status 404 returned error can't find the container with id 338f50fd8c2b108103d1f01b529696e53e99891776af3e90f9b7ce7e281b2d62 Jun 05 15:37:38.143565 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.143530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" event={"ID":"c4239cbb-0504-4628-a711-d3a82c680b26","Type":"ContainerStarted","Data":"728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0"} Jun 05 15:37:38.143783 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.143589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" event={"ID":"c4239cbb-0504-4628-a711-d3a82c680b26","Type":"ContainerStarted","Data":"338f50fd8c2b108103d1f01b529696e53e99891776af3e90f9b7ce7e281b2d62"} Jun 05 15:37:38.143783 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.143638 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:37:38.144990 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.144967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" event={"ID":"85847081-1304-405d-a9cf-4d0decc9cab3","Type":"ContainerStarted","Data":"54a555052110808eac245208ae9413d846f8658b80fe7b63b5a2a066b543b45b"} Jun 05 15:37:38.145111 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.145005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" event={"ID":"85847081-1304-405d-a9cf-4d0decc9cab3","Type":"ContainerStarted","Data":"eaba571f06f0e36a004c84fe40839b24e5b5b510efe27c8272e17edfdc7d0ab0"} Jun 05 15:37:38.159965 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.159907 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" podStartSLOduration=17.159886428 podStartE2EDuration="17.159886428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:38.158552143 +0000 UTC m=+196.077644251" watchObservedRunningTime="2026-06-05 15:37:38.159886428 +0000 UTC m=+196.078978536" Jun 05 15:37:38.173670 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.173625 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" podStartSLOduration=17.173611227 podStartE2EDuration="17.173611227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:38.172088946 +0000 UTC m=+196.091181073" watchObservedRunningTime="2026-06-05 15:37:38.173611227 +0000 UTC m=+196.092703336" Jun 05 15:37:38.407888 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.407801 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:38.410464 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:38.410443 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:39.147887 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:39.147859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:39.149220 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:39.149199 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-589d6fbc4f-q7srj" Jun 05 15:37:43.536076 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:43.536038 2579 scope.go:117] "RemoveContainer" containerID="55ec65a9b000c179148e055d1ddc29e4def68fd72f0a4149a52f31c47f1a067b" Jun 05 15:37:44.170590 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:44.170556 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:37:44.170786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:44.170622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" event={"ID":"8da5c00e-4dec-4658-9e5e-da9689963c80","Type":"ContainerStarted","Data":"353dc06d4999bde598452207c8b7a3cc9fb0cb0d1d85cceb4b32c5ed0316b7b2"} Jun 05 15:37:44.171038 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:44.171008 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:44.186936 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:44.186878 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" podStartSLOduration=20.803564855 podStartE2EDuration="23.186859297s" totalImagesPullingTime="2.383294442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:44.185073333 +0000 UTC m=+202.104165441" watchObservedRunningTime="2026-06-05 15:37:44.186859297 +0000 UTC m=+202.105951407" Jun 05 15:37:44.597890 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:44.597863 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-nzvnd" Jun 05 15:37:48.293095 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.293063 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2"] Jun 05 15:37:48.295973 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.295956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:48.297649 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.297613 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-crfbt\"" Jun 05 15:37:48.297930 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.297916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 15:37:48.305592 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.305566 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-plk4m"] Jun 05 15:37:48.309198 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.309173 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2"] Jun 05 15:37:48.309317 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.309275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:37:48.311269 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.311247 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bfb5b4d94-9jf4v"] Jun 05 15:37:48.312091 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.311838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-chnc2\"" Jun 05 15:37:48.312234 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.312217 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 15:37:48.312496 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.312481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 15:37:48.318266 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.318234 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9zn98"] Jun 05 15:37:48.322342 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.322321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.324044 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.324024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ptq4k\"" Jun 05 15:37:48.324567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.324549 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 15:37:48.324671 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.324651 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 15:37:48.324729 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.324711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-plk4m"] Jun 05 15:37:48.324810 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.324610 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 15:37:48.324906 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.324889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 15:37:48.333608 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.333580 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zn98"] Jun 05 15:37:48.339714 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.339691 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59cd596fcd-vdq2r"] Jun 05 15:37:48.343004 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.342984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.343184 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.343165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skbf\" (UniqueName: \"kubernetes.io/projected/43add59e-15f1-4cae-a663-26896aa9c6dc-kube-api-access-8skbf\") pod \"downloads-6657875f97-plk4m\" (UID: \"43add59e-15f1-4cae-a663-26896aa9c6dc\") " pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:37:48.343262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.343199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959b5806-fab7-4e4c-927b-49c535d4b4d5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnd2\" (UID: \"959b5806-fab7-4e4c-927b-49c535d4b4d5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:48.359657 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.359630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59cd596fcd-vdq2r"] Jun 05 15:37:48.444420 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-bound-sa-token\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.444596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e76b199d-f15a-414e-8e91-77ad76ee03ed-installation-pull-secrets\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.444596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68081149-2407-42fb-b80e-4ec9db98f708-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.444596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-registry-tls\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.444596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68081149-2407-42fb-b80e-4ec9db98f708-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.444596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e76b199d-f15a-414e-8e91-77ad76ee03ed-registry-certificates\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.444848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skbf\" (UniqueName: \"kubernetes.io/projected/43add59e-15f1-4cae-a663-26896aa9c6dc-kube-api-access-8skbf\") pod \"downloads-6657875f97-plk4m\" (UID: \"43add59e-15f1-4cae-a663-26896aa9c6dc\") " pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:37:48.444848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959b5806-fab7-4e4c-927b-49c535d4b4d5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnd2\" (UID: \"959b5806-fab7-4e4c-927b-49c535d4b4d5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:48.444848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e76b199d-f15a-414e-8e91-77ad76ee03ed-image-registry-private-configuration\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.444848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444698 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmc6\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-kube-api-access-zdmc6\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.444848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl6lj\" (UniqueName: \"kubernetes.io/projected/68081149-2407-42fb-b80e-4ec9db98f708-kube-api-access-kl6lj\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.444848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e76b199d-f15a-414e-8e91-77ad76ee03ed-trusted-ca\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.445121 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68081149-2407-42fb-b80e-4ec9db98f708-crio-socket\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.445121 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68081149-2407-42fb-b80e-4ec9db98f708-data-volume\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.445121 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.444992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e76b199d-f15a-414e-8e91-77ad76ee03ed-ca-trust-extracted\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.447276 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.447254 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/959b5806-fab7-4e4c-927b-49c535d4b4d5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnd2\" (UID: \"959b5806-fab7-4e4c-927b-49c535d4b4d5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:48.451252 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.451219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skbf\" (UniqueName: \"kubernetes.io/projected/43add59e-15f1-4cae-a663-26896aa9c6dc-kube-api-access-8skbf\") pod \"downloads-6657875f97-plk4m\" (UID: \"43add59e-15f1-4cae-a663-26896aa9c6dc\") " pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:37:48.545402 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e76b199d-f15a-414e-8e91-77ad76ee03ed-registry-certificates\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545402 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e76b199d-f15a-414e-8e91-77ad76ee03ed-image-registry-private-configuration\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545402 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmc6\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-kube-api-access-zdmc6\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545402 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl6lj\" (UniqueName: \"kubernetes.io/projected/68081149-2407-42fb-b80e-4ec9db98f708-kube-api-access-kl6lj\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.545717 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e76b199d-f15a-414e-8e91-77ad76ee03ed-trusted-ca\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545717 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68081149-2407-42fb-b80e-4ec9db98f708-crio-socket\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.545717 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68081149-2407-42fb-b80e-4ec9db98f708-data-volume\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.545885 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e76b199d-f15a-414e-8e91-77ad76ee03ed-ca-trust-extracted\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545885 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68081149-2407-42fb-b80e-4ec9db98f708-crio-socket\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.545885 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-bound-sa-token\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545885 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e76b199d-f15a-414e-8e91-77ad76ee03ed-installation-pull-secrets\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.545885 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68081149-2407-42fb-b80e-4ec9db98f708-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.546100 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-registry-tls\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.546100 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.545939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68081149-2407-42fb-b80e-4ec9db98f708-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.546100 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.546058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68081149-2407-42fb-b80e-4ec9db98f708-data-volume\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.546306 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.546282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e76b199d-f15a-414e-8e91-77ad76ee03ed-registry-certificates\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.546509 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.546477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e76b199d-f15a-414e-8e91-77ad76ee03ed-ca-trust-extracted\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.546509 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.546489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68081149-2407-42fb-b80e-4ec9db98f708-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.547198 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.547173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e76b199d-f15a-414e-8e91-77ad76ee03ed-trusted-ca\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.548241 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.548213 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e76b199d-f15a-414e-8e91-77ad76ee03ed-image-registry-private-configuration\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.548543 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.548522 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e76b199d-f15a-414e-8e91-77ad76ee03ed-installation-pull-secrets\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.548904 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.548883 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68081149-2407-42fb-b80e-4ec9db98f708-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.549040 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.549024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-registry-tls\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.554500 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.554475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmc6\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-kube-api-access-zdmc6\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.554744 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.554725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl6lj\" (UniqueName: \"kubernetes.io/projected/68081149-2407-42fb-b80e-4ec9db98f708-kube-api-access-kl6lj\") pod \"insights-runtime-extractor-9zn98\" (UID: \"68081149-2407-42fb-b80e-4ec9db98f708\") " pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.554943 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.554904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e76b199d-f15a-414e-8e91-77ad76ee03ed-bound-sa-token\") pod \"image-registry-59cd596fcd-vdq2r\" (UID: \"e76b199d-f15a-414e-8e91-77ad76ee03ed\") " pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.605664 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.605624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:48.623311 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.623289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:37:48.635296 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.635271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9zn98" Jun 05 15:37:48.652414 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.652385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:48.766009 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.765978 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2"] Jun 05 15:37:48.770922 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:48.770877 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959b5806_fab7_4e4c_927b_49c535d4b4d5.slice/crio-4ea73cbecb74ceae060c49ff5d2f612e1b16645d5b8faa494b7897c128eab573 WatchSource:0}: Error finding container 4ea73cbecb74ceae060c49ff5d2f612e1b16645d5b8faa494b7897c128eab573: Status 404 returned error can't find the container with id 4ea73cbecb74ceae060c49ff5d2f612e1b16645d5b8faa494b7897c128eab573 Jun 05 15:37:48.790778 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.790735 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-plk4m"] Jun 05 15:37:48.797319 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:48.797236 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43add59e_15f1_4cae_a663_26896aa9c6dc.slice/crio-df88fcb8dd8c13ed5a4657da66039ee54a47c98b6ad7ad5e34b3ff795c967444 WatchSource:0}: Error finding container df88fcb8dd8c13ed5a4657da66039ee54a47c98b6ad7ad5e34b3ff795c967444: Status 404 returned error can't find the container with id df88fcb8dd8c13ed5a4657da66039ee54a47c98b6ad7ad5e34b3ff795c967444 Jun 05 15:37:48.822309 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.822278 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59cd596fcd-vdq2r"] Jun 05 15:37:48.826095 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:48.826066 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76b199d_f15a_414e_8e91_77ad76ee03ed.slice/crio-341ff4c4b8688ad3b64a646d37d93640f1c560d6bb08a143df80fec72e1ade79 WatchSource:0}: Error finding container 341ff4c4b8688ad3b64a646d37d93640f1c560d6bb08a143df80fec72e1ade79: Status 404 returned error can't find the container with id 341ff4c4b8688ad3b64a646d37d93640f1c560d6bb08a143df80fec72e1ade79 Jun 05 15:37:48.834987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:48.834963 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9zn98"] Jun 05 15:37:48.838582 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:48.838554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68081149_2407_42fb_b80e_4ec9db98f708.slice/crio-e55c823b66dad2fd53db6dd377275af0dfff2cc8649e1919a345bb5d652ba198 WatchSource:0}: Error finding container e55c823b66dad2fd53db6dd377275af0dfff2cc8649e1919a345bb5d652ba198: Status 404 returned error can't find the container with id e55c823b66dad2fd53db6dd377275af0dfff2cc8649e1919a345bb5d652ba198 Jun 05 15:37:49.187945 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.187863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zn98" event={"ID":"68081149-2407-42fb-b80e-4ec9db98f708","Type":"ContainerStarted","Data":"4d4319dde7a08b117088ac18d4ade5cd060f25045b4d4834e36b39528837732f"} Jun 05 15:37:49.188108 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.187944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zn98" event={"ID":"68081149-2407-42fb-b80e-4ec9db98f708","Type":"ContainerStarted","Data":"e55c823b66dad2fd53db6dd377275af0dfff2cc8649e1919a345bb5d652ba198"} Jun 05 15:37:49.189036 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.189010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" event={"ID":"959b5806-fab7-4e4c-927b-49c535d4b4d5","Type":"ContainerStarted","Data":"4ea73cbecb74ceae060c49ff5d2f612e1b16645d5b8faa494b7897c128eab573"} Jun 05 15:37:49.190389 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.190365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" event={"ID":"e76b199d-f15a-414e-8e91-77ad76ee03ed","Type":"ContainerStarted","Data":"277bdfa888b36612fdcd2ebdfb95520427c19af0d9610957ed503913459cccf3"} Jun 05 15:37:49.190483 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.190409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" event={"ID":"e76b199d-f15a-414e-8e91-77ad76ee03ed","Type":"ContainerStarted","Data":"341ff4c4b8688ad3b64a646d37d93640f1c560d6bb08a143df80fec72e1ade79"} Jun 05 15:37:49.190625 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.190600 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:37:49.191542 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.191522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-plk4m" event={"ID":"43add59e-15f1-4cae-a663-26896aa9c6dc","Type":"ContainerStarted","Data":"df88fcb8dd8c13ed5a4657da66039ee54a47c98b6ad7ad5e34b3ff795c967444"} Jun 05 15:37:49.207743 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:49.207689 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podStartSLOduration=1.207672543 podStartE2EDuration="1.207672543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:49.206105841 +0000 UTC m=+207.125197948" watchObservedRunningTime="2026-06-05 15:37:49.207672543 +0000 UTC m=+207.126764641" Jun 05 15:37:50.198740 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:50.198585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zn98" event={"ID":"68081149-2407-42fb-b80e-4ec9db98f708","Type":"ContainerStarted","Data":"10ff0ff62187358f2d73375cb7374046a8c713b78911047ed9eff5284814dd22"} Jun 05 15:37:50.200974 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:50.200947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" event={"ID":"959b5806-fab7-4e4c-927b-49c535d4b4d5","Type":"ContainerStarted","Data":"79453b4741115cd2db3bee3d24b43bc309780401ca4b8ab6959b2164740e274d"} Jun 05 15:37:50.201401 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:50.201377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:50.206986 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:50.206906 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" Jun 05 15:37:50.213243 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:50.213190 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnd2" podStartSLOduration=1.101228124 podStartE2EDuration="2.213173301s" totalImagesPullingTime="1.111945177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:50.212910851 +0000 UTC m=+208.132002960" watchObservedRunningTime="2026-06-05 15:37:50.213173301 +0000 UTC m=+208.132265404" Jun 05 15:37:51.207659 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:51.207626 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9zn98" event={"ID":"68081149-2407-42fb-b80e-4ec9db98f708","Type":"ContainerStarted","Data":"9c61e20670cb82369a8f8d3ad6153828019c3aa025261239b8fb889ecbdc3430"} Jun 05 15:37:51.222236 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:51.222183 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9zn98" podStartSLOduration=1.085994934 podStartE2EDuration="3.222164656s" totalImagesPullingTime="2.136169722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:37:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:51.221362411 +0000 UTC m=+209.140454512" watchObservedRunningTime="2026-06-05 15:37:51.222164656 +0000 UTC m=+209.141256788" Jun 05 15:37:56.486676 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.486636 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s9zw9"] Jun 05 15:37:56.491635 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.491610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.493794 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.493423 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 15:37:56.493794 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.493423 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 15:37:56.493794 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.493465 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 15:37:56.493794 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.493617 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 15:37:56.493794 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.493721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 15:37:56.495253 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.495231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kwh86\"" Jun 05 15:37:56.495374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.495294 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 15:37:56.620086 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-accelerators-collector-config\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620292 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-wtmp\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620292 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-root\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620292 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-tls\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620433 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-textfile\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620433 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620433 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-sys\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620555 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptq46\" (UniqueName: \"kubernetes.io/projected/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-kube-api-access-ptq46\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.620555 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.620474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-metrics-client-ca\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721242 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-metrics-client-ca\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721428 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721288 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-accelerators-collector-config\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721428 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-wtmp\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721428 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-root\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721428 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-tls\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721645 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-textfile\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721645 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721645 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-sys\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721645 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptq46\" (UniqueName: \"kubernetes.io/projected/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-kube-api-access-ptq46\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721645 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-wtmp\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721905 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721814 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-root\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721905 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721832 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-textfile\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721905 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-sys\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.721905 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.721897 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-metrics-client-ca\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.722117 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.722012 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-accelerators-collector-config\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.725148 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.725088 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-tls\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.725148 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.725115 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.728708 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.728670 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptq46\" (UniqueName: \"kubernetes.io/projected/06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d-kube-api-access-ptq46\") pod \"node-exporter-s9zw9\" (UID: \"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d\") " pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.803987 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:56.803891 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s9zw9" Jun 05 15:37:56.817722 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:37:56.817679 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a5fd9b_294b_4ec3_be77_0dfd7a5ed73d.slice/crio-1f1accdc5d722ae719dbf4177e46b24ed8f03aa0607425a0b97b8f9eef8c6083 WatchSource:0}: Error finding container 1f1accdc5d722ae719dbf4177e46b24ed8f03aa0607425a0b97b8f9eef8c6083: Status 404 returned error can't find the container with id 1f1accdc5d722ae719dbf4177e46b24ed8f03aa0607425a0b97b8f9eef8c6083 Jun 05 15:37:57.230990 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:57.230953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s9zw9" event={"ID":"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d","Type":"ContainerStarted","Data":"1f1accdc5d722ae719dbf4177e46b24ed8f03aa0607425a0b97b8f9eef8c6083"} Jun 05 15:37:58.236936 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:58.236840 2579 generic.go:356] "Generic (PLEG): container finished" podID="06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d" containerID="9ca50badf1c8e72670c524dbd7bb2d79117a9b3432bb98768177340a2bca5d0b" exitCode=0 Jun 05 15:37:58.237398 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:58.236923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s9zw9" event={"ID":"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d","Type":"ContainerDied","Data":"9ca50badf1c8e72670c524dbd7bb2d79117a9b3432bb98768177340a2bca5d0b"} Jun 05 15:37:58.317495 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:58.317463 2579 patch_prober.go:28] interesting pod/image-registry-6bfb5b4d94-9jf4v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:37:58.317606 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:58.317520 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:37:59.242806 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:59.242742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s9zw9" event={"ID":"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d","Type":"ContainerStarted","Data":"c89691de40fc90b84fb497c6adedf5abe16a61779c0db538c8df31acc636571f"} Jun 05 15:37:59.243290 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:59.242835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s9zw9" event={"ID":"06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d","Type":"ContainerStarted","Data":"65ee1c249080f68bdbf88838404d20a23fedbf169190e072beea0923498f18fe"} Jun 05 15:37:59.259225 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:37:59.259172 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s9zw9" podStartSLOduration=2.00733878 podStartE2EDuration="3.259154583s" totalImagesPullingTime="1.159373015s" totalInitContainerRuntime="92.442788ms" isStatefulPod=true podCreationTimestamp="2026-06-05 15:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:37:59.257912029 +0000 UTC m=+217.177004139" watchObservedRunningTime="2026-06-05 15:37:59.259154583 +0000 UTC m=+217.178246735" Jun 05 15:38:02.493963 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.493921 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfbdb664d-pbdml"] Jun 05 15:38:02.498523 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.498500 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.500130 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.500100 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 15:38:02.500712 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.500515 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 15:38:02.500712 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.500580 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 15:38:02.500712 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.500590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 15:38:02.500712 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.500591 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 15:38:02.500712 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.500591 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qdmtl\"" Jun 05 15:38:02.506048 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.506025 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfbdb664d-pbdml"] Jun 05 15:38:02.506249 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.506033 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 15:38:02.577781 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.577728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-oauth-serving-cert\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.577970 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.577809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-oauth-config\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.577970 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.577852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-serving-cert\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.577970 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.577922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-config\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.577970 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.577955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-trusted-ca-bundle\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.578190 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.578005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-service-ca\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.578190 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.578031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx28x\" (UniqueName: \"kubernetes.io/projected/5bae691a-a63c-4cd8-b279-1b40731bf0db-kube-api-access-tx28x\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.663251 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.663209 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:38:02.667557 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.667531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.669417 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.669394 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 15:38:02.669903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.669653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 15:38:02.669903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.669716 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 15:38:02.669903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.669786 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 15:38:02.669903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.669816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 15:38:02.669903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.669817 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 15:38:02.670450 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670434 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 15:38:02.670535 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7ksf6\"" Jun 05 15:38:02.670535 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670515 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1bdbj2gkofvhj\"" Jun 05 15:38:02.670640 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 15:38:02.670856 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 15:38:02.670856 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670849 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 15:38:02.670990 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.670880 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 15:38:02.671145 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.671102 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 15:38:02.671493 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.671377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 15:38:02.672685 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.672667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 15:38:02.675887 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.675799 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 15:38:02.678611 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-trusted-ca-bundle\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.678724 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-service-ca\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.678724 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx28x\" (UniqueName: \"kubernetes.io/projected/5bae691a-a63c-4cd8-b279-1b40731bf0db-kube-api-access-tx28x\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.678724 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-oauth-serving-cert\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.678724 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-oauth-config\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.678976 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-serving-cert\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.678976 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.678874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-config\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.679431 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.679403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-service-ca\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.679521 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.679446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-oauth-serving-cert\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.679595 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.679570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-trusted-ca-bundle\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.679678 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.679571 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-config\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.681740 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.681717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-oauth-config\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.681865 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.681725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-serving-cert\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.685109 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.685087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:38:02.687454 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.687433 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx28x\" (UniqueName: \"kubernetes.io/projected/5bae691a-a63c-4cd8-b279-1b40731bf0db-kube-api-access-tx28x\") pod \"console-5dfbdb664d-pbdml\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.780135 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780135 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780135 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780125 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xc7m\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-kube-api-access-5xc7m\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-config\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780991 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780991 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.780991 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.780739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.811128 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.811081 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:02.882059 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882059 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882323 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882323 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882323 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882323 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882323 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xc7m\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-kube-api-access-5xc7m\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-config\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.882951 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.882771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.883242 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.883141 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.883842 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.883814 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.886085 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.885695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.886085 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.886063 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.886396 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.886364 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.886827 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.886771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.887329 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.887302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.887694 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.887671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.888906 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.888566 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.889400 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.889400 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.889541 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889439 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-config\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.889541 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889501 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.889849 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889807 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.889976 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.890018 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.889981 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.890142 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.890118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.890284 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.890262 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.891053 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.891030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xc7m\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-kube-api-access-5xc7m\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.892360 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.892339 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:02.979209 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:02.979178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:05.674851 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:05.674805 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfbdb664d-pbdml"] Jun 05 15:38:05.677668 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:38:05.677644 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bae691a_a63c_4cd8_b279_1b40731bf0db.slice/crio-a2b495974175c0bdeb903f5ef04a23937adf7237b3485981616550a11fe81ac5 WatchSource:0}: Error finding container a2b495974175c0bdeb903f5ef04a23937adf7237b3485981616550a11fe81ac5: Status 404 returned error can't find the container with id a2b495974175c0bdeb903f5ef04a23937adf7237b3485981616550a11fe81ac5 Jun 05 15:38:05.695593 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:05.695546 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:38:05.698929 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:38:05.698889 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf927565_788e_4a27_bee1_2e490bd63bd8.slice/crio-1544b1aea93c626ab612e624f5ea00a566b511f0aefc115331e792d516318b7c WatchSource:0}: Error finding container 1544b1aea93c626ab612e624f5ea00a566b511f0aefc115331e792d516318b7c: Status 404 returned error can't find the container with id 1544b1aea93c626ab612e624f5ea00a566b511f0aefc115331e792d516318b7c Jun 05 15:38:06.272029 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:06.271888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"1544b1aea93c626ab612e624f5ea00a566b511f0aefc115331e792d516318b7c"} Jun 05 15:38:06.278210 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:06.277370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-plk4m" event={"ID":"43add59e-15f1-4cae-a663-26896aa9c6dc","Type":"ContainerStarted","Data":"88fb35616ca8cd4ec64c7c2542537b39c26e4bb6addd2d39a8966faea1dd5670"} Jun 05 15:38:06.278210 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:06.278163 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:38:06.282467 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:06.282430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfbdb664d-pbdml" event={"ID":"5bae691a-a63c-4cd8-b279-1b40731bf0db","Type":"ContainerStarted","Data":"a2b495974175c0bdeb903f5ef04a23937adf7237b3485981616550a11fe81ac5"} Jun 05 15:38:06.289605 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:06.289576 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-plk4m" Jun 05 15:38:06.292813 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:06.292733 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-plk4m" podStartSLOduration=1.4779896909999999 podStartE2EDuration="18.292678919s" totalImagesPullingTime="16.814689228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:38:06.291441808 +0000 UTC m=+224.210533916" watchObservedRunningTime="2026-06-05 15:38:06.292678919 +0000 UTC m=+224.211771026" Jun 05 15:38:07.290838 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:07.290723 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" exitCode=0 Jun 05 15:38:07.292134 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:07.292108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} Jun 05 15:38:08.317638 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:08.317138 2579 patch_prober.go:28] interesting pod/image-registry-6bfb5b4d94-9jf4v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:08.317638 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:08.317213 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:08.659316 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:08.659205 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:08.659898 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:08.659551 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:10.208268 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:10.208231 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:10.208725 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:10.208297 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:12.317534 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.317495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} Jun 05 15:38:12.318055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.317582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} Jun 05 15:38:12.319415 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.319384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfbdb664d-pbdml" event={"ID":"5bae691a-a63c-4cd8-b279-1b40731bf0db","Type":"ContainerStarted","Data":"551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b"} Jun 05 15:38:12.335134 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.335073 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dfbdb664d-pbdml" podStartSLOduration=4.687688564 podStartE2EDuration="10.335052055s" totalImagesPullingTime="5.647363491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:38:12.333233497 +0000 UTC m=+230.252325605" watchObservedRunningTime="2026-06-05 15:38:12.335052055 +0000 UTC m=+230.254144169" Jun 05 15:38:12.811702 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.811483 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:12.811972 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.811893 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:38:12.813225 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.813162 2579 patch_prober.go:28] interesting pod/console-5dfbdb664d-pbdml container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 15:38:12.813356 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:12.813229 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 15:38:13.341705 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:13.341653 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" containerName="registry" containerID="cri-o://728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0" gracePeriod=30 Jun 05 15:38:14.251267 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.251224 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:38:14.328700 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.328593 2579 generic.go:356] "Generic (PLEG): container finished" podID="c4239cbb-0504-4628-a711-d3a82c680b26" containerID="728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0" exitCode=0 Jun 05 15:38:14.328700 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.328650 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" Jun 05 15:38:14.328946 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.328700 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" event={"ID":"c4239cbb-0504-4628-a711-d3a82c680b26","Type":"ContainerDied","Data":"728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0"} Jun 05 15:38:14.328946 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.328744 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfb5b4d94-9jf4v" event={"ID":"c4239cbb-0504-4628-a711-d3a82c680b26","Type":"ContainerDied","Data":"338f50fd8c2b108103d1f01b529696e53e99891776af3e90f9b7ce7e281b2d62"} Jun 05 15:38:14.328946 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.328814 2579 scope.go:117] "RemoveContainer" containerID="728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0" Jun 05 15:38:14.408543 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408505 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-installation-pull-secrets\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408560 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408596 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-bound-sa-token\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408623 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pl5c\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-kube-api-access-8pl5c\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408698 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-image-registry-private-configuration\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408731 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-registry-certificates\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408794 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-trusted-ca\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.408831 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4239cbb-0504-4628-a711-d3a82c680b26-ca-trust-extracted\") pod \"c4239cbb-0504-4628-a711-d3a82c680b26\" (UID: \"c4239cbb-0504-4628-a711-d3a82c680b26\") " Jun 05 15:38:14.409426 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.409215 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:38:14.409426 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.409258 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:38:14.411730 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.411670 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:38:14.411730 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.411702 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:38:14.411993 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.411815 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:38:14.412724 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.412669 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-kube-api-access-8pl5c" (OuterVolumeSpecName: "kube-api-access-8pl5c") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "kube-api-access-8pl5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:38:14.412929 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.412726 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:38:14.421856 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.421814 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4239cbb-0504-4628-a711-d3a82c680b26-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c4239cbb-0504-4628-a711-d3a82c680b26" (UID: "c4239cbb-0504-4628-a711-d3a82c680b26"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:38:14.442189 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.442006 2579 scope.go:117] "RemoveContainer" containerID="728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0" Jun 05 15:38:14.442613 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:38:14.442577 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0\": container with ID starting with 728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0 not found: ID does not exist" containerID="728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0" Jun 05 15:38:14.442762 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.442616 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0"} err="failed to get container status \"728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0\": rpc error: code = NotFound desc = could not find container \"728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0\": container with ID starting with 728daffa933a8f418b1dcffaf282f949c98de4b21761e13fa028013f410c35a0 not found: ID does not exist" Jun 05 15:38:14.510117 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510090 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-trusted-ca\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510117 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510117 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c4239cbb-0504-4628-a711-d3a82c680b26-ca-trust-extracted\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510129 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-installation-pull-secrets\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510139 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-registry-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510149 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-bound-sa-token\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510157 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pl5c\" (UniqueName: \"kubernetes.io/projected/c4239cbb-0504-4628-a711-d3a82c680b26-kube-api-access-8pl5c\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510165 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c4239cbb-0504-4628-a711-d3a82c680b26-image-registry-private-configuration\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.510326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.510173 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c4239cbb-0504-4628-a711-d3a82c680b26-registry-certificates\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:38:14.649544 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.649502 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bfb5b4d94-9jf4v"] Jun 05 15:38:14.653285 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:14.653232 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bfb5b4d94-9jf4v"] Jun 05 15:38:15.336915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:15.336879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} Jun 05 15:38:15.337138 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:15.336942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} Jun 05 15:38:15.337138 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:15.336968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} Jun 05 15:38:15.337138 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:15.336992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerStarted","Data":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} Jun 05 15:38:15.361165 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:15.361111 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.114526198 podStartE2EDuration="13.36109402s" totalImagesPullingTime="8.220608505s" totalInitContainerRuntime="25.959317ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:38:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:38:15.359904904 +0000 UTC m=+233.278997013" watchObservedRunningTime="2026-06-05 15:38:15.36109402 +0000 UTC m=+233.280186128" Jun 05 15:38:16.540055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:16.540021 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" path="/var/lib/kubelet/pods/c4239cbb-0504-4628-a711-d3a82c680b26/volumes" Jun 05 15:38:17.979879 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:17.979837 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:38:18.658002 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:18.657966 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:18.658197 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:18.658041 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:20.205945 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:20.205911 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:20.206311 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:20.205961 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:21.945374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:21.945319 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" podUID="d2463b04-0463-4ef9-b3a5-89e8230ce9cb" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 05 15:38:22.363020 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:22.362984 2579 generic.go:356] "Generic (PLEG): container finished" podID="d2463b04-0463-4ef9-b3a5-89e8230ce9cb" containerID="91e0e39b1b472dcc5cae9a49e607f6655db3baf3464c3f5f5c0c627c1d1c0c29" exitCode=1 Jun 05 15:38:22.363317 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:22.363059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" event={"ID":"d2463b04-0463-4ef9-b3a5-89e8230ce9cb","Type":"ContainerDied","Data":"91e0e39b1b472dcc5cae9a49e607f6655db3baf3464c3f5f5c0c627c1d1c0c29"} Jun 05 15:38:22.363485 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:22.363469 2579 scope.go:117] "RemoveContainer" containerID="91e0e39b1b472dcc5cae9a49e607f6655db3baf3464c3f5f5c0c627c1d1c0c29" Jun 05 15:38:22.811795 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:22.811731 2579 patch_prober.go:28] interesting pod/console-5dfbdb664d-pbdml container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 15:38:22.811968 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:22.811816 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 15:38:23.368364 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:23.368331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" event={"ID":"d2463b04-0463-4ef9-b3a5-89e8230ce9cb","Type":"ContainerStarted","Data":"70b0ebc5d2c70b5b3a0225d9ea255c0ca11b7d738fa5e7e4fa935868a611b7e8"} Jun 05 15:38:23.368809 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:23.368592 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:38:23.369286 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:23.369270 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c97599b69-d8jsr" Jun 05 15:38:28.657055 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:28.657018 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:28.657583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:28.657079 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:28.657583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:28.657121 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:38:28.657673 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:28.657597 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"277bdfa888b36612fdcd2ebdfb95520427c19af0d9610957ed503913459cccf3"} pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 15:38:28.661452 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:28.661418 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:28.661596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:28.661467 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:32.811960 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:32.811916 2579 patch_prober.go:28] interesting pod/console-5dfbdb664d-pbdml container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 15:38:32.812374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:32.811969 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 15:38:33.378004 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:33.377967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:38:33.380410 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:33.380391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31ab34b-a195-4e7a-bccb-93cc46162468-metrics-certs\") pod \"network-metrics-daemon-w5gjm\" (UID: \"a31ab34b-a195-4e7a-bccb-93cc46162468\") " pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:38:33.438113 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:33.438077 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5wbl4\"" Jun 05 15:38:33.447435 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:33.447410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w5gjm" Jun 05 15:38:33.575858 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:33.575823 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w5gjm"] Jun 05 15:38:33.578721 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:38:33.578690 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31ab34b_a195_4e7a_bccb_93cc46162468.slice/crio-909367300d9309a3587f5712cd91ef2ed6e5aad23cdeaf600d40ad120c6cddd1 WatchSource:0}: Error finding container 909367300d9309a3587f5712cd91ef2ed6e5aad23cdeaf600d40ad120c6cddd1: Status 404 returned error can't find the container with id 909367300d9309a3587f5712cd91ef2ed6e5aad23cdeaf600d40ad120c6cddd1 Jun 05 15:38:34.408766 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:34.408728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5gjm" event={"ID":"a31ab34b-a195-4e7a-bccb-93cc46162468","Type":"ContainerStarted","Data":"909367300d9309a3587f5712cd91ef2ed6e5aad23cdeaf600d40ad120c6cddd1"} Jun 05 15:38:35.414230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:35.414198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5gjm" event={"ID":"a31ab34b-a195-4e7a-bccb-93cc46162468","Type":"ContainerStarted","Data":"1c50677e67d878271e5ef43ed2bcc0d1224bf092d161ef93e0eab5076710bfd9"} Jun 05 15:38:36.419595 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:36.419550 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w5gjm" event={"ID":"a31ab34b-a195-4e7a-bccb-93cc46162468","Type":"ContainerStarted","Data":"f5d9e5fe656a8756d8e2c379bb0adceb32542096525ac28b79813d336387b65e"} Jun 05 15:38:36.432175 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:36.432032 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w5gjm" podStartSLOduration=252.887091466 podStartE2EDuration="4m14.432015534s" totalImagesPullingTime="1.544924068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:38:36.43169367 +0000 UTC m=+254.350785777" watchObservedRunningTime="2026-06-05 15:38:36.432015534 +0000 UTC m=+254.351107636" Jun 05 15:38:38.662501 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:38.662468 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:38.662898 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:38.662527 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:42.812619 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:42.812521 2579 patch_prober.go:28] interesting pod/console-5dfbdb664d-pbdml container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 15:38:42.813076 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:42.812619 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 15:38:47.317816 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:47.317786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s9zw9_06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d/init-textfile/0.log" Jun 05 15:38:47.519594 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:47.519568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s9zw9_06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d/node-exporter/0.log" Jun 05 15:38:47.718855 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:47.718828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s9zw9_06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d/kube-rbac-proxy/0.log" Jun 05 15:38:48.519570 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:48.519540 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/init-config-reloader/0.log" Jun 05 15:38:48.662695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:48.662658 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:38:48.662863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:48.662716 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:38:48.719332 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:48.719304 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/prometheus/0.log" Jun 05 15:38:48.918656 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:48.918588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/config-reloader/0.log" Jun 05 15:38:49.121988 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:49.121951 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/thanos-sidecar/0.log" Jun 05 15:38:49.320468 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:49.320408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/kube-rbac-proxy-web/0.log" Jun 05 15:38:49.519335 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:49.519308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/kube-rbac-proxy/0.log" Jun 05 15:38:49.718192 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:49.718168 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf927565-788e-4a27-bee1-2e490bd63bd8/kube-rbac-proxy-thanos/0.log" Jun 05 15:38:50.318546 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:50.318478 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-9pnd2_959b5806-fab7-4e4c-927b-49c535d4b4d5/prometheus-operator-admission-webhook/0.log" Jun 05 15:38:52.518785 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:52.518736 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:38:52.720552 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:52.720527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/2.log" Jun 05 15:38:52.811804 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:52.811705 2579 patch_prober.go:28] interesting pod/console-5dfbdb664d-pbdml container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 15:38:52.811804 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:52.811786 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 15:38:52.918801 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:52.918775 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dfbdb664d-pbdml_5bae691a-a63c-4cd8-b279-1b40731bf0db/console/0.log" Jun 05 15:38:53.520810 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:53.520778 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-plk4m_43add59e-15f1-4cae-a663-26896aa9c6dc/download-server/0.log" Jun 05 15:38:53.677962 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:53.677923 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" containerID="cri-o://277bdfa888b36612fdcd2ebdfb95520427c19af0d9610957ed503913459cccf3" gracePeriod=30 Jun 05 15:38:55.118965 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.118868 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8tct_2b32239f-f857-49a6-a92d-e90b5d020a90/dns-node-resolver/0.log" Jun 05 15:38:55.494356 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.494325 2579 generic.go:356] "Generic (PLEG): container finished" podID="ef3ada5e-8af7-4d56-a76c-3639a4f3836c" containerID="bb2f2a01a3ccae8d5d21ac2dd9ff62b46b2c3bbbd0f8fd8fb320fc6e9ded8ff6" exitCode=0 Jun 05 15:38:55.494541 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.494396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" event={"ID":"ef3ada5e-8af7-4d56-a76c-3639a4f3836c","Type":"ContainerDied","Data":"bb2f2a01a3ccae8d5d21ac2dd9ff62b46b2c3bbbd0f8fd8fb320fc6e9ded8ff6"} Jun 05 15:38:55.494835 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.494817 2579 scope.go:117] "RemoveContainer" containerID="bb2f2a01a3ccae8d5d21ac2dd9ff62b46b2c3bbbd0f8fd8fb320fc6e9ded8ff6" Jun 05 15:38:55.496077 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.496032 2579 generic.go:356] "Generic (PLEG): container finished" podID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerID="277bdfa888b36612fdcd2ebdfb95520427c19af0d9610957ed503913459cccf3" exitCode=0 Jun 05 15:38:55.496136 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.496079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" event={"ID":"e76b199d-f15a-414e-8e91-77ad76ee03ed","Type":"ContainerDied","Data":"277bdfa888b36612fdcd2ebdfb95520427c19af0d9610957ed503913459cccf3"} Jun 05 15:38:55.496136 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.496119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" event={"ID":"e76b199d-f15a-414e-8e91-77ad76ee03ed","Type":"ContainerStarted","Data":"a19c85bb845c1eec9077071545514e4f55f58c4f438457aea675a9fabad902ee"} Jun 05 15:38:55.496299 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.496281 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:38:55.719421 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:55.719384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59cd596fcd-vdq2r_e76b199d-f15a-414e-8e91-77ad76ee03ed/registry/1.log" Jun 05 15:38:56.119048 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:56.119011 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-llg2l_4948a870-b955-4925-b7df-f7633aeafb1f/node-ca/0.log" Jun 05 15:38:56.504075 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:56.504044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-br29h" event={"ID":"ef3ada5e-8af7-4d56-a76c-3639a4f3836c","Type":"ContainerStarted","Data":"60a19bec58c4fdd4a1d308ab3e0ce2b72961442e99c0ce5beab19983ba6e764b"} Jun 05 15:38:56.519695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:56.519667 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-589d6fbc4f-q7srj_85847081-1304-405d-a9cf-4d0decc9cab3/router/0.log" Jun 05 15:38:56.718650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:38:56.718618 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cflnl_a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6/serve-healthcheck-canary/0.log" Jun 05 15:39:02.811950 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:02.811904 2579 patch_prober.go:28] interesting pod/console-5dfbdb664d-pbdml container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 15:39:02.812369 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:02.811965 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 15:39:02.979813 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:02.979779 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:02.996221 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:02.996194 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:03.034189 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:03.034148 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6dmmw" podUID="47d21d45-c80a-49d3-ac41-f886c4daffb0" Jun 05 15:39:03.535019 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:03.534991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dmmw" Jun 05 15:39:03.552965 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:03.552936 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:06.974332 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:06.974292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:39:06.976892 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:06.976867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47d21d45-c80a-49d3-ac41-f886c4daffb0-metrics-tls\") pod \"dns-default-6dmmw\" (UID: \"47d21d45-c80a-49d3-ac41-f886c4daffb0\") " pod="openshift-dns/dns-default-6dmmw" Jun 05 15:39:07.138405 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:07.138368 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dm5g6\"" Jun 05 15:39:07.146734 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:07.146709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dmmw" Jun 05 15:39:07.295730 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:07.295687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6dmmw"] Jun 05 15:39:07.300329 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:39:07.300301 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d21d45_c80a_49d3_ac41_f886c4daffb0.slice/crio-da6c0d9452be5484d2187592088506774faba7482f64452acaf3853445ed9f85 WatchSource:0}: Error finding container da6c0d9452be5484d2187592088506774faba7482f64452acaf3853445ed9f85: Status 404 returned error can't find the container with id da6c0d9452be5484d2187592088506774faba7482f64452acaf3853445ed9f85 Jun 05 15:39:07.549971 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:07.549882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dmmw" event={"ID":"47d21d45-c80a-49d3-ac41-f886c4daffb0","Type":"ContainerStarted","Data":"da6c0d9452be5484d2187592088506774faba7482f64452acaf3853445ed9f85"} Jun 05 15:39:08.659720 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:08.659665 2579 patch_prober.go:28] interesting pod/image-registry-59cd596fcd-vdq2r container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 15:39:08.660207 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:08.659795 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" podUID="e76b199d-f15a-414e-8e91-77ad76ee03ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 15:39:09.559328 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:09.559291 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dmmw" event={"ID":"47d21d45-c80a-49d3-ac41-f886c4daffb0","Type":"ContainerStarted","Data":"2891f4f0a8cd17a1769b9f9dd04122f125d54aca93af69d847bc48c4baf88880"} Jun 05 15:39:09.559500 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:09.559343 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dmmw" event={"ID":"47d21d45-c80a-49d3-ac41-f886c4daffb0","Type":"ContainerStarted","Data":"c448f92170bdcd84864a773bd8c560fc2f11e5d04222f723b124eda47dbc0138"} Jun 05 15:39:09.559500 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:09.559448 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6dmmw" Jun 05 15:39:09.575289 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:09.575235 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6dmmw" podStartSLOduration=252.14345066 podStartE2EDuration="4m13.575218827s" totalImagesPullingTime="1.431768167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:39:09.574304753 +0000 UTC m=+287.493396862" watchObservedRunningTime="2026-06-05 15:39:09.575218827 +0000 UTC m=+287.494310990" Jun 05 15:39:12.816320 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:12.816288 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:39:12.820279 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:12.820244 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:39:16.508474 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:16.508444 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59cd596fcd-vdq2r" Jun 05 15:39:19.565038 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:19.565002 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6dmmw" Jun 05 15:39:20.977528 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.977487 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:39:20.978056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.977848 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="prometheus" containerID="cri-o://84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" gracePeriod=600 Jun 05 15:39:20.978056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.977867 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy" containerID="cri-o://1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" gracePeriod=600 Jun 05 15:39:20.978056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.977913 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="thanos-sidecar" containerID="cri-o://252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" gracePeriod=600 Jun 05 15:39:20.978056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.977941 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-web" containerID="cri-o://1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" gracePeriod=600 Jun 05 15:39:20.978056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.978012 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="config-reloader" containerID="cri-o://72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" gracePeriod=600 Jun 05 15:39:20.978056 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:20.977957 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" gracePeriod=600 Jun 05 15:39:21.213761 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.213720 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.296122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296035 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-serving-certs-ca-bundle\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296078 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xc7m\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-kube-api-access-5xc7m\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296098 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-web-config\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296394 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296117 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-metrics-client-ca\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296394 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296247 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296394 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296296 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-tls-assets\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296394 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296333 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-2\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296400 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-1\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296431 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-kube-rbac-proxy\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296458 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-db\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296471 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296503 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-config-out\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296546 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-0\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296569 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-tls\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.296601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296591 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-trusted-ca-bundle\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296621 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-config\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296654 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-thanos-prometheus-http-client-file\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296680 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-grpc-tls\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296711 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296737 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-metrics-client-certs\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296770 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.296803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-kubelet-serving-ca-bundle\") pod \"bf927565-788e-4a27-bee1-2e490bd63bd8\" (UID: \"bf927565-788e-4a27-bee1-2e490bd63bd8\") " Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.297055 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.297183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.297074 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.297612 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.297341 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.297612 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.297434 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.297713 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.297658 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.299106 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.299040 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:39:21.300212 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300166 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.300335 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300286 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:21.300403 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300350 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.300574 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300530 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-kube-api-access-5xc7m" (OuterVolumeSpecName: "kube-api-access-5xc7m") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "kube-api-access-5xc7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:39:21.300740 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300716 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.300841 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300609 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.300922 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.300902 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:39:21.301080 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.301050 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-config-out" (OuterVolumeSpecName: "config-out") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:39:21.301420 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.301399 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-config" (OuterVolumeSpecName: "config") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.301580 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.301554 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.301774 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.301730 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.302094 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.302074 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.302871 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.302845 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.310972 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.310948 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-web-config" (OuterVolumeSpecName: "web-config") pod "bf927565-788e-4a27-bee1-2e490bd63bd8" (UID: "bf927565-788e-4a27-bee1-2e490bd63bd8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:21.397628 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397583 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-kube-rbac-proxy\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397628 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397620 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-db\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397628 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397634 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf927565-788e-4a27-bee1-2e490bd63bd8-config-out\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397645 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397657 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397670 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397684 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397695 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397706 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-grpc-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397719 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397730 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-metrics-client-certs\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397741 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397781 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xc7m\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-kube-api-access-5xc7m\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397793 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-web-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397804 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-configmap-metrics-client-ca\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397817 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf927565-788e-4a27-bee1-2e490bd63bd8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397828 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf927565-788e-4a27-bee1-2e490bd63bd8-tls-assets\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.397926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.397840 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf927565-788e-4a27-bee1-2e490bd63bd8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:21.609695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609605 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" exitCode=0 Jun 05 15:39:21.609695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609632 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" exitCode=0 Jun 05 15:39:21.609695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609640 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" exitCode=0 Jun 05 15:39:21.609695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609646 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" exitCode=0 Jun 05 15:39:21.609695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609651 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" exitCode=0 Jun 05 15:39:21.609695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609656 2579 generic.go:356] "Generic (PLEG): container finished" podID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" exitCode=0 Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609705 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609799 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609869 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.609971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} Jun 05 15:39:21.610140 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.610013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf927565-788e-4a27-bee1-2e490bd63bd8","Type":"ContainerDied","Data":"1544b1aea93c626ab612e624f5ea00a566b511f0aefc115331e792d516318b7c"} Jun 05 15:39:21.619311 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.619292 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.626385 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.626363 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.632480 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.632457 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:39:21.634034 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.634020 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.636842 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.636686 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:39:21.641607 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.641584 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.648482 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.648463 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.655989 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.655973 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.661247 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661223 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:39:21.661530 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661514 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="thanos-sidecar" Jun 05 15:39:21.661602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661533 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="thanos-sidecar" Jun 05 15:39:21.661602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661549 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-web" Jun 05 15:39:21.661602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661558 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-web" Jun 05 15:39:21.661602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661571 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy" Jun 05 15:39:21.661602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661580 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy" Jun 05 15:39:21.661602 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661595 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="config-reloader" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661605 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="config-reloader" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661619 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" containerName="registry" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661627 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" containerName="registry" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661639 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="prometheus" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661647 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="prometheus" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661657 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="init-config-reloader" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661664 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="init-config-reloader" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661675 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-thanos" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661691 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-thanos" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661817 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="prometheus" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661831 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4239cbb-0504-4628-a711-d3a82c680b26" containerName="registry" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661841 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="thanos-sidecar" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661850 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-web" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661860 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy-thanos" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661869 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="config-reloader" Jun 05 15:39:21.661926 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.661879 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" containerName="kube-rbac-proxy" Jun 05 15:39:21.663792 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.663763 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.664400 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.664370 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.664500 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.664410 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} err="failed to get container status \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" Jun 05 15:39:21.664500 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.664437 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.665372 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.664933 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.665372 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.664973 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} err="failed to get container status \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" Jun 05 15:39:21.665372 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.664995 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.665572 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.665477 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.665572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.665513 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} err="failed to get container status \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" Jun 05 15:39:21.665572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.665534 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.666013 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.665983 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.666101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.666018 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} err="failed to get container status \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" Jun 05 15:39:21.666101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.666038 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.666492 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.666473 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.666574 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.666505 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} err="failed to get container status \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" Jun 05 15:39:21.666574 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.666525 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.667006 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.666967 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.667078 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667006 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} err="failed to get container status \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" Jun 05 15:39:21.667078 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667028 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.667849 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:21.667484 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.667849 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667519 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} err="failed to get container status \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" Jun 05 15:39:21.667849 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667541 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.667849 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.668047 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667857 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} err="failed to get container status \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" Jun 05 15:39:21.668047 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.667881 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.669093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.668204 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} err="failed to get container status \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" Jun 05 15:39:21.669093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.668229 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.669093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.668501 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} err="failed to get container status \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" Jun 05 15:39:21.669093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.668522 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.669093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.668825 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} err="failed to get container status \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" Jun 05 15:39:21.669093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.668850 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.669448 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.669301 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} err="failed to get container status \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" Jun 05 15:39:21.669448 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.669368 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.669838 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} err="failed to get container status \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.669901 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670183 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670192 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670219 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670364 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} err="failed to get container status \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670388 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 15:39:21.670599 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7ksf6\"" Jun 05 15:39:21.671244 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670708 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} err="failed to get container status \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" Jun 05 15:39:21.671244 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670731 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.671244 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 15:39:21.671244 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 15:39:21.671244 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.670932 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 15:39:21.671244 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 15:39:21.671550 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671285 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} err="failed to get container status \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" Jun 05 15:39:21.671550 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671350 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.671550 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671450 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 15:39:21.671550 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1bdbj2gkofvhj\"" Jun 05 15:39:21.671893 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671608 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 15:39:21.671893 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.671616 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 15:39:21.672047 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.672032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 15:39:21.672255 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.672225 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} err="failed to get container status \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" Jun 05 15:39:21.672255 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.672256 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.673622 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.673593 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} err="failed to get container status \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" Jun 05 15:39:21.673733 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.673625 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.673936 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.673911 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} err="failed to get container status \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" Jun 05 15:39:21.674018 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.673939 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.674352 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674227 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} err="failed to get container status \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" Jun 05 15:39:21.674352 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674253 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.674501 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674482 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 15:39:21.674562 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674520 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} err="failed to get container status \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" Jun 05 15:39:21.674562 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674541 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.674827 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674806 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} err="failed to get container status \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" Jun 05 15:39:21.674913 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.674828 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.675106 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675084 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} err="failed to get container status \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" Jun 05 15:39:21.675172 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675109 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.675355 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675320 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} err="failed to get container status \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" Jun 05 15:39:21.675432 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675357 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.675676 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675641 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} err="failed to get container status \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" Jun 05 15:39:21.675776 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675677 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.675955 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675936 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} err="failed to get container status \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" Jun 05 15:39:21.676044 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.675957 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.676095 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676066 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 15:39:21.676201 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676178 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} err="failed to get container status \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" Jun 05 15:39:21.676251 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676204 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.676471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676449 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} err="failed to get container status \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" Jun 05 15:39:21.676551 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676471 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.676682 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676658 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} err="failed to get container status \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" Jun 05 15:39:21.676726 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676684 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.677079 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676902 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} err="failed to get container status \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" Jun 05 15:39:21.677079 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.676927 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.677427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.677406 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} err="failed to get container status \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" Jun 05 15:39:21.677427 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.677427 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.677684 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.677661 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} err="failed to get container status \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" Jun 05 15:39:21.677732 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.677686 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.677949 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.677916 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} err="failed to get container status \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" Jun 05 15:39:21.677949 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.677948 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.678189 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678167 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} err="failed to get container status \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" Jun 05 15:39:21.678239 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678190 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.678417 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678400 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} err="failed to get container status \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" Jun 05 15:39:21.678466 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678417 2579 scope.go:117] "RemoveContainer" containerID="df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31" Jun 05 15:39:21.678654 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678637 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31"} err="failed to get container status \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": rpc error: code = NotFound desc = could not find container \"df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31\": container with ID starting with df7ed2973f3978ed667c5b04e47aa6deb45222e90026d312ab837b7165810a31 not found: ID does not exist" Jun 05 15:39:21.678695 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678656 2579 scope.go:117] "RemoveContainer" containerID="1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085" Jun 05 15:39:21.678922 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678896 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085"} err="failed to get container status \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": rpc error: code = NotFound desc = could not find container \"1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085\": container with ID starting with 1728559fcfda6f75bc0103735c46919453239a6b5df6bc5ea93aeb2a3c00d085 not found: ID does not exist" Jun 05 15:39:21.678975 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.678927 2579 scope.go:117] "RemoveContainer" containerID="1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e" Jun 05 15:39:21.679182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.679158 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e"} err="failed to get container status \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": rpc error: code = NotFound desc = could not find container \"1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e\": container with ID starting with 1e8b08d735501e60c3008fadaeb8a01ddf68c9df7f18bde079b11f5bd981882e not found: ID does not exist" Jun 05 15:39:21.679182 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.679180 2579 scope.go:117] "RemoveContainer" containerID="252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e" Jun 05 15:39:21.679447 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.679427 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e"} err="failed to get container status \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": rpc error: code = NotFound desc = could not find container \"252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e\": container with ID starting with 252f74d86e4b71d52b3c33f9efc1a6c00df3d9ca6468399c59d46946d049fa8e not found: ID does not exist" Jun 05 15:39:21.679447 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.679447 2579 scope.go:117] "RemoveContainer" containerID="72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c" Jun 05 15:39:21.679681 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.679649 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c"} err="failed to get container status \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": rpc error: code = NotFound desc = could not find container \"72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c\": container with ID starting with 72e2bdccb64a4704f97d94703183a33d2f2e53eec9cd06a5031ab92d8b25f55c not found: ID does not exist" Jun 05 15:39:21.679681 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.679681 2579 scope.go:117] "RemoveContainer" containerID="84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f" Jun 05 15:39:21.680563 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.680538 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f"} err="failed to get container status \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": rpc error: code = NotFound desc = could not find container \"84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f\": container with ID starting with 84c76d53a1ae293625fb969c843a15f980e0d84ca020834e6143da5910c9a86f not found: ID does not exist" Jun 05 15:39:21.680635 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.680565 2579 scope.go:117] "RemoveContainer" containerID="6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3" Jun 05 15:39:21.680861 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.680832 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3"} err="failed to get container status \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": rpc error: code = NotFound desc = could not find container \"6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3\": container with ID starting with 6c63a60819705a867f5bef9c06355aafecc88297c0ed87cb78a5c2273b3cabc3 not found: ID does not exist" Jun 05 15:39:21.681669 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.681650 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:39:21.800827 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.800827 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b56df72-e22e-4831-b6ff-d7d6b131faf5-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.800996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-config\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b56df72-e22e-4831-b6ff-d7d6b131faf5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hlgt\" (UniqueName: \"kubernetes.io/projected/7b56df72-e22e-4831-b6ff-d7d6b131faf5-kube-api-access-4hlgt\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.801351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.801344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902122 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b56df72-e22e-4831-b6ff-d7d6b131faf5-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902404 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902404 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902404 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902404 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902404 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-config\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b56df72-e22e-4831-b6ff-d7d6b131faf5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.902650 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hlgt\" (UniqueName: \"kubernetes.io/projected/7b56df72-e22e-4831-b6ff-d7d6b131faf5-kube-api-access-4hlgt\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902902 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.902931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903527 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.903275 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.903527 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.903369 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.905432 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.905165 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.905571 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.905438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.906553 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.906530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.907205 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.907107 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b56df72-e22e-4831-b6ff-d7d6b131faf5-config-out\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.907455 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.907358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.907666 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.907524 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-web-config\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.907666 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.907523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.907666 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.907573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.907999 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.907977 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.908126 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.908104 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b56df72-e22e-4831-b6ff-d7d6b131faf5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.908211 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.908197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.908507 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.908491 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.908611 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.908518 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7b56df72-e22e-4831-b6ff-d7d6b131faf5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.909827 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.909806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7b56df72-e22e-4831-b6ff-d7d6b131faf5-config\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.910814 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.910795 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hlgt\" (UniqueName: \"kubernetes.io/projected/7b56df72-e22e-4831-b6ff-d7d6b131faf5-kube-api-access-4hlgt\") pod \"prometheus-k8s-0\" (UID: \"7b56df72-e22e-4831-b6ff-d7d6b131faf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:21.980075 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:21.980035 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:22.144038 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.144003 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 15:39:22.147205 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:39:22.147176 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b56df72_e22e_4831_b6ff_d7d6b131faf5.slice/crio-fc387e6519e466fa5c18bf58266b4adcba94fbccedb35cabe4e8f9cbd2ba1ed0 WatchSource:0}: Error finding container fc387e6519e466fa5c18bf58266b4adcba94fbccedb35cabe4e8f9cbd2ba1ed0: Status 404 returned error can't find the container with id fc387e6519e466fa5c18bf58266b4adcba94fbccedb35cabe4e8f9cbd2ba1ed0 Jun 05 15:39:22.472880 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.472855 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:39:22.475654 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.475631 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:39:22.477364 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.477346 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:39:22.480005 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.479983 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:39:22.484867 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.484850 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 15:39:22.542886 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.542525 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf927565-788e-4a27-bee1-2e490bd63bd8" path="/var/lib/kubelet/pods/bf927565-788e-4a27-bee1-2e490bd63bd8/volumes" Jun 05 15:39:22.614328 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.614293 2579 generic.go:356] "Generic (PLEG): container finished" podID="7b56df72-e22e-4831-b6ff-d7d6b131faf5" containerID="93cb5701ba5346be9c859ddee7c3c72d475a620fdf475a1edcc0bb421a4d74a4" exitCode=0 Jun 05 15:39:22.614460 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.614353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerDied","Data":"93cb5701ba5346be9c859ddee7c3c72d475a620fdf475a1edcc0bb421a4d74a4"} Jun 05 15:39:22.614460 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:22.614417 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"fc387e6519e466fa5c18bf58266b4adcba94fbccedb35cabe4e8f9cbd2ba1ed0"} Jun 05 15:39:23.621931 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.621906 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:39:23.622365 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622339 2579 generic.go:356] "Generic (PLEG): container finished" podID="7b56df72-e22e-4831-b6ff-d7d6b131faf5" containerID="1ad958b4371024ecdea4f81d25eee866aba4e1d643c856903f67ea06932719d8" exitCode=2 Jun 05 15:39:23.622497 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622374 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"7493d27c264c4aa7838eaaf1eee51f4437e7d6fff7627a4545eb1de6be5280a0"} Jun 05 15:39:23.622564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"4dc4bb1ceb830cad2eccb04f23b88a58de3360a06d2b58e81cc0746b4351c58b"} Jun 05 15:39:23.622564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"ecbf545aeb7318800dd58b1bdfe526b1428367863c282d86b127ef8d140244b6"} Jun 05 15:39:23.622564 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"e22cf1984c842b7fc95fb8a41c2d5807bb5136d49fa9a101b9ca2a97111b54a2"} Jun 05 15:39:23.622698 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"86373544235cd0bba5a77e04ea297d4bfe29b6873f1bdb4b82956eebdf1937ab"} Jun 05 15:39:23.622698 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622612 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerDied","Data":"1ad958b4371024ecdea4f81d25eee866aba4e1d643c856903f67ea06932719d8"} Jun 05 15:39:23.622966 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:23.622952 2579 scope.go:117] "RemoveContainer" containerID="1ad958b4371024ecdea4f81d25eee866aba4e1d643c856903f67ea06932719d8" Jun 05 15:39:24.292280 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:24.289044 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfbdb664d-pbdml"] Jun 05 15:39:24.629978 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:24.629899 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:39:24.630371 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:24.630305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7b56df72-e22e-4831-b6ff-d7d6b131faf5","Type":"ContainerStarted","Data":"017ec1ce34a653dd0e13344bfa986f55691ea6a4867e3bdf9f7db03416825018"} Jun 05 15:39:24.657374 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:24.657322 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.639438877 podStartE2EDuration="3.657302505s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.863628ms" isStatefulPod=false podCreationTimestamp="2026-06-05 15:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:39:24.656420218 +0000 UTC m=+302.575512339" watchObservedRunningTime="2026-06-05 15:39:24.657302505 +0000 UTC m=+302.576394615" Jun 05 15:39:26.980388 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:26.980349 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:39:49.313133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.313061 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5dfbdb664d-pbdml" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" containerID="cri-o://551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b" gracePeriod=15 Jun 05 15:39:49.566644 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.566582 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:39:49.643610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643571 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-trusted-ca-bundle\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.643610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643607 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-service-ca\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.643864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643624 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-config\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.643864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643651 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx28x\" (UniqueName: \"kubernetes.io/projected/5bae691a-a63c-4cd8-b279-1b40731bf0db-kube-api-access-tx28x\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.643864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643709 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-oauth-serving-cert\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.643864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643738 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-oauth-config\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.643864 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.643795 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-serving-cert\") pod \"5bae691a-a63c-4cd8-b279-1b40731bf0db\" (UID: \"5bae691a-a63c-4cd8-b279-1b40731bf0db\") " Jun 05 15:39:49.644101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.644022 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-config" (OuterVolumeSpecName: "console-config") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:49.644101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.644032 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:49.644101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.644065 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-service-ca" (OuterVolumeSpecName: "service-ca") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:49.644378 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.644348 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:39:49.646264 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.646231 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bae691a-a63c-4cd8-b279-1b40731bf0db-kube-api-access-tx28x" (OuterVolumeSpecName: "kube-api-access-tx28x") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "kube-api-access-tx28x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:39:49.646350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.646255 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:49.646350 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.646271 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5bae691a-a63c-4cd8-b279-1b40731bf0db" (UID: "5bae691a-a63c-4cd8-b279-1b40731bf0db"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 15:39:49.728231 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.728191 2579 generic.go:356] "Generic (PLEG): container finished" podID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerID="551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b" exitCode=0 Jun 05 15:39:49.728400 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.728243 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfbdb664d-pbdml" Jun 05 15:39:49.728400 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.728273 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfbdb664d-pbdml" event={"ID":"5bae691a-a63c-4cd8-b279-1b40731bf0db","Type":"ContainerDied","Data":"551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b"} Jun 05 15:39:49.728400 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.728331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfbdb664d-pbdml" event={"ID":"5bae691a-a63c-4cd8-b279-1b40731bf0db","Type":"ContainerDied","Data":"a2b495974175c0bdeb903f5ef04a23937adf7237b3485981616550a11fe81ac5"} Jun 05 15:39:49.728400 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.728353 2579 scope.go:117] "RemoveContainer" containerID="551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b" Jun 05 15:39:49.737101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.737083 2579 scope.go:117] "RemoveContainer" containerID="551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b" Jun 05 15:39:49.737367 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:39:49.737350 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b\": container with ID starting with 551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b not found: ID does not exist" containerID="551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b" Jun 05 15:39:49.737405 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.737376 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b"} err="failed to get container status \"551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b\": rpc error: code = NotFound desc = could not find container \"551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b\": container with ID starting with 551780cba09eebcb677b977a9f522c85f52eef073e50abbfdb22d414ea9c594b not found: ID does not exist" Jun 05 15:39:49.745043 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745010 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-trusted-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.745043 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745038 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-service-ca\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.745298 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745052 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.745298 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745063 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx28x\" (UniqueName: \"kubernetes.io/projected/5bae691a-a63c-4cd8-b279-1b40731bf0db-kube-api-access-tx28x\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.745298 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745075 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bae691a-a63c-4cd8-b279-1b40731bf0db-oauth-serving-cert\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.745298 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745086 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-oauth-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.745298 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.745098 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bae691a-a63c-4cd8-b279-1b40731bf0db-console-serving-cert\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:39:49.747053 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.747030 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfbdb664d-pbdml"] Jun 05 15:39:49.750157 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:49.750135 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfbdb664d-pbdml"] Jun 05 15:39:50.540313 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:39:50.540277 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" path="/var/lib/kubelet/pods/5bae691a-a63c-4cd8-b279-1b40731bf0db/volumes" Jun 05 15:40:21.981022 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:40:21.980937 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:40:21.997207 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:40:21.997178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:40:22.863674 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:40:22.863590 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 15:41:45.194039 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.193948 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx"] Jun 05 15:41:45.194610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.194359 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" Jun 05 15:41:45.194610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.194377 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" Jun 05 15:41:45.194610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.194466 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bae691a-a63c-4cd8-b279-1b40731bf0db" containerName="console" Jun 05 15:41:45.197380 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.197357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.199257 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.199234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 15:41:45.199649 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.199627 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 15:41:45.199785 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.199743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 15:41:45.199901 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.199765 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 15:41:45.199901 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.199800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 15:41:45.199901 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.199861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8hbth\"" Jun 05 15:41:45.206569 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.206544 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx"] Jun 05 15:41:45.365969 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.365931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a48bbaa1-a6d9-4913-8320-9f911eba8ead-manager-config\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.365969 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.365976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a48bbaa1-a6d9-4913-8320-9f911eba8ead-cert\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.366189 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.366043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a48bbaa1-a6d9-4913-8320-9f911eba8ead-metrics-cert\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.366189 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.366069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8pbm\" (UniqueName: \"kubernetes.io/projected/a48bbaa1-a6d9-4913-8320-9f911eba8ead-kube-api-access-d8pbm\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.466674 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.466629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8pbm\" (UniqueName: \"kubernetes.io/projected/a48bbaa1-a6d9-4913-8320-9f911eba8ead-kube-api-access-d8pbm\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.466887 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.466679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a48bbaa1-a6d9-4913-8320-9f911eba8ead-manager-config\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.466887 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.466708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a48bbaa1-a6d9-4913-8320-9f911eba8ead-cert\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.466887 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.466785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a48bbaa1-a6d9-4913-8320-9f911eba8ead-metrics-cert\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.467405 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.467382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a48bbaa1-a6d9-4913-8320-9f911eba8ead-manager-config\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.469399 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.469374 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a48bbaa1-a6d9-4913-8320-9f911eba8ead-cert\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.469488 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.469400 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a48bbaa1-a6d9-4913-8320-9f911eba8ead-metrics-cert\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.474862 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.474834 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8pbm\" (UniqueName: \"kubernetes.io/projected/a48bbaa1-a6d9-4913-8320-9f911eba8ead-kube-api-access-d8pbm\") pod \"lws-controller-manager-cf49c9d64-dzscx\" (UID: \"a48bbaa1-a6d9-4913-8320-9f911eba8ead\") " pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.506839 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.506799 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:45.639469 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.639432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx"] Jun 05 15:41:45.642839 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:41:45.642814 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48bbaa1_a6d9_4913_8320_9f911eba8ead.slice/crio-3a52f447b06c0181f9b86e9c21f2feb096a991280f681c12b769a0054c038f10 WatchSource:0}: Error finding container 3a52f447b06c0181f9b86e9c21f2feb096a991280f681c12b769a0054c038f10: Status 404 returned error can't find the container with id 3a52f447b06c0181f9b86e9c21f2feb096a991280f681c12b769a0054c038f10 Jun 05 15:41:45.644924 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:45.644907 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:41:46.156281 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:46.156243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" event={"ID":"a48bbaa1-a6d9-4913-8320-9f911eba8ead","Type":"ContainerStarted","Data":"3a52f447b06c0181f9b86e9c21f2feb096a991280f681c12b769a0054c038f10"} Jun 05 15:41:48.165459 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:48.165420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" event={"ID":"a48bbaa1-a6d9-4913-8320-9f911eba8ead","Type":"ContainerStarted","Data":"a1fdae66bb089f96b07f8c462341ef8d2232f14434c43ff230ed22c6c68256af"} Jun 05 15:41:48.165919 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:48.165567 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:41:48.178964 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:48.178899 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" podStartSLOduration=0.817930283 podStartE2EDuration="3.178881637s" totalImagesPullingTime="2.360951354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:48.177914367 +0000 UTC m=+446.097006474" watchObservedRunningTime="2026-06-05 15:41:48.178881637 +0000 UTC m=+446.097973746" Jun 05 15:41:51.937236 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.937203 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n"] Jun 05 15:41:51.940639 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.940618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:51.944341 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.944318 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 15:41:51.944506 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.944492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 15:41:51.944575 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.944551 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 15:41:51.944705 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.944686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7mlzd\"" Jun 05 15:41:51.945133 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.945119 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 15:41:51.960769 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:51.960721 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n"] Jun 05 15:41:52.126968 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.126928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc100dce-1b78-4137-adfe-0a8970bea4d7-manifests\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.126968 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.126965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc100dce-1b78-4137-adfe-0a8970bea4d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.127176 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.126987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc100dce-1b78-4137-adfe-0a8970bea4d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.127176 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.127070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqd58\" (UniqueName: \"kubernetes.io/projected/cc100dce-1b78-4137-adfe-0a8970bea4d7-kube-api-access-fqd58\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.127176 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.127131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc100dce-1b78-4137-adfe-0a8970bea4d7-tmp\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.228608 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.228571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqd58\" (UniqueName: \"kubernetes.io/projected/cc100dce-1b78-4137-adfe-0a8970bea4d7-kube-api-access-fqd58\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.228819 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.228621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc100dce-1b78-4137-adfe-0a8970bea4d7-tmp\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.228819 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.228678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc100dce-1b78-4137-adfe-0a8970bea4d7-manifests\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.228819 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.228696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc100dce-1b78-4137-adfe-0a8970bea4d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.228819 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.228714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc100dce-1b78-4137-adfe-0a8970bea4d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.229109 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.229088 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc100dce-1b78-4137-adfe-0a8970bea4d7-manifests\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.231008 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.230984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc100dce-1b78-4137-adfe-0a8970bea4d7-tmp\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.231334 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.231313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc100dce-1b78-4137-adfe-0a8970bea4d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.231458 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.231438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc100dce-1b78-4137-adfe-0a8970bea4d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.239798 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.239778 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqd58\" (UniqueName: \"kubernetes.io/projected/cc100dce-1b78-4137-adfe-0a8970bea4d7-kube-api-access-fqd58\") pod \"opendatahub-operator-controller-manager-56cbf6b767-9gt5n\" (UID: \"cc100dce-1b78-4137-adfe-0a8970bea4d7\") " pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.250601 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.250579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:52.395725 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:52.395611 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n"] Jun 05 15:41:52.398551 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:41:52.398523 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc100dce_1b78_4137_adfe_0a8970bea4d7.slice/crio-cf697d8d8cb2de790d7e1f7a1eabdc0e0b3896e9d555798171f8e30f9f470881 WatchSource:0}: Error finding container cf697d8d8cb2de790d7e1f7a1eabdc0e0b3896e9d555798171f8e30f9f470881: Status 404 returned error can't find the container with id cf697d8d8cb2de790d7e1f7a1eabdc0e0b3896e9d555798171f8e30f9f470881 Jun 05 15:41:53.186692 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:53.186637 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" event={"ID":"cc100dce-1b78-4137-adfe-0a8970bea4d7","Type":"ContainerStarted","Data":"cf697d8d8cb2de790d7e1f7a1eabdc0e0b3896e9d555798171f8e30f9f470881"} Jun 05 15:41:56.202466 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:56.202432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" event={"ID":"cc100dce-1b78-4137-adfe-0a8970bea4d7","Type":"ContainerStarted","Data":"2941283327cc30a3d508697842ef629c7036c79d59b58246e44a081624e0dedd"} Jun 05 15:41:57.208117 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:57.208077 2579 generic.go:356] "Generic (PLEG): container finished" podID="cc100dce-1b78-4137-adfe-0a8970bea4d7" containerID="2941283327cc30a3d508697842ef629c7036c79d59b58246e44a081624e0dedd" exitCode=0 Jun 05 15:41:57.208520 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:57.208121 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" event={"ID":"cc100dce-1b78-4137-adfe-0a8970bea4d7","Type":"ContainerDied","Data":"2941283327cc30a3d508697842ef629c7036c79d59b58246e44a081624e0dedd"} Jun 05 15:41:58.213594 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:58.213556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" event={"ID":"cc100dce-1b78-4137-adfe-0a8970bea4d7","Type":"ContainerStarted","Data":"758a9f90fba4463af2bf22170168349f1d3658fb96dd6b93683df1e456860aa1"} Jun 05 15:41:58.213970 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:58.213668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:41:58.232161 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:58.232108 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" podStartSLOduration=3.027209593 podStartE2EDuration="7.232093373s" totalImagesPullingTime="3.16521941s" totalInitContainerRuntime="1.03966437s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:41:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:41:58.231165494 +0000 UTC m=+456.150257636" watchObservedRunningTime="2026-06-05 15:41:58.232093373 +0000 UTC m=+456.151185480" Jun 05 15:41:59.171436 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:41:59.171400 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cf49c9d64-dzscx" Jun 05 15:42:09.220390 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:09.220358 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56cbf6b767-9gt5n" Jun 05 15:42:38.426587 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.426546 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-594c4dc786-n78cq"] Jun 05 15:42:38.431342 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.431316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.433053 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.433034 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 15:42:38.433193 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.433080 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x56g8\"" Jun 05 15:42:38.437786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.437706 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-594c4dc786-n78cq"] Jun 05 15:42:38.527373 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.527331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcxw7\" (UniqueName: \"kubernetes.io/projected/70189bcd-7c60-4e55-a7ff-343d8e459ba3-kube-api-access-kcxw7\") pod \"dashboard-redirect-594c4dc786-n78cq\" (UID: \"70189bcd-7c60-4e55-a7ff-343d8e459ba3\") " pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.527373 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.527382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/70189bcd-7c60-4e55-a7ff-343d8e459ba3-redirect-config\") pod \"dashboard-redirect-594c4dc786-n78cq\" (UID: \"70189bcd-7c60-4e55-a7ff-343d8e459ba3\") " pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.628351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.628318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcxw7\" (UniqueName: \"kubernetes.io/projected/70189bcd-7c60-4e55-a7ff-343d8e459ba3-kube-api-access-kcxw7\") pod \"dashboard-redirect-594c4dc786-n78cq\" (UID: \"70189bcd-7c60-4e55-a7ff-343d8e459ba3\") " pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.628522 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.628377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/70189bcd-7c60-4e55-a7ff-343d8e459ba3-redirect-config\") pod \"dashboard-redirect-594c4dc786-n78cq\" (UID: \"70189bcd-7c60-4e55-a7ff-343d8e459ba3\") " pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.629191 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.629173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/70189bcd-7c60-4e55-a7ff-343d8e459ba3-redirect-config\") pod \"dashboard-redirect-594c4dc786-n78cq\" (UID: \"70189bcd-7c60-4e55-a7ff-343d8e459ba3\") " pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.635513 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.635482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcxw7\" (UniqueName: \"kubernetes.io/projected/70189bcd-7c60-4e55-a7ff-343d8e459ba3-kube-api-access-kcxw7\") pod \"dashboard-redirect-594c4dc786-n78cq\" (UID: \"70189bcd-7c60-4e55-a7ff-343d8e459ba3\") " pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.743183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.743146 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" Jun 05 15:42:38.877680 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:38.877648 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-594c4dc786-n78cq"] Jun 05 15:42:38.881148 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:42:38.881113 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70189bcd_7c60_4e55_a7ff_343d8e459ba3.slice/crio-8087588e4c05f574d9515d19c229d207878fbc2ab28ac5a749dfce1f244dac82 WatchSource:0}: Error finding container 8087588e4c05f574d9515d19c229d207878fbc2ab28ac5a749dfce1f244dac82: Status 404 returned error can't find the container with id 8087588e4c05f574d9515d19c229d207878fbc2ab28ac5a749dfce1f244dac82 Jun 05 15:42:39.366522 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:39.366490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" event={"ID":"70189bcd-7c60-4e55-a7ff-343d8e459ba3","Type":"ContainerStarted","Data":"8087588e4c05f574d9515d19c229d207878fbc2ab28ac5a749dfce1f244dac82"} Jun 05 15:42:42.379590 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:42.379553 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" event={"ID":"70189bcd-7c60-4e55-a7ff-343d8e459ba3","Type":"ContainerStarted","Data":"148ca9efb09e905ec87c3ad197786e49ffd69d8a6edb6f4d452b11f87d80327e"} Jun 05 15:42:42.403532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:42.403469 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-594c4dc786-n78cq" podStartSLOduration=1.969927346 podStartE2EDuration="4.403450935s" totalImagesPullingTime="2.433523589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:42.40203284 +0000 UTC m=+500.321124949" watchObservedRunningTime="2026-06-05 15:42:42.403450935 +0000 UTC m=+500.322543073" Jun 05 15:42:53.138565 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.138532 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb"] Jun 05 15:42:53.142965 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.142947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.144515 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.144489 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 15:42:53.144783 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.144761 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b6n74\"" Jun 05 15:42:53.156302 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.156275 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb"] Jun 05 15:42:53.247222 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247222 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247442 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmscb\" (UniqueName: \"kubernetes.io/projected/eb62c275-fd0c-4d66-98bc-b4644d25d38e-kube-api-access-dmscb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247442 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247442 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247442 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247442 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247606 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.247606 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.247479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348413 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmscb\" (UniqueName: \"kubernetes.io/projected/eb62c275-fd0c-4d66-98bc-b4644d25d38e-kube-api-access-dmscb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.348572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.349015 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.349015 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348871 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.349015 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.348989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.349161 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.349055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.349369 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.349349 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.349411 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.349397 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.350845 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.350819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.351158 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.351142 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.359947 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.359925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb62c275-fd0c-4d66-98bc-b4644d25d38e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.360049 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.359991 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmscb\" (UniqueName: \"kubernetes.io/projected/eb62c275-fd0c-4d66-98bc-b4644d25d38e-kube-api-access-dmscb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795hbcwb\" (UID: \"eb62c275-fd0c-4d66-98bc-b4644d25d38e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.452855 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.452829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:53.591075 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:53.590944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb"] Jun 05 15:42:53.593651 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:42:53.593624 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb62c275_fd0c_4d66_98bc_b4644d25d38e.slice/crio-356391367ed4cc42c1e446a4ac33332c51299ce86eb22fabb930a7ddb727c84c WatchSource:0}: Error finding container 356391367ed4cc42c1e446a4ac33332c51299ce86eb22fabb930a7ddb727c84c: Status 404 returned error can't find the container with id 356391367ed4cc42c1e446a4ac33332c51299ce86eb22fabb930a7ddb727c84c Jun 05 15:42:54.426279 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:54.426239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" event={"ID":"eb62c275-fd0c-4d66-98bc-b4644d25d38e","Type":"ContainerStarted","Data":"356391367ed4cc42c1e446a4ac33332c51299ce86eb22fabb930a7ddb727c84c"} Jun 05 15:42:57.159044 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:57.159004 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:42:57.159282 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:57.159085 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:42:57.159282 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:57.159113 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:42:57.442435 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:57.442345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" event={"ID":"eb62c275-fd0c-4d66-98bc-b4644d25d38e","Type":"ContainerStarted","Data":"fedf5fb8f83d8354ae886a5f31ee06cb2afd313b0934460a6fe70116f90ca9cc"} Jun 05 15:42:57.453301 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:57.453273 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:57.459970 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:57.459923 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" podStartSLOduration=0.896775308 podStartE2EDuration="4.4599081s" totalImagesPullingTime="3.563132792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:42:57.458216849 +0000 UTC m=+515.377308957" watchObservedRunningTime="2026-06-05 15:42:57.4599081 +0000 UTC m=+515.379000208" Jun 05 15:42:58.457868 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:58.457837 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:59.450712 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:59.450677 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:42:59.451772 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:42:59.451728 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795hbcwb" Jun 05 15:43:12.359108 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.359017 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6glhj"] Jun 05 15:43:12.362357 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.362334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:12.364320 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.364287 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 15:43:12.364629 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.364607 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 15:43:12.364767 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.364633 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-74zbp\"" Jun 05 15:43:12.369491 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.369392 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6glhj"] Jun 05 15:43:12.535667 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.535635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzs2k\" (UniqueName: \"kubernetes.io/projected/a583841f-171e-4c74-a9d9-6c33b8d32aff-kube-api-access-qzs2k\") pod \"kuadrant-operator-catalog-6glhj\" (UID: \"a583841f-171e-4c74-a9d9-6c33b8d32aff\") " pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:12.636128 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.636036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzs2k\" (UniqueName: \"kubernetes.io/projected/a583841f-171e-4c74-a9d9-6c33b8d32aff-kube-api-access-qzs2k\") pod \"kuadrant-operator-catalog-6glhj\" (UID: \"a583841f-171e-4c74-a9d9-6c33b8d32aff\") " pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:12.643233 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.643191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzs2k\" (UniqueName: \"kubernetes.io/projected/a583841f-171e-4c74-a9d9-6c33b8d32aff-kube-api-access-qzs2k\") pod \"kuadrant-operator-catalog-6glhj\" (UID: \"a583841f-171e-4c74-a9d9-6c33b8d32aff\") " pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:12.674066 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.674034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:12.793838 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.793790 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6glhj"] Jun 05 15:43:12.815777 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.815726 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6glhj"] Jun 05 15:43:12.818711 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:43:12.818685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda583841f_171e_4c74_a9d9_6c33b8d32aff.slice/crio-600794c5b1fc44c9b71b9d9c6b09b13d1a45ae0ec2bb11b87260b1ac52651473 WatchSource:0}: Error finding container 600794c5b1fc44c9b71b9d9c6b09b13d1a45ae0ec2bb11b87260b1ac52651473: Status 404 returned error can't find the container with id 600794c5b1fc44c9b71b9d9c6b09b13d1a45ae0ec2bb11b87260b1ac52651473 Jun 05 15:43:12.935927 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.935849 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rsn6f"] Jun 05 15:43:12.940127 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.940101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:12.945311 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:12.945283 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rsn6f"] Jun 05 15:43:13.040351 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.040317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w47wt\" (UniqueName: \"kubernetes.io/projected/1bfac722-3686-4b19-a965-d5d3320ef2b4-kube-api-access-w47wt\") pod \"kuadrant-operator-catalog-rsn6f\" (UID: \"1bfac722-3686-4b19-a965-d5d3320ef2b4\") " pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:13.141164 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.141115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w47wt\" (UniqueName: \"kubernetes.io/projected/1bfac722-3686-4b19-a965-d5d3320ef2b4-kube-api-access-w47wt\") pod \"kuadrant-operator-catalog-rsn6f\" (UID: \"1bfac722-3686-4b19-a965-d5d3320ef2b4\") " pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:13.148732 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.148696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w47wt\" (UniqueName: \"kubernetes.io/projected/1bfac722-3686-4b19-a965-d5d3320ef2b4-kube-api-access-w47wt\") pod \"kuadrant-operator-catalog-rsn6f\" (UID: \"1bfac722-3686-4b19-a965-d5d3320ef2b4\") " pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:13.251057 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.251021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:13.387858 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.387787 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rsn6f"] Jun 05 15:43:13.399067 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:43:13.399030 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfac722_3686_4b19_a965_d5d3320ef2b4.slice/crio-d37e020d42b7c4396fc1660d92d79bfe44763048574503273a32fddef4589a68 WatchSource:0}: Error finding container d37e020d42b7c4396fc1660d92d79bfe44763048574503273a32fddef4589a68: Status 404 returned error can't find the container with id d37e020d42b7c4396fc1660d92d79bfe44763048574503273a32fddef4589a68 Jun 05 15:43:13.510610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.510507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" event={"ID":"a583841f-171e-4c74-a9d9-6c33b8d32aff","Type":"ContainerStarted","Data":"600794c5b1fc44c9b71b9d9c6b09b13d1a45ae0ec2bb11b87260b1ac52651473"} Jun 05 15:43:13.512128 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:13.512095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" event={"ID":"1bfac722-3686-4b19-a965-d5d3320ef2b4","Type":"ContainerStarted","Data":"d37e020d42b7c4396fc1660d92d79bfe44763048574503273a32fddef4589a68"} Jun 05 15:43:14.363256 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.362076 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64db7f5cb9-z2trv"] Jun 05 15:43:14.365741 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.365715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.367708 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.367682 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 15:43:14.367708 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.367704 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 15:43:14.367928 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.367783 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 15:43:14.368060 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.368041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qdmtl\"" Jun 05 15:43:14.368468 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.368295 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 15:43:14.368468 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.368345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 15:43:14.382054 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.381786 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 15:43:14.384193 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.383924 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64db7f5cb9-z2trv"] Jun 05 15:43:14.452038 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.451994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-trusted-ca-bundle\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.452038 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.452038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-oauth-serving-cert\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.452532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.452068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-service-ca\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.452532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.452138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26j5z\" (UniqueName: \"kubernetes.io/projected/322798c4-2c91-4194-87e6-267ca8937d27-kube-api-access-26j5z\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.452532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.452188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-console-config\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.452532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.452260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/322798c4-2c91-4194-87e6-267ca8937d27-console-oauth-config\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.452532 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.452301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/322798c4-2c91-4194-87e6-267ca8937d27-console-serving-cert\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.553853 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.553814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26j5z\" (UniqueName: \"kubernetes.io/projected/322798c4-2c91-4194-87e6-267ca8937d27-kube-api-access-26j5z\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.553853 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.553864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-console-config\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.554187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.553934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/322798c4-2c91-4194-87e6-267ca8937d27-console-oauth-config\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.554187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.553971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/322798c4-2c91-4194-87e6-267ca8937d27-console-serving-cert\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.554187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.554027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-trusted-ca-bundle\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.554187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.554054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-oauth-serving-cert\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.554187 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.554079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-service-ca\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.554930 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.554890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-service-ca\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.555041 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.555019 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-console-config\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.555179 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.555138 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-oauth-serving-cert\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.555309 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.555219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/322798c4-2c91-4194-87e6-267ca8937d27-trusted-ca-bundle\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.557940 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.557375 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/322798c4-2c91-4194-87e6-267ca8937d27-console-serving-cert\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.557940 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.557603 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/322798c4-2c91-4194-87e6-267ca8937d27-console-oauth-config\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.561889 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.561847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26j5z\" (UniqueName: \"kubernetes.io/projected/322798c4-2c91-4194-87e6-267ca8937d27-kube-api-access-26j5z\") pod \"console-64db7f5cb9-z2trv\" (UID: \"322798c4-2c91-4194-87e6-267ca8937d27\") " pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.689240 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.689155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:14.968740 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:14.968712 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64db7f5cb9-z2trv"] Jun 05 15:43:14.971426 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:43:14.971403 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322798c4_2c91_4194_87e6_267ca8937d27.slice/crio-e73c8a91ac8e82c2090cccd89ea2380990d52752cf3a4999e90b8a995dbf53eb WatchSource:0}: Error finding container e73c8a91ac8e82c2090cccd89ea2380990d52752cf3a4999e90b8a995dbf53eb: Status 404 returned error can't find the container with id e73c8a91ac8e82c2090cccd89ea2380990d52752cf3a4999e90b8a995dbf53eb Jun 05 15:43:15.523319 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.523282 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64db7f5cb9-z2trv" event={"ID":"322798c4-2c91-4194-87e6-267ca8937d27","Type":"ContainerStarted","Data":"b643f37d5250b24858d721a69b1c6ac4f127f6e9a3e950faf11b1e1559724577"} Jun 05 15:43:15.523781 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.523338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64db7f5cb9-z2trv" event={"ID":"322798c4-2c91-4194-87e6-267ca8937d27","Type":"ContainerStarted","Data":"e73c8a91ac8e82c2090cccd89ea2380990d52752cf3a4999e90b8a995dbf53eb"} Jun 05 15:43:15.524771 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.524715 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" event={"ID":"1bfac722-3686-4b19-a965-d5d3320ef2b4","Type":"ContainerStarted","Data":"6b39d88f86d50df0eeb2bc153859f0f9be8fbc7b051c6697a731320ca346fc2d"} Jun 05 15:43:15.526002 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.525973 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" event={"ID":"a583841f-171e-4c74-a9d9-6c33b8d32aff","Type":"ContainerStarted","Data":"c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d"} Jun 05 15:43:15.526093 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.526045 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" podUID="a583841f-171e-4c74-a9d9-6c33b8d32aff" containerName="registry-server" containerID="cri-o://c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d" gracePeriod=2 Jun 05 15:43:15.539462 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.539421 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64db7f5cb9-z2trv" podStartSLOduration=1.5394050529999999 podStartE2EDuration="1.539405053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:43:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:43:15.53845302 +0000 UTC m=+533.457545128" watchObservedRunningTime="2026-06-05 15:43:15.539405053 +0000 UTC m=+533.458497160" Jun 05 15:43:15.551610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.551555 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" podStartSLOduration=2.030082119 podStartE2EDuration="3.551537179s" totalImagesPullingTime="1.52145506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:43:15.551173271 +0000 UTC m=+533.470265392" watchObservedRunningTime="2026-06-05 15:43:15.551537179 +0000 UTC m=+533.470629288" Jun 05 15:43:15.567308 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.567267 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" podStartSLOduration=1.47034033 podStartE2EDuration="3.567251951s" totalImagesPullingTime="2.096911621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:43:15.565766296 +0000 UTC m=+533.484858395" watchObservedRunningTime="2026-06-05 15:43:15.567251951 +0000 UTC m=+533.486344058" Jun 05 15:43:15.756143 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.756115 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:15.865234 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.865202 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzs2k\" (UniqueName: \"kubernetes.io/projected/a583841f-171e-4c74-a9d9-6c33b8d32aff-kube-api-access-qzs2k\") pod \"a583841f-171e-4c74-a9d9-6c33b8d32aff\" (UID: \"a583841f-171e-4c74-a9d9-6c33b8d32aff\") " Jun 05 15:43:15.867490 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.867467 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a583841f-171e-4c74-a9d9-6c33b8d32aff-kube-api-access-qzs2k" (OuterVolumeSpecName: "kube-api-access-qzs2k") pod "a583841f-171e-4c74-a9d9-6c33b8d32aff" (UID: "a583841f-171e-4c74-a9d9-6c33b8d32aff"). InnerVolumeSpecName "kube-api-access-qzs2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:43:15.965867 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:15.965831 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzs2k\" (UniqueName: \"kubernetes.io/projected/a583841f-171e-4c74-a9d9-6c33b8d32aff-kube-api-access-qzs2k\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:43:16.531610 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.531573 2579 generic.go:356] "Generic (PLEG): container finished" podID="a583841f-171e-4c74-a9d9-6c33b8d32aff" containerID="c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d" exitCode=0 Jun 05 15:43:16.532079 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.531621 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" Jun 05 15:43:16.532079 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.531665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" event={"ID":"a583841f-171e-4c74-a9d9-6c33b8d32aff","Type":"ContainerDied","Data":"c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d"} Jun 05 15:43:16.532079 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.531722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6glhj" event={"ID":"a583841f-171e-4c74-a9d9-6c33b8d32aff","Type":"ContainerDied","Data":"600794c5b1fc44c9b71b9d9c6b09b13d1a45ae0ec2bb11b87260b1ac52651473"} Jun 05 15:43:16.532079 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.531743 2579 scope.go:117] "RemoveContainer" containerID="c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d" Jun 05 15:43:16.541544 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.541528 2579 scope.go:117] "RemoveContainer" containerID="c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d" Jun 05 15:43:16.541833 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:43:16.541806 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d\": container with ID starting with c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d not found: ID does not exist" containerID="c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d" Jun 05 15:43:16.541919 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.541838 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d"} err="failed to get container status \"c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d\": rpc error: code = NotFound desc = could not find container \"c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d\": container with ID starting with c55adb3cf9760205c0b939031aba8465fafbf1c9bf6c2030558f6b84ff6a622d not found: ID does not exist" Jun 05 15:43:16.550185 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.550162 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6glhj"] Jun 05 15:43:16.558992 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:16.558969 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6glhj"] Jun 05 15:43:18.541202 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:18.541167 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a583841f-171e-4c74-a9d9-6c33b8d32aff" path="/var/lib/kubelet/pods/a583841f-171e-4c74-a9d9-6c33b8d32aff/volumes" Jun 05 15:43:23.251316 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:23.251272 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:23.251785 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:23.251339 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:23.274493 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:23.274458 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:23.583903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:23.583830 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rsn6f" Jun 05 15:43:24.689741 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:24.689703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:24.690195 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:24.689791 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:24.694452 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:24.694430 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:25.573867 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:25.573834 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64db7f5cb9-z2trv" Jun 05 15:43:38.354408 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.354374 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4"] Jun 05 15:43:38.354888 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.354741 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a583841f-171e-4c74-a9d9-6c33b8d32aff" containerName="registry-server" Jun 05 15:43:38.354888 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.354766 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a583841f-171e-4c74-a9d9-6c33b8d32aff" containerName="registry-server" Jun 05 15:43:38.354888 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.354821 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a583841f-171e-4c74-a9d9-6c33b8d32aff" containerName="registry-server" Jun 05 15:43:38.364509 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.364488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:38.366405 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.366382 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fqj95\"" Jun 05 15:43:38.367460 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.367425 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4"] Jun 05 15:43:38.456018 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.455976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wg46\" (UniqueName: \"kubernetes.io/projected/cf792f72-323c-4d7d-987a-3f5e2def65f0-kube-api-access-4wg46\") pod \"limitador-operator-controller-manager-859d7b78bd-t94k4\" (UID: \"cf792f72-323c-4d7d-987a-3f5e2def65f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:38.556877 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.556839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wg46\" (UniqueName: \"kubernetes.io/projected/cf792f72-323c-4d7d-987a-3f5e2def65f0-kube-api-access-4wg46\") pod \"limitador-operator-controller-manager-859d7b78bd-t94k4\" (UID: \"cf792f72-323c-4d7d-987a-3f5e2def65f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:38.581921 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.581887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wg46\" (UniqueName: \"kubernetes.io/projected/cf792f72-323c-4d7d-987a-3f5e2def65f0-kube-api-access-4wg46\") pod \"limitador-operator-controller-manager-859d7b78bd-t94k4\" (UID: \"cf792f72-323c-4d7d-987a-3f5e2def65f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:38.675875 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.675800 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:38.811453 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:38.811427 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4"] Jun 05 15:43:38.813610 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:43:38.813579 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf792f72_323c_4d7d_987a_3f5e2def65f0.slice/crio-b88f011177dc7ff950525bd97eac52104de8fd3ada294abb222736c652ad9699 WatchSource:0}: Error finding container b88f011177dc7ff950525bd97eac52104de8fd3ada294abb222736c652ad9699: Status 404 returned error can't find the container with id b88f011177dc7ff950525bd97eac52104de8fd3ada294abb222736c652ad9699 Jun 05 15:43:39.632512 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:39.632470 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" event={"ID":"cf792f72-323c-4d7d-987a-3f5e2def65f0","Type":"ContainerStarted","Data":"b88f011177dc7ff950525bd97eac52104de8fd3ada294abb222736c652ad9699"} Jun 05 15:43:40.637686 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:40.637657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" event={"ID":"cf792f72-323c-4d7d-987a-3f5e2def65f0","Type":"ContainerStarted","Data":"99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d"} Jun 05 15:43:40.638087 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:40.637798 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:40.653616 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:40.653574 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" podStartSLOduration=1.04461363 podStartE2EDuration="2.653562552s" totalImagesPullingTime="1.608948922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:43:40.653357297 +0000 UTC m=+558.572449405" watchObservedRunningTime="2026-06-05 15:43:40.653562552 +0000 UTC m=+558.572654659" Jun 05 15:43:46.541197 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.541165 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2"] Jun 05 15:43:46.544642 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.544626 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:43:46.546651 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.546632 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gvv57\"" Jun 05 15:43:46.547181 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.547165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 15:43:46.552585 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.552564 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2"] Jun 05 15:43:46.635886 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.635850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtgd\" (UniqueName: \"kubernetes.io/projected/aa00fa60-3504-40b4-9ba5-9ff22a99a35a-kube-api-access-wqtgd\") pod \"dns-operator-controller-manager-864dd78c4c-qchx2\" (UID: \"aa00fa60-3504-40b4-9ba5-9ff22a99a35a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:43:46.737396 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.737362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtgd\" (UniqueName: \"kubernetes.io/projected/aa00fa60-3504-40b4-9ba5-9ff22a99a35a-kube-api-access-wqtgd\") pod \"dns-operator-controller-manager-864dd78c4c-qchx2\" (UID: \"aa00fa60-3504-40b4-9ba5-9ff22a99a35a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:43:46.745250 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.745219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtgd\" (UniqueName: \"kubernetes.io/projected/aa00fa60-3504-40b4-9ba5-9ff22a99a35a-kube-api-access-wqtgd\") pod \"dns-operator-controller-manager-864dd78c4c-qchx2\" (UID: \"aa00fa60-3504-40b4-9ba5-9ff22a99a35a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:43:46.856509 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.856420 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:43:46.998420 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:46.998394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2"] Jun 05 15:43:47.001303 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:43:47.001277 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa00fa60_3504_40b4_9ba5_9ff22a99a35a.slice/crio-401b0ca10174afe742d65eb8d253d7cde730195a9b5d3a6f8a1e51f3a52df1a2 WatchSource:0}: Error finding container 401b0ca10174afe742d65eb8d253d7cde730195a9b5d3a6f8a1e51f3a52df1a2: Status 404 returned error can't find the container with id 401b0ca10174afe742d65eb8d253d7cde730195a9b5d3a6f8a1e51f3a52df1a2 Jun 05 15:43:47.670188 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:47.670157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" event={"ID":"aa00fa60-3504-40b4-9ba5-9ff22a99a35a","Type":"ContainerStarted","Data":"401b0ca10174afe742d65eb8d253d7cde730195a9b5d3a6f8a1e51f3a52df1a2"} Jun 05 15:43:49.679386 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:49.679351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" event={"ID":"aa00fa60-3504-40b4-9ba5-9ff22a99a35a","Type":"ContainerStarted","Data":"6b47bcd6b4cfd18dcc62e1038138fbc4f98f7cea25a1df7a006f93c8a643c5a8"} Jun 05 15:43:49.679782 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:49.679468 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:43:49.692687 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:49.692632 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" podStartSLOduration=1.6545685589999999 podStartE2EDuration="3.692615259s" totalImagesPullingTime="2.0380467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:43:49.691865937 +0000 UTC m=+567.610958045" watchObservedRunningTime="2026-06-05 15:43:49.692615259 +0000 UTC m=+567.611707370" Jun 05 15:43:50.404342 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.404307 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq"] Jun 05 15:43:50.407774 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.407737 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:43:50.409529 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.409505 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-d95vr\"" Jun 05 15:43:50.415874 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.415850 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq"] Jun 05 15:43:50.468844 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.468808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqbgt\" (UniqueName: \"kubernetes.io/projected/30db186c-ad6f-4964-a13b-88e12c46fdf9-kube-api-access-gqbgt\") pod \"authorino-operator-75cc8d5cb7-k8sbq\" (UID: \"30db186c-ad6f-4964-a13b-88e12c46fdf9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:43:50.569289 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.569238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqbgt\" (UniqueName: \"kubernetes.io/projected/30db186c-ad6f-4964-a13b-88e12c46fdf9-kube-api-access-gqbgt\") pod \"authorino-operator-75cc8d5cb7-k8sbq\" (UID: \"30db186c-ad6f-4964-a13b-88e12c46fdf9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:43:50.586344 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.586320 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqbgt\" (UniqueName: \"kubernetes.io/projected/30db186c-ad6f-4964-a13b-88e12c46fdf9-kube-api-access-gqbgt\") pod \"authorino-operator-75cc8d5cb7-k8sbq\" (UID: \"30db186c-ad6f-4964-a13b-88e12c46fdf9\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:43:50.719189 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.719142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:43:50.851855 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:50.851830 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq"] Jun 05 15:43:50.854533 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:43:50.854503 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30db186c_ad6f_4964_a13b_88e12c46fdf9.slice/crio-ff0e80b4029449fd583e4110dbf0ee4537fc2597d9c4c3cc155af01e6b6139b2 WatchSource:0}: Error finding container ff0e80b4029449fd583e4110dbf0ee4537fc2597d9c4c3cc155af01e6b6139b2: Status 404 returned error can't find the container with id ff0e80b4029449fd583e4110dbf0ee4537fc2597d9c4c3cc155af01e6b6139b2 Jun 05 15:43:51.646644 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:51.646609 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:43:51.691471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:51.691432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" event={"ID":"30db186c-ad6f-4964-a13b-88e12c46fdf9","Type":"ContainerStarted","Data":"ff0e80b4029449fd583e4110dbf0ee4537fc2597d9c4c3cc155af01e6b6139b2"} Jun 05 15:43:53.702596 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:53.702554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" event={"ID":"30db186c-ad6f-4964-a13b-88e12c46fdf9","Type":"ContainerStarted","Data":"5889078e98868fe8d36d6b2ab1f16d83eea8af2b7f7a7767c52ed9e38a8ae25f"} Jun 05 15:43:53.702989 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:53.702673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:43:53.719117 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:43:53.719070 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" podStartSLOduration=1.6907978909999999 podStartE2EDuration="3.719054799s" totalImagesPullingTime="2.028256908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:43:53.717695358 +0000 UTC m=+571.636787466" watchObservedRunningTime="2026-06-05 15:43:53.719054799 +0000 UTC m=+571.638146907" Jun 05 15:44:00.686218 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:00.686140 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qchx2" Jun 05 15:44:00.990652 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:00.990621 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4"] Jun 05 15:44:00.990880 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:00.990842 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" containerName="manager" containerID="cri-o://99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d" gracePeriod=2 Jun 05 15:44:01.000026 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:00.999999 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4"] Jun 05 15:44:01.071011 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.070979 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd"] Jun 05 15:44:01.071326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.071314 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" containerName="manager" Jun 05 15:44:01.071368 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.071328 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" containerName="manager" Jun 05 15:44:01.071401 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.071388 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" containerName="manager" Jun 05 15:44:01.074368 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.074352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:01.077420 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:01.077392 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t94k4\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:01.097682 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.097651 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd"] Jun 05 15:44:01.166150 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.166117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxxpr\" (UniqueName: \"kubernetes.io/projected/a36de703-c82d-4501-8022-2218f78ae941-kube-api-access-fxxpr\") pod \"limitador-operator-controller-manager-859d7b78bd-jx8wd\" (UID: \"a36de703-c82d-4501-8022-2218f78ae941\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:01.239375 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.239349 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:01.240880 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:01.240835 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t94k4\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:01.267320 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.267290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxxpr\" (UniqueName: \"kubernetes.io/projected/a36de703-c82d-4501-8022-2218f78ae941-kube-api-access-fxxpr\") pod \"limitador-operator-controller-manager-859d7b78bd-jx8wd\" (UID: \"a36de703-c82d-4501-8022-2218f78ae941\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:01.286807 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.286775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxxpr\" (UniqueName: \"kubernetes.io/projected/a36de703-c82d-4501-8022-2218f78ae941-kube-api-access-fxxpr\") pod \"limitador-operator-controller-manager-859d7b78bd-jx8wd\" (UID: \"a36de703-c82d-4501-8022-2218f78ae941\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:01.368032 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.367996 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wg46\" (UniqueName: \"kubernetes.io/projected/cf792f72-323c-4d7d-987a-3f5e2def65f0-kube-api-access-4wg46\") pod \"cf792f72-323c-4d7d-987a-3f5e2def65f0\" (UID: \"cf792f72-323c-4d7d-987a-3f5e2def65f0\") " Jun 05 15:44:01.370149 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.370113 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf792f72-323c-4d7d-987a-3f5e2def65f0-kube-api-access-4wg46" (OuterVolumeSpecName: "kube-api-access-4wg46") pod "cf792f72-323c-4d7d-987a-3f5e2def65f0" (UID: "cf792f72-323c-4d7d-987a-3f5e2def65f0"). InnerVolumeSpecName "kube-api-access-4wg46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:44:01.383287 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.383262 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:01.469489 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.469454 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wg46\" (UniqueName: \"kubernetes.io/projected/cf792f72-323c-4d7d-987a-3f5e2def65f0-kube-api-access-4wg46\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 15:44:01.514556 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.514528 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd"] Jun 05 15:44:01.517093 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:44:01.517070 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36de703_c82d_4501_8022_2218f78ae941.slice/crio-3d71e26c6bdbea14a2273fc4da75a0556e170e7e632b3591aa777683bee0786e WatchSource:0}: Error finding container 3d71e26c6bdbea14a2273fc4da75a0556e170e7e632b3591aa777683bee0786e: Status 404 returned error can't find the container with id 3d71e26c6bdbea14a2273fc4da75a0556e170e7e632b3591aa777683bee0786e Jun 05 15:44:01.738502 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.738471 2579 generic.go:356] "Generic (PLEG): container finished" podID="cf792f72-323c-4d7d-987a-3f5e2def65f0" containerID="99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d" exitCode=0 Jun 05 15:44:01.738994 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.738514 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:01.738994 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.738568 2579 scope.go:117] "RemoveContainer" containerID="99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d" Jun 05 15:44:01.740082 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:01.740050 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t94k4\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:01.740359 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.740207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" event={"ID":"a36de703-c82d-4501-8022-2218f78ae941","Type":"ContainerStarted","Data":"658c000ae8e2ba2c224564d32f44072c6ee12e986986f40aeb890dc4f053cf1b"} Jun 05 15:44:01.740359 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.740249 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" event={"ID":"a36de703-c82d-4501-8022-2218f78ae941","Type":"ContainerStarted","Data":"3d71e26c6bdbea14a2273fc4da75a0556e170e7e632b3591aa777683bee0786e"} Jun 05 15:44:01.740359 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.740333 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:01.741499 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:01.741472 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t94k4\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:01.747560 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.747543 2579 scope.go:117] "RemoveContainer" containerID="99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d" Jun 05 15:44:01.747831 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:01.747813 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d\": container with ID starting with 99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d not found: ID does not exist" containerID="99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d" Jun 05 15:44:01.747874 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.747839 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d"} err="failed to get container status \"99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d\": rpc error: code = NotFound desc = could not find container \"99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d\": container with ID starting with 99fb7c8968d44b489df5a885cb79240c2b36e64a16a3b479370ba29bac05148d not found: ID does not exist" Jun 05 15:44:01.759163 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:01.759110 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" podStartSLOduration=0.759098264 podStartE2EDuration="759.098264ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:01.757908134 +0000 UTC m=+579.677000253" watchObservedRunningTime="2026-06-05 15:44:01.759098264 +0000 UTC m=+579.678190371" Jun 05 15:44:01.759288 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:01.759249 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t94k4\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:02.539641 ip-10-0-129-173 kubenswrapper[2579]: E0605 15:44:02.539602 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t94k4\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t94k4" Jun 05 15:44:02.541647 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:02.541626 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf792f72-323c-4d7d-987a-3f5e2def65f0" path="/var/lib/kubelet/pods/cf792f72-323c-4d7d-987a-3f5e2def65f0/volumes" Jun 05 15:44:04.708683 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:04.708639 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k8sbq" Jun 05 15:44:12.749163 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:12.749114 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jx8wd" Jun 05 15:44:22.497111 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:22.497082 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:44:22.498112 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:22.498091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:44:22.501945 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:22.501924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:44:22.502619 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:22.502603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:44:22.509208 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:22.509187 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:44:22.509979 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:22.509963 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:44:29.745417 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.745384 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n"] Jun 05 15:44:29.750474 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.750450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.752113 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.752088 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gknj7\"" Jun 05 15:44:29.760423 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.760347 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n"] Jun 05 15:44:29.814326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814326 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e82d232c-a59f-43e6-9955-6d65072b628e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e82d232c-a59f-43e6-9955-6d65072b628e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814583 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814792 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e82d232c-a59f-43e6-9955-6d65072b628e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.814792 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.814628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpttj\" (UniqueName: \"kubernetes.io/projected/e82d232c-a59f-43e6-9955-6d65072b628e-kube-api-access-zpttj\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915634 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e82d232c-a59f-43e6-9955-6d65072b628e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e82d232c-a59f-43e6-9955-6d65072b628e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e82d232c-a59f-43e6-9955-6d65072b628e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.915863 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpttj\" (UniqueName: \"kubernetes.io/projected/e82d232c-a59f-43e6-9955-6d65072b628e-kube-api-access-zpttj\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.916263 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.915902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.916263 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.916222 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.916263 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.916252 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.916409 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.916358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.916446 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.916416 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.916990 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.916966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e82d232c-a59f-43e6-9955-6d65072b628e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.918236 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.918220 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e82d232c-a59f-43e6-9955-6d65072b628e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.918276 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.918252 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e82d232c-a59f-43e6-9955-6d65072b628e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.923411 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.923384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e82d232c-a59f-43e6-9955-6d65072b628e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:29.923585 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:29.923569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpttj\" (UniqueName: \"kubernetes.io/projected/e82d232c-a59f-43e6-9955-6d65072b628e-kube-api-access-zpttj\") pod \"maas-default-gateway-openshift-default-687ff6996-6q92n\" (UID: \"e82d232c-a59f-43e6-9955-6d65072b628e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:30.063823 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.063709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:30.197803 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.197772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n"] Jun 05 15:44:30.200395 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:44:30.200371 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82d232c_a59f_43e6_9955_6d65072b628e.slice/crio-0abd3dce7f47d066e300e62d2eee1f16181268efb804165ff4ff2e66d53896be WatchSource:0}: Error finding container 0abd3dce7f47d066e300e62d2eee1f16181268efb804165ff4ff2e66d53896be: Status 404 returned error can't find the container with id 0abd3dce7f47d066e300e62d2eee1f16181268efb804165ff4ff2e66d53896be Jun 05 15:44:30.202666 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.202633 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:44:30.202731 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.202704 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:44:30.202795 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.202742 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:44:30.870979 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.870947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" event={"ID":"e82d232c-a59f-43e6-9955-6d65072b628e","Type":"ContainerStarted","Data":"10442e2c14731228b2278be89001b74d927d3badc5b438513b59f6b90749fd66"} Jun 05 15:44:30.871346 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.871000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" event={"ID":"e82d232c-a59f-43e6-9955-6d65072b628e","Type":"ContainerStarted","Data":"0abd3dce7f47d066e300e62d2eee1f16181268efb804165ff4ff2e66d53896be"} Jun 05 15:44:30.888084 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:30.888020 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" podStartSLOduration=1.888004409 podStartE2EDuration="1.888004409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:30.886176187 +0000 UTC m=+608.805268294" watchObservedRunningTime="2026-06-05 15:44:30.888004409 +0000 UTC m=+608.807096515" Jun 05 15:44:31.064812 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:31.064744 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:31.069604 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:31.069576 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:31.875793 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:31.875743 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:31.876645 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:31.876626 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:44:33.955456 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:33.955420 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:44:33.958116 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:33.958089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:33.959572 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:33.959553 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d29x7\"" Jun 05 15:44:33.959681 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:33.959556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 15:44:33.966670 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:33.966647 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:44:33.992013 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:33.991981 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:44:34.054663 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.054627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmnwz\" (UniqueName: \"kubernetes.io/projected/12a4a380-972d-4ff3-b13f-3ce3c5f8cf83-kube-api-access-gmnwz\") pod \"limitador-limitador-54d6d988d5-b27f2\" (UID: \"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.054865 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.054781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12a4a380-972d-4ff3-b13f-3ce3c5f8cf83-config-file\") pod \"limitador-limitador-54d6d988d5-b27f2\" (UID: \"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.155848 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.155818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12a4a380-972d-4ff3-b13f-3ce3c5f8cf83-config-file\") pod \"limitador-limitador-54d6d988d5-b27f2\" (UID: \"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.156016 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.155858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmnwz\" (UniqueName: \"kubernetes.io/projected/12a4a380-972d-4ff3-b13f-3ce3c5f8cf83-kube-api-access-gmnwz\") pod \"limitador-limitador-54d6d988d5-b27f2\" (UID: \"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.156554 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.156527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12a4a380-972d-4ff3-b13f-3ce3c5f8cf83-config-file\") pod \"limitador-limitador-54d6d988d5-b27f2\" (UID: \"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.162355 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.162332 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmnwz\" (UniqueName: \"kubernetes.io/projected/12a4a380-972d-4ff3-b13f-3ce3c5f8cf83-kube-api-access-gmnwz\") pod \"limitador-limitador-54d6d988d5-b27f2\" (UID: \"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.269053 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.268969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:34.416026 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.415994 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:44:34.418861 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:44:34.418829 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a4a380_972d_4ff3_b13f_3ce3c5f8cf83.slice/crio-56b4c0037c2d175275ca415a2afffbd020381f390f16793fc00e817ee1752394 WatchSource:0}: Error finding container 56b4c0037c2d175275ca415a2afffbd020381f390f16793fc00e817ee1752394: Status 404 returned error can't find the container with id 56b4c0037c2d175275ca415a2afffbd020381f390f16793fc00e817ee1752394 Jun 05 15:44:34.898378 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:34.898335 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" event={"ID":"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83","Type":"ContainerStarted","Data":"56b4c0037c2d175275ca415a2afffbd020381f390f16793fc00e817ee1752394"} Jun 05 15:44:36.908806 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:36.908771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" event={"ID":"12a4a380-972d-4ff3-b13f-3ce3c5f8cf83","Type":"ContainerStarted","Data":"701568cd61caf313f27064ff79b9e30381c970bed9a6e80b7e268acfc352c2ac"} Jun 05 15:44:36.909178 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:36.908823 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:44:36.923686 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:36.923640 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" podStartSLOduration=1.5813110620000002 podStartE2EDuration="3.923625249s" totalImagesPullingTime="2.342314187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:44:36.921333953 +0000 UTC m=+614.840426059" watchObservedRunningTime="2026-06-05 15:44:36.923625249 +0000 UTC m=+614.842717357" Jun 05 15:44:47.914819 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:44:47.914726 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b27f2" Jun 05 15:46:33.290796 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:33.290669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:46:41.473847 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:41.473808 2579 generic.go:356] "Generic (PLEG): container finished" podID="e82d232c-a59f-43e6-9955-6d65072b628e" containerID="10442e2c14731228b2278be89001b74d927d3badc5b438513b59f6b90749fd66" exitCode=0 Jun 05 15:46:41.474312 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:41.473883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" event={"ID":"e82d232c-a59f-43e6-9955-6d65072b628e","Type":"ContainerDied","Data":"10442e2c14731228b2278be89001b74d927d3badc5b438513b59f6b90749fd66"} Jun 05 15:46:41.474312 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:41.474272 2579 scope.go:117] "RemoveContainer" containerID="10442e2c14731228b2278be89001b74d927d3badc5b438513b59f6b90749fd66" Jun 05 15:46:41.475262 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:41.475234 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:46:41.475359 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:41.475302 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:46:41.475359 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:41.475332 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 15:46:42.485183 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:42.485127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" event={"ID":"e82d232c-a59f-43e6-9955-6d65072b628e","Type":"ContainerStarted","Data":"0fec8f84cbac2b0efdab764eeba9f6aad80456be2768909b3a0c2c3ec9fbae2f"} Jun 05 15:46:43.064446 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:43.064400 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:46:43.065717 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:43.065687 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6q92n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 05 15:46:43.065874 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:43.065775 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" podUID="e82d232c-a59f-43e6-9955-6d65072b628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 05 15:46:44.065012 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:44.064972 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6q92n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 05 15:46:44.065419 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:44.065027 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" podUID="e82d232c-a59f-43e6-9955-6d65072b628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 05 15:46:45.064237 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:45.064194 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6q92n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 05 15:46:45.064415 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:45.064256 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" podUID="e82d232c-a59f-43e6-9955-6d65072b628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 05 15:46:46.064509 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:46.064467 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6q92n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jun 05 15:46:46.064900 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:46.064527 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" podUID="e82d232c-a59f-43e6-9955-6d65072b628e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jun 05 15:46:46.875876 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:46.875839 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:46:47.068897 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:47.068860 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:46:47.514208 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:46:47.514173 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6q92n" Jun 05 15:47:55.573786 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:47:55.573675 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:48:00.174663 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:00.174628 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:48:06.579524 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:06.579491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:48:16.184033 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.183999 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs"] Jun 05 15:48:16.186422 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.186405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.188124 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.188103 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 15:48:16.188279 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.188259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 15:48:16.188394 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.188377 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-59zrr\"" Jun 05 15:48:16.188463 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.188410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 15:48:16.196095 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.196069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs"] Jun 05 15:48:16.248597 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.248562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.248837 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.248686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47afd63e-1c6d-4d19-967d-fc8abf69351b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.248837 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.248715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.248837 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.248774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvr4\" (UniqueName: \"kubernetes.io/projected/47afd63e-1c6d-4d19-967d-fc8abf69351b-kube-api-access-qnvr4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.248837 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.248815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.248837 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.248832 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.349647 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.349609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvr4\" (UniqueName: \"kubernetes.io/projected/47afd63e-1c6d-4d19-967d-fc8abf69351b-kube-api-access-qnvr4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.349872 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.349660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.349872 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.349799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.349986 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.349875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.349986 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.349954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47afd63e-1c6d-4d19-967d-fc8abf69351b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.350089 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.349984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.350142 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.350130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.350196 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.350145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.350274 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.350257 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.352144 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.352124 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47afd63e-1c6d-4d19-967d-fc8abf69351b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.352417 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.352400 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47afd63e-1c6d-4d19-967d-fc8abf69351b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.359233 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.359208 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvr4\" (UniqueName: \"kubernetes.io/projected/47afd63e-1c6d-4d19-967d-fc8abf69351b-kube-api-access-qnvr4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs\" (UID: \"47afd63e-1c6d-4d19-967d-fc8abf69351b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.497431 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.497378 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:16.637884 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.637676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs"] Jun 05 15:48:16.640736 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:48:16.640702 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47afd63e_1c6d_4d19_967d_fc8abf69351b.slice/crio-2dcea6de69748c7198a8120b2c15af49424b4bde223ba46ca1ccfcff205d816f WatchSource:0}: Error finding container 2dcea6de69748c7198a8120b2c15af49424b4bde223ba46ca1ccfcff205d816f: Status 404 returned error can't find the container with id 2dcea6de69748c7198a8120b2c15af49424b4bde223ba46ca1ccfcff205d816f Jun 05 15:48:16.642595 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.642580 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:48:16.919575 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:16.919487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" event={"ID":"47afd63e-1c6d-4d19-967d-fc8abf69351b","Type":"ContainerStarted","Data":"2dcea6de69748c7198a8120b2c15af49424b4bde223ba46ca1ccfcff205d816f"} Jun 05 15:48:17.087614 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:17.087578 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:48:20.946955 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:20.946922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" event={"ID":"47afd63e-1c6d-4d19-967d-fc8abf69351b","Type":"ContainerStarted","Data":"c4de0f6f84c9e7372e77a0b685719b51141e40504dc0272a2efcef007937c2a6"} Jun 05 15:48:21.953331 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:21.953295 2579 generic.go:356] "Generic (PLEG): container finished" podID="47afd63e-1c6d-4d19-967d-fc8abf69351b" containerID="c4de0f6f84c9e7372e77a0b685719b51141e40504dc0272a2efcef007937c2a6" exitCode=0 Jun 05 15:48:21.953717 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:21.953389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" event={"ID":"47afd63e-1c6d-4d19-967d-fc8abf69351b","Type":"ContainerDied","Data":"c4de0f6f84c9e7372e77a0b685719b51141e40504dc0272a2efcef007937c2a6"} Jun 05 15:48:23.965660 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:23.965622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" event={"ID":"47afd63e-1c6d-4d19-967d-fc8abf69351b","Type":"ContainerStarted","Data":"dba7a26ea568395740776a9f3b312fc407886265649f47a14cb172aee2d94708"} Jun 05 15:48:23.982739 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:23.982683 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" podStartSLOduration=1.9810485949999999 podStartE2EDuration="7.982665406s" totalImagesPullingTime="4.576278851s" totalInitContainerRuntime="1.42533796s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:48:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:48:23.980465944 +0000 UTC m=+841.899558050" watchObservedRunningTime="2026-06-05 15:48:23.982665406 +0000 UTC m=+841.901757506" Jun 05 15:48:26.497735 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:26.497694 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:26.498230 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:26.497776 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:26.510476 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:26.510452 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:26.990727 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:26.990697 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs" Jun 05 15:48:29.278218 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:29.278184 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:48:34.584247 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.584212 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn"] Jun 05 15:48:34.603091 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.603060 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn"] Jun 05 15:48:34.603240 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.603157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.604994 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.604967 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 15:48:34.727917 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.727878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.728090 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.727928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.728090 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.727966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmw4s\" (UniqueName: \"kubernetes.io/projected/1266ad83-2183-4bc9-a758-5ce1fa473c40-kube-api-access-rmw4s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.728090 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.727988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.728090 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.728004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1266ad83-2183-4bc9-a758-5ce1fa473c40-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.728243 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.728085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829250 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829446 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829446 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmw4s\" (UniqueName: \"kubernetes.io/projected/1266ad83-2183-4bc9-a758-5ce1fa473c40-kube-api-access-rmw4s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829446 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829446 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1266ad83-2183-4bc9-a758-5ce1fa473c40-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829647 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829647 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829773 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829668 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.829908 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.829885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.831654 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.831631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1266ad83-2183-4bc9-a758-5ce1fa473c40-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.831995 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.831978 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1266ad83-2183-4bc9-a758-5ce1fa473c40-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.835816 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.835740 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmw4s\" (UniqueName: \"kubernetes.io/projected/1266ad83-2183-4bc9-a758-5ce1fa473c40-kube-api-access-rmw4s\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-gskgn\" (UID: \"1266ad83-2183-4bc9-a758-5ce1fa473c40\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:34.912250 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:34.912217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:35.042725 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:35.042702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn"] Jun 05 15:48:35.045294 ip-10-0-129-173 kubenswrapper[2579]: W0605 15:48:35.045259 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1266ad83_2183_4bc9_a758_5ce1fa473c40.slice/crio-4221a4f308c08dbda95807bb4ffa7a69599684f8ab0fbba65470b82a9c5ebb9a WatchSource:0}: Error finding container 4221a4f308c08dbda95807bb4ffa7a69599684f8ab0fbba65470b82a9c5ebb9a: Status 404 returned error can't find the container with id 4221a4f308c08dbda95807bb4ffa7a69599684f8ab0fbba65470b82a9c5ebb9a Jun 05 15:48:36.019226 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:36.019187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" event={"ID":"1266ad83-2183-4bc9-a758-5ce1fa473c40","Type":"ContainerStarted","Data":"321ac2992cc416b261f3d68ea5ac3e90c546007af0bb5da2f31613b143fcc012"} Jun 05 15:48:36.019226 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:36.019232 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" event={"ID":"1266ad83-2183-4bc9-a758-5ce1fa473c40","Type":"ContainerStarted","Data":"4221a4f308c08dbda95807bb4ffa7a69599684f8ab0fbba65470b82a9c5ebb9a"} Jun 05 15:48:36.378908 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:36.378873 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:48:37.025170 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:37.025126 2579 generic.go:356] "Generic (PLEG): container finished" podID="1266ad83-2183-4bc9-a758-5ce1fa473c40" containerID="321ac2992cc416b261f3d68ea5ac3e90c546007af0bb5da2f31613b143fcc012" exitCode=0 Jun 05 15:48:37.025612 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:37.025183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" event={"ID":"1266ad83-2183-4bc9-a758-5ce1fa473c40","Type":"ContainerDied","Data":"321ac2992cc416b261f3d68ea5ac3e90c546007af0bb5da2f31613b143fcc012"} Jun 05 15:48:38.031803 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:38.031764 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" event={"ID":"1266ad83-2183-4bc9-a758-5ce1fa473c40","Type":"ContainerStarted","Data":"d678b4e979eea49beb9e4863f13c4e2e3925413e933d90b9d2e033a2c7d8f311"} Jun 05 15:48:38.047457 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:38.047386 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" podStartSLOduration=2.57777871 podStartE2EDuration="4.047367753s" totalImagesPullingTime="232.367021ms" totalInitContainerRuntime="1.237222022s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:48:38.04685135 +0000 UTC m=+855.965943459" watchObservedRunningTime="2026-06-05 15:48:38.047367753 +0000 UTC m=+855.966459860" Jun 05 15:48:44.912420 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:44.912387 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:44.912964 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:44.912437 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:44.925513 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:44.925487 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:48:45.076915 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:48:45.076885 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-gskgn" Jun 05 15:49:22.529903 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:49:22.529816 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:49:22.531337 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:49:22.531315 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:49:22.535681 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:49:22.535658 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:49:22.537574 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:49:22.537554 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:49:22.541520 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:49:22.541498 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:49:22.543976 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:49:22.543940 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:50:40.588436 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:50:40.588359 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:50:50.878722 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:50:50.878676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:50:59.977607 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:50:59.977560 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:51:09.082432 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:51:09.082394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:51:19.081888 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:51:19.081845 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:51:28.387213 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:51:28.387170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:52:40.282804 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:52:40.282698 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:52:56.384924 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:52:56.384884 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:53:35.078084 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:53:35.078048 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:53:52.573377 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:53:52.573300 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:54:04.981835 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:04.981798 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:54:21.986980 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:21.986946 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:54:22.564675 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:22.564649 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:54:22.567499 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:22.567479 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:54:22.569388 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:22.569368 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:54:22.572121 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:22.572105 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:54:22.573471 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:22.573454 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:54:22.575935 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:54:22.575914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:55:17.576157 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:55:17.576069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:55:26.879269 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:55:26.879230 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:55:43.582567 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:55:43.582524 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:55:52.772323 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:55:52.772277 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:56:07.473057 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:56:07.473017 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:56:16.581078 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:56:16.581038 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:56:49.779810 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:56:49.779707 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:56:58.480500 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:56:58.480459 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:57:06.778176 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:57:06.778132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:57:14.878487 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:57:14.878442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:57:22.978000 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:57:22.977961 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:57:41.177998 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:57:41.177964 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:57:52.183342 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:57:52.183300 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:58:41.274769 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:58:41.274670 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:58:45.983057 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:58:45.983018 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:58:52.680811 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:58:52.680770 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:03.083685 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:03.083651 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:11.984034 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:11.983992 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:19.080614 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:19.080577 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:22.592925 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:22.592900 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:59:22.596994 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:22.596967 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 15:59:22.597154 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:22.597093 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:59:22.601669 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:22.601649 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 15:59:22.601811 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:22.601795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:59:22.605945 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:22.605924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 15:59:29.287101 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:29.287055 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:38.284624 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:38.284587 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:44.680107 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:44.680025 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 15:59:53.479376 ip-10-0-129-173 kubenswrapper[2579]: I0605 15:59:53.479332 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:04.280417 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:04.280385 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:11.283843 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:11.283802 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:22.091423 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:22.091381 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:29.176243 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:29.176203 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:39.713853 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:39.713820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:46.183465 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:46.183421 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:00:56.979269 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:00:56.979228 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:01:03.183476 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:01:03.183428 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:03:22.884942 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:03:22.884909 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:03:30.179233 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:03:30.179196 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:03:57.780126 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:03:57.780086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:04:03.085195 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:03.085158 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:04:14.273404 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:14.273315 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:04:22.621525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:22.621494 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 16:04:22.625813 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:22.625791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 16:04:22.626525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:22.626502 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 16:04:22.630593 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:22.630574 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 16:04:22.630798 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:22.630782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 16:04:22.634851 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:22.634833 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 16:04:24.376140 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:24.376099 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:04:32.887299 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:32.887267 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:04:44.078538 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:44.078499 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:04:52.386957 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:04:52.386919 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:05:01.684140 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:05:01.684102 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:05:10.581509 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:05:10.581470 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:05:21.778175 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:05:21.778131 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:05:30.578009 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:05:30.577973 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:06:06.183461 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:06:06.183425 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:06:47.684175 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:06:47.684138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:06:56.785561 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:06:56.785526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:07:05.587472 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:07:05.587432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:07:14.585110 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:07:14.585021 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:07:23.877958 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:07:23.877916 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:07:38.286065 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:07:38.286024 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:07:46.284629 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:07:46.284591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:07:57.276018 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:07:57.275977 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:08:05.476377 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:08:05.476338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:08:12.285292 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:08:12.285255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:08:22.383982 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:08:22.383940 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:08:34.779635 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:08:34.779599 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:08:51.886629 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:08:51.886537 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:01.081497 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:01.081457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:07.978199 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:07.978163 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:16.081270 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:16.081231 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:22.650445 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:22.650412 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 16:09:22.658768 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:22.658728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 16:09:22.658912 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:22.658853 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 16:09:22.663005 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:22.662973 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 16:09:22.663825 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:22.663807 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 16:09:22.667934 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:22.667916 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 16:09:34.383190 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:34.383152 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:43.676373 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:43.676332 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:52.777911 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:52.777869 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:09:59.284879 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:09:59.284844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:10:09.781911 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:10:09.781875 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:10:18.582664 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:10:18.582625 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:10:25.383952 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:10:25.383914 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:10:40.276977 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:10:40.276941 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:10:49.078990 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:10:49.078951 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:11:02.680118 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:11:02.680080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:11:11.382966 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:11:11.382923 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:11:19.481833 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:11:19.481787 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:11:30.473907 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:11:30.473872 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:11:38.083494 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:11:38.083454 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:11:56.781862 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:11:56.781777 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:12:03.177551 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:03.177513 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:12:14.079957 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:14.079921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:12:21.773457 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:21.773418 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:12:47.280974 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:47.280930 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:12:58.969525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:58.969488 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4"] Jun 05 16:12:58.973737 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:58.973712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:58.975795 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:58.975770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-08a4bd0d-openshift-default-dockercfg-qwjw7\"" Jun 05 16:12:58.990632 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:58.990598 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4"] Jun 05 16:12:59.017827 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017790 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-certs\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.017975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-socket\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.017975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-credential-socket\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.017975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-podinfo\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.017975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-data\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.017975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istiod-ca-cert\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.018142 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.017989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknm2\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-kube-api-access-dknm2\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.018142 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.018031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-token\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.018142 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.018084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-envoy\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119313 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-certs\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119313 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-socket\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119558 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-credential-socket\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119558 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-podinfo\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119558 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-data\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istiod-ca-cert\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknm2\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-kube-api-access-dknm2\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-token\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119788 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-certs\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119793 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-credential-socket\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.119947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-envoy\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.120171 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.119970 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-socket\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.120171 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.120004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-data\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.120330 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.120312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istiod-ca-cert\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.122199 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.122175 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-envoy\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.122564 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.122541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-podinfo\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.128930 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.128907 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-token\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.129094 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.129074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknm2\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-kube-api-access-dknm2\") pod \"e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.285499 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.285414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:12:59.424710 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.424677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4"] Jun 05 16:12:59.427328 ip-10-0-129-173 kubenswrapper[2579]: W0605 16:12:59.427285 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd221b8d6_abe7_4f7a_a719_ae7f6404b995.slice/crio-9a0b3181d98d0013464e2ac3e91f1f0247c94f2aad2c1210e43f92f63501fb6f WatchSource:0}: Error finding container 9a0b3181d98d0013464e2ac3e91f1f0247c94f2aad2c1210e43f92f63501fb6f: Status 404 returned error can't find the container with id 9a0b3181d98d0013464e2ac3e91f1f0247c94f2aad2c1210e43f92f63501fb6f Jun 05 16:12:59.429713 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.429675 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 16:12:59.429820 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.429796 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 16:12:59.429867 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.429850 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 16:12:59.789949 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:12:59.789906 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b27f2"] Jun 05 16:13:00.002034 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:00.001997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" event={"ID":"d221b8d6-abe7-4f7a-a719-ae7f6404b995","Type":"ContainerStarted","Data":"40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917"} Jun 05 16:13:00.002507 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:00.002055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" event={"ID":"d221b8d6-abe7-4f7a-a719-ae7f6404b995","Type":"ContainerStarted","Data":"9a0b3181d98d0013464e2ac3e91f1f0247c94f2aad2c1210e43f92f63501fb6f"} Jun 05 16:13:00.018501 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:00.018455 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" podStartSLOduration=2.01843502 podStartE2EDuration="2.01843502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:13:00.017076863 +0000 UTC m=+2317.936168970" watchObservedRunningTime="2026-06-05 16:13:00.01843502 +0000 UTC m=+2317.937527128" Jun 05 16:13:00.285636 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:00.285598 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:13:00.290599 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:00.290573 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:13:01.007188 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:01.007151 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:13:01.008111 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:01.008090 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:13:05.371890 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:05.371849 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4"] Jun 05 16:13:05.372366 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:05.372090 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" podUID="d221b8d6-abe7-4f7a-a719-ae7f6404b995" containerName="istio-proxy" containerID="cri-o://40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917" gracePeriod=30 Jun 05 16:13:10.628144 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.628110 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:13:10.726887 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.726853 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-credential-socket\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727077 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.726904 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istiod-ca-cert\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727077 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.726935 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-certs\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727077 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.726951 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-token\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727077 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.726987 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dknm2\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-kube-api-access-dknm2\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727281 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727102 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-data\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727281 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-socket\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727281 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727178 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:10.727281 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727218 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-podinfo\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727281 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727248 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-envoy\") pod \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\" (UID: \"d221b8d6-abe7-4f7a-a719-ae7f6404b995\") " Jun 05 16:13:10.727525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727321 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:10.727525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727396 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-data" (OuterVolumeSpecName: "istio-data") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:10.727525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727421 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 16:13:10.727525 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727479 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:10.727673 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727627 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-data\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.727673 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727647 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-socket\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.727673 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727662 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-credential-socket\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.727869 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727677 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istiod-ca-cert\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.727869 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.727689 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-workload-certs\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.729600 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.729573 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-kube-api-access-dknm2" (OuterVolumeSpecName: "kube-api-access-dknm2") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "kube-api-access-dknm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 16:13:10.729709 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.729623 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 16:13:10.729709 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.729647 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-token" (OuterVolumeSpecName: "istio-token") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 16:13:10.729816 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.729731 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d221b8d6-abe7-4f7a-a719-ae7f6404b995" (UID: "d221b8d6-abe7-4f7a-a719-ae7f6404b995"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:10.829199 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.829152 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-token\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.829199 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.829191 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dknm2\" (UniqueName: \"kubernetes.io/projected/d221b8d6-abe7-4f7a-a719-ae7f6404b995-kube-api-access-dknm2\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.829199 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.829202 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-podinfo\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:10.829429 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:10.829211 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d221b8d6-abe7-4f7a-a719-ae7f6404b995-istio-envoy\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:11.055695 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.055609 2579 generic.go:356] "Generic (PLEG): container finished" podID="d221b8d6-abe7-4f7a-a719-ae7f6404b995" containerID="40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917" exitCode=0 Jun 05 16:13:11.055695 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.055659 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" Jun 05 16:13:11.055902 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.055698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" event={"ID":"d221b8d6-abe7-4f7a-a719-ae7f6404b995","Type":"ContainerDied","Data":"40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917"} Jun 05 16:13:11.055902 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.055768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4" event={"ID":"d221b8d6-abe7-4f7a-a719-ae7f6404b995","Type":"ContainerDied","Data":"9a0b3181d98d0013464e2ac3e91f1f0247c94f2aad2c1210e43f92f63501fb6f"} Jun 05 16:13:11.055902 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.055792 2579 scope.go:117] "RemoveContainer" containerID="40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917" Jun 05 16:13:11.065647 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.065626 2579 scope.go:117] "RemoveContainer" containerID="40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917" Jun 05 16:13:11.065913 ip-10-0-129-173 kubenswrapper[2579]: E0605 16:13:11.065895 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917\": container with ID starting with 40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917 not found: ID does not exist" containerID="40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917" Jun 05 16:13:11.066008 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.065922 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917"} err="failed to get container status \"40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917\": rpc error: code = NotFound desc = could not find container \"40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917\": container with ID starting with 40dd8309d95f72823487a876e5bef852c2fc68dd6da2405fffc62cd261864917 not found: ID does not exist" Jun 05 16:13:11.076386 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.076349 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4"] Jun 05 16:13:11.078058 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.078036 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-08a4bd0d-openshift-default-79459ff7b-lfnf4"] Jun 05 16:13:11.408855 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.408776 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw"] Jun 05 16:13:11.409353 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.409328 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d221b8d6-abe7-4f7a-a719-ae7f6404b995" containerName="istio-proxy" Jun 05 16:13:11.409537 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.409521 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d221b8d6-abe7-4f7a-a719-ae7f6404b995" containerName="istio-proxy" Jun 05 16:13:11.409803 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.409781 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d221b8d6-abe7-4f7a-a719-ae7f6404b995" containerName="istio-proxy" Jun 05 16:13:11.414508 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.414489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.416142 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.416115 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-64fcaaf8-openshift-default-dockercfg-zgl4t\"" Jun 05 16:13:11.424928 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.424906 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw"] Jun 05 16:13:11.536619 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-envoy\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536789 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536627 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-data\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536789 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-podinfo\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536789 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62628a42-c98a-45a8-87aa-2f2d239b84c5-istiod-ca-cert\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536928 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-certs\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536928 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-socket\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536928 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlmwt\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-kube-api-access-dlmwt\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.536928 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-token\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.537101 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.536966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-credential-socket\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.637939 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.637898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62628a42-c98a-45a8-87aa-2f2d239b84c5-istiod-ca-cert\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.637939 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.637957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-certs\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.637980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-socket\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlmwt\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-kube-api-access-dlmwt\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-token\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-credential-socket\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-envoy\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-data\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-podinfo\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638378 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-socket\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638449 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638419 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-certs\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638984 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638687 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-credential-socket\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.638984 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.638810 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-data\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.639089 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.639033 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62628a42-c98a-45a8-87aa-2f2d239b84c5-istiod-ca-cert\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.640550 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.640526 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-envoy\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.640947 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.640930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-podinfo\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.656937 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.656911 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-token\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.657098 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.657078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlmwt\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-kube-api-access-dlmwt\") pod \"e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.727048 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.727011 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:11.871328 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.871305 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw"] Jun 05 16:13:11.873693 ip-10-0-129-173 kubenswrapper[2579]: W0605 16:13:11.873667 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62628a42_c98a_45a8_87aa_2f2d239b84c5.slice/crio-bdb80873d327055370accab1412d87e90d00c09e2a59df0f99ae1470cdafa2e1 WatchSource:0}: Error finding container bdb80873d327055370accab1412d87e90d00c09e2a59df0f99ae1470cdafa2e1: Status 404 returned error can't find the container with id bdb80873d327055370accab1412d87e90d00c09e2a59df0f99ae1470cdafa2e1 Jun 05 16:13:11.875722 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.875690 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 16:13:11.875853 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.875786 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 16:13:11.875853 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:11.875817 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 05 16:13:12.063669 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:12.063568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" event={"ID":"62628a42-c98a-45a8-87aa-2f2d239b84c5","Type":"ContainerStarted","Data":"41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169"} Jun 05 16:13:12.063669 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:12.063627 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" event={"ID":"62628a42-c98a-45a8-87aa-2f2d239b84c5","Type":"ContainerStarted","Data":"bdb80873d327055370accab1412d87e90d00c09e2a59df0f99ae1470cdafa2e1"} Jun 05 16:13:12.084716 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:12.084650 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" podStartSLOduration=1.084628923 podStartE2EDuration="1.084628923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:13:12.083142438 +0000 UTC m=+2330.002234546" watchObservedRunningTime="2026-06-05 16:13:12.084628923 +0000 UTC m=+2330.003721033" Jun 05 16:13:12.543736 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:12.543700 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d221b8d6-abe7-4f7a-a719-ae7f6404b995" path="/var/lib/kubelet/pods/d221b8d6-abe7-4f7a-a719-ae7f6404b995/volumes" Jun 05 16:13:12.727872 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:12.727830 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:12.732959 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:12.732934 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:13.069320 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:13.069288 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:13.070195 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:13.070172 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:18.805768 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:18.805723 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw"] Jun 05 16:13:18.806338 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:18.805962 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" podUID="62628a42-c98a-45a8-87aa-2f2d239b84c5" containerName="istio-proxy" containerID="cri-o://41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169" gracePeriod=30 Jun 05 16:13:24.051218 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.051191 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:24.123720 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.123632 2579 generic.go:356] "Generic (PLEG): container finished" podID="62628a42-c98a-45a8-87aa-2f2d239b84c5" containerID="41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169" exitCode=0 Jun 05 16:13:24.123720 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.123678 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" Jun 05 16:13:24.123975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.123722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" event={"ID":"62628a42-c98a-45a8-87aa-2f2d239b84c5","Type":"ContainerDied","Data":"41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169"} Jun 05 16:13:24.123975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.123808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw" event={"ID":"62628a42-c98a-45a8-87aa-2f2d239b84c5","Type":"ContainerDied","Data":"bdb80873d327055370accab1412d87e90d00c09e2a59df0f99ae1470cdafa2e1"} Jun 05 16:13:24.123975 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.123840 2579 scope.go:117] "RemoveContainer" containerID="41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169" Jun 05 16:13:24.135083 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.135057 2579 scope.go:117] "RemoveContainer" containerID="41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169" Jun 05 16:13:24.135678 ip-10-0-129-173 kubenswrapper[2579]: E0605 16:13:24.135660 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169\": container with ID starting with 41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169 not found: ID does not exist" containerID="41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169" Jun 05 16:13:24.135781 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.135686 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169"} err="failed to get container status \"41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169\": rpc error: code = NotFound desc = could not find container \"41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169\": container with ID starting with 41ec24dfd6c573d1091a4ec9cadbf2577aa3b5fab00fc84383974aaa69e4e169 not found: ID does not exist" Jun 05 16:13:24.152029 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152004 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-envoy\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152140 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152050 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62628a42-c98a-45a8-87aa-2f2d239b84c5-istiod-ca-cert\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152140 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152088 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-podinfo\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152140 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152108 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlmwt\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-kube-api-access-dlmwt\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152140 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152123 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-token\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152349 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152209 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-data\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152349 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152237 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-certs\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152349 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152261 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-socket\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152349 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152285 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-credential-socket\") pod \"62628a42-c98a-45a8-87aa-2f2d239b84c5\" (UID: \"62628a42-c98a-45a8-87aa-2f2d239b84c5\") " Jun 05 16:13:24.152551 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152488 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:24.152551 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152510 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62628a42-c98a-45a8-87aa-2f2d239b84c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 16:13:24.152653 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152634 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-data\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.152724 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152654 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62628a42-c98a-45a8-87aa-2f2d239b84c5-istiod-ca-cert\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.152724 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152653 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:24.153016 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152778 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:24.153016 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.152786 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:24.154446 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.154420 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 16:13:24.154532 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.154469 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 16:13:24.154532 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.154514 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-kube-api-access-dlmwt" (OuterVolumeSpecName: "kube-api-access-dlmwt") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "kube-api-access-dlmwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 16:13:24.154607 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.154577 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "62628a42-c98a-45a8-87aa-2f2d239b84c5" (UID: "62628a42-c98a-45a8-87aa-2f2d239b84c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 16:13:24.253524 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253494 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-certs\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.253524 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253521 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-workload-socket\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.253710 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253532 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-credential-socket\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.253710 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253542 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-envoy\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.253710 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253550 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-podinfo\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.253710 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253558 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlmwt\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-kube-api-access-dlmwt\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.253710 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.253566 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62628a42-c98a-45a8-87aa-2f2d239b84c5-istio-token\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jun 05 16:13:24.448540 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.448497 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw"] Jun 05 16:13:24.451859 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.451831 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-64fcaaf8-openshift-default-6689d56d56-4jsxw"] Jun 05 16:13:24.544163 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:24.544129 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62628a42-c98a-45a8-87aa-2f2d239b84c5" path="/var/lib/kubelet/pods/62628a42-c98a-45a8-87aa-2f2d239b84c5/volumes" Jun 05 16:13:35.197527 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:35.197490 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-594c4dc786-n78cq_70189bcd-7c60-4e55-a7ff-343d8e459ba3/nginx/0.log" Jun 05 16:13:36.321849 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:36.321815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cbf6b767-9gt5n_cc100dce-1b78-4137-adfe-0a8970bea4d7/copy-manifests/0.log" Jun 05 16:13:36.328465 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:36.328436 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cbf6b767-9gt5n_cc100dce-1b78-4137-adfe-0a8970bea4d7/manager/0.log" Jun 05 16:13:37.897368 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:37.897331 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-k8sbq_30db186c-ad6f-4964-a13b-88e12c46fdf9/manager/0.log" Jun 05 16:13:38.007249 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:38.007210 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qchx2_aa00fa60-3504-40b4-9ba5-9ff22a99a35a/manager/0.log" Jun 05 16:13:38.227912 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:38.227881 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rsn6f_1bfac722-3686-4b19-a965-d5d3320ef2b4/registry-server/0.log" Jun 05 16:13:38.465448 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:38.465421 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b27f2_12a4a380-972d-4ff3-b13f-3ce3c5f8cf83/limitador/0.log" Jun 05 16:13:38.582363 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:38.582287 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jx8wd_a36de703-c82d-4501-8022-2218f78ae941/manager/0.log" Jun 05 16:13:38.916037 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:38.915957 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hbcwb_eb62c275-fd0c-4d66-98bc-b4644d25d38e/istio-proxy/0.log" Jun 05 16:13:39.373635 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:39.373605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/1.log" Jun 05 16:13:39.710842 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:39.710817 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-589d6fbc4f-q7srj_85847081-1304-405d-a9cf-4d0decc9cab3/router/0.log" Jun 05 16:13:40.383909 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:40.383861 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs_47afd63e-1c6d-4d19-967d-fc8abf69351b/storage-initializer/0.log" Jun 05 16:13:40.390653 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:40.390627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdwnzs_47afd63e-1c6d-4d19-967d-fc8abf69351b/main/0.log" Jun 05 16:13:40.621827 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:40.621799 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gskgn_1266ad83-2183-4bc9-a758-5ce1fa473c40/storage-initializer/0.log" Jun 05 16:13:40.629273 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:40.629246 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-gskgn_1266ad83-2183-4bc9-a758-5ce1fa473c40/main/0.log" Jun 05 16:13:44.709382 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.709350 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kn9td/must-gather-jd79w"] Jun 05 16:13:44.709767 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.709706 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62628a42-c98a-45a8-87aa-2f2d239b84c5" containerName="istio-proxy" Jun 05 16:13:44.709767 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.709716 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62628a42-c98a-45a8-87aa-2f2d239b84c5" containerName="istio-proxy" Jun 05 16:13:44.709855 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.709791 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62628a42-c98a-45a8-87aa-2f2d239b84c5" containerName="istio-proxy" Jun 05 16:13:44.713077 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.713055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:44.714810 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.714787 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kn9td\"/\"openshift-service-ca.crt\"" Jun 05 16:13:44.714938 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.714866 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kn9td\"/\"default-dockercfg-h9tkn\"" Jun 05 16:13:44.714938 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.714866 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kn9td\"/\"kube-root-ca.crt\"" Jun 05 16:13:44.721600 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.721574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kn9td/must-gather-jd79w"] Jun 05 16:13:44.821191 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.821153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4x46\" (UniqueName: \"kubernetes.io/projected/0e2bd4de-234a-4e56-bbbb-eb6574d97331-kube-api-access-q4x46\") pod \"must-gather-jd79w\" (UID: \"0e2bd4de-234a-4e56-bbbb-eb6574d97331\") " pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:44.821383 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.821199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0e2bd4de-234a-4e56-bbbb-eb6574d97331-must-gather-output\") pod \"must-gather-jd79w\" (UID: \"0e2bd4de-234a-4e56-bbbb-eb6574d97331\") " pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:44.921813 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.921773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4x46\" (UniqueName: \"kubernetes.io/projected/0e2bd4de-234a-4e56-bbbb-eb6574d97331-kube-api-access-q4x46\") pod \"must-gather-jd79w\" (UID: \"0e2bd4de-234a-4e56-bbbb-eb6574d97331\") " pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:44.921813 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.921823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0e2bd4de-234a-4e56-bbbb-eb6574d97331-must-gather-output\") pod \"must-gather-jd79w\" (UID: \"0e2bd4de-234a-4e56-bbbb-eb6574d97331\") " pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:44.922207 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.922188 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0e2bd4de-234a-4e56-bbbb-eb6574d97331-must-gather-output\") pod \"must-gather-jd79w\" (UID: \"0e2bd4de-234a-4e56-bbbb-eb6574d97331\") " pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:44.930727 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:44.930700 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4x46\" (UniqueName: \"kubernetes.io/projected/0e2bd4de-234a-4e56-bbbb-eb6574d97331-kube-api-access-q4x46\") pod \"must-gather-jd79w\" (UID: \"0e2bd4de-234a-4e56-bbbb-eb6574d97331\") " pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:45.035427 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:45.035338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kn9td/must-gather-jd79w" Jun 05 16:13:45.172455 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:45.172420 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kn9td/must-gather-jd79w"] Jun 05 16:13:45.175616 ip-10-0-129-173 kubenswrapper[2579]: W0605 16:13:45.175584 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e2bd4de_234a_4e56_bbbb_eb6574d97331.slice/crio-36aba064bcbc4336168e8fc7497e31c6b8a8c81cacb9797aa5ca211ec60708ef WatchSource:0}: Error finding container 36aba064bcbc4336168e8fc7497e31c6b8a8c81cacb9797aa5ca211ec60708ef: Status 404 returned error can't find the container with id 36aba064bcbc4336168e8fc7497e31c6b8a8c81cacb9797aa5ca211ec60708ef Jun 05 16:13:45.177427 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:45.177409 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 16:13:45.225842 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:45.225806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn9td/must-gather-jd79w" event={"ID":"0e2bd4de-234a-4e56-bbbb-eb6574d97331","Type":"ContainerStarted","Data":"36aba064bcbc4336168e8fc7497e31c6b8a8c81cacb9797aa5ca211ec60708ef"} Jun 05 16:13:46.234196 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:46.234098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn9td/must-gather-jd79w" event={"ID":"0e2bd4de-234a-4e56-bbbb-eb6574d97331","Type":"ContainerStarted","Data":"7a21c865734e5013b19266785f190d774aafdabce643e8aafa219563612d4365"} Jun 05 16:13:46.234196 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:46.234141 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn9td/must-gather-jd79w" event={"ID":"0e2bd4de-234a-4e56-bbbb-eb6574d97331","Type":"ContainerStarted","Data":"b2bd068c5e51f6a6d623d5dbc148252059e69c93ce165f58bb11db00e0acaf02"} Jun 05 16:13:46.249698 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:46.249634 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kn9td/must-gather-jd79w" podStartSLOduration=1.448674427 podStartE2EDuration="2.249616669s" totalImagesPullingTime="800.942242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 16:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:13:46.247471023 +0000 UTC m=+2364.166563144" watchObservedRunningTime="2026-06-05 16:13:46.249616669 +0000 UTC m=+2364.168708800" Jun 05 16:13:47.993384 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:47.993348 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zltth_0c96334d-a9ef-4c89-8977-3755b9e40b35/global-pull-secret-syncer/0.log" Jun 05 16:13:48.108366 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:48.108335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9ffjc_fe3f1993-9f70-4234-b0d8-978332c951a7/konnectivity-agent/0.log" Jun 05 16:13:48.153725 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:48.153695 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-173.ec2.internal_a8b459a3fd9ef4dc8ea70f1ef3af0ad8/haproxy/0.log" Jun 05 16:13:53.365601 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:53.365521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-k8sbq_30db186c-ad6f-4964-a13b-88e12c46fdf9/manager/0.log" Jun 05 16:13:53.389331 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:53.389266 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qchx2_aa00fa60-3504-40b4-9ba5-9ff22a99a35a/manager/0.log" Jun 05 16:13:53.456704 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:53.456674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rsn6f_1bfac722-3686-4b19-a965-d5d3320ef2b4/registry-server/0.log" Jun 05 16:13:53.561780 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:53.561734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b27f2_12a4a380-972d-4ff3-b13f-3ce3c5f8cf83/limitador/0.log" Jun 05 16:13:53.648336 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:53.648251 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jx8wd_a36de703-c82d-4501-8022-2218f78ae941/manager/0.log" Jun 05 16:13:55.664088 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.664042 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s9zw9_06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d/node-exporter/0.log" Jun 05 16:13:55.690168 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.690098 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s9zw9_06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d/kube-rbac-proxy/0.log" Jun 05 16:13:55.714855 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.714830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s9zw9_06a5fd9b-294b-4ec3-be77-0dfd7a5ed73d/init-textfile/0.log" Jun 05 16:13:55.851615 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.851530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/1.log" Jun 05 16:13:55.865787 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.865731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/prometheus/0.log" Jun 05 16:13:55.890848 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.890821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/config-reloader/0.log" Jun 05 16:13:55.922676 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.922648 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/thanos-sidecar/0.log" Jun 05 16:13:55.950303 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.950274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/kube-rbac-proxy-web/0.log" Jun 05 16:13:55.977602 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:55.977563 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/kube-rbac-proxy/0.log" Jun 05 16:13:56.004249 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:56.004218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/kube-rbac-proxy-thanos/0.log" Jun 05 16:13:56.042692 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:56.042647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7b56df72-e22e-4831-b6ff-d7d6b131faf5/init-config-reloader/0.log" Jun 05 16:13:56.131626 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:56.131534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-9pnd2_959b5806-fab7-4e4c-927b-49c535d4b4d5/prometheus-operator-admission-webhook/0.log" Jun 05 16:13:58.548876 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:58.548838 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/1.log" Jun 05 16:13:58.555950 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:58.555912 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-nzvnd_8da5c00e-4dec-4658-9e5e-da9689963c80/console-operator/2.log" Jun 05 16:13:59.097093 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:59.097062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64db7f5cb9-z2trv_322798c4-2c91-4194-87e6-267ca8937d27/console/0.log" Jun 05 16:13:59.130584 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:13:59.130553 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-plk4m_43add59e-15f1-4cae-a663-26896aa9c6dc/download-server/0.log" Jun 05 16:14:00.685313 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.685271 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g"] Jun 05 16:14:00.691366 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.691337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.698386 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.698354 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g"] Jun 05 16:14:00.817242 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.817195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-lib-modules\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.817412 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.817266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-proc\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.817412 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.817329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-podres\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.817412 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.817373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzl7h\" (UniqueName: \"kubernetes.io/projected/3ec0dc78-2240-4ff8-a6be-762ce6948893-kube-api-access-bzl7h\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.817521 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.817434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-sys\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918589 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-lib-modules\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918819 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918598 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-proc\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918819 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-podres\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918819 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzl7h\" (UniqueName: \"kubernetes.io/projected/3ec0dc78-2240-4ff8-a6be-762ce6948893-kube-api-access-bzl7h\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918819 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-sys\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918819 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918789 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-proc\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.918819 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-lib-modules\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.919054 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918840 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-sys\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.919054 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.918856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ec0dc78-2240-4ff8-a6be-762ce6948893-podres\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:00.925824 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:00.925794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzl7h\" (UniqueName: \"kubernetes.io/projected/3ec0dc78-2240-4ff8-a6be-762ce6948893-kube-api-access-bzl7h\") pod \"perf-node-gather-daemonset-5gg7g\" (UID: \"3ec0dc78-2240-4ff8-a6be-762ce6948893\") " pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:01.009278 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.009235 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:01.179851 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.179814 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g"] Jun 05 16:14:01.196628 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.196588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6dmmw_47d21d45-c80a-49d3-ac41-f886c4daffb0/dns/0.log" Jun 05 16:14:01.219318 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.219090 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6dmmw_47d21d45-c80a-49d3-ac41-f886c4daffb0/kube-rbac-proxy/0.log" Jun 05 16:14:01.316698 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.316663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8tct_2b32239f-f857-49a6-a92d-e90b5d020a90/dns-node-resolver/0.log" Jun 05 16:14:01.343218 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.343181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" event={"ID":"3ec0dc78-2240-4ff8-a6be-762ce6948893","Type":"ContainerStarted","Data":"e68881ec3c3d929ad6ee740cc9c524bcf98138d0a358077cb3cd7af57862a31f"} Jun 05 16:14:01.343382 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.343237 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" event={"ID":"3ec0dc78-2240-4ff8-a6be-762ce6948893","Type":"ContainerStarted","Data":"90e5efbe67ad047e9dabdb4babebb487e661fa686450129879eaab439e2756bb"} Jun 05 16:14:01.343382 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.343262 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:01.357520 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.357456 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" podStartSLOduration=1.357433988 podStartE2EDuration="1.357433988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 16:14:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 16:14:01.356037817 +0000 UTC m=+2379.275129927" watchObservedRunningTime="2026-06-05 16:14:01.357433988 +0000 UTC m=+2379.276526097" Jun 05 16:14:01.862134 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.862094 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59cd596fcd-vdq2r_e76b199d-f15a-414e-8e91-77ad76ee03ed/registry/0.log" Jun 05 16:14:01.874514 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.874484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59cd596fcd-vdq2r_e76b199d-f15a-414e-8e91-77ad76ee03ed/registry/1.log" Jun 05 16:14:01.918889 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:01.918858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-llg2l_4948a870-b955-4925-b7df-f7633aeafb1f/node-ca/0.log" Jun 05 16:14:02.844392 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:02.844359 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hbcwb_eb62c275-fd0c-4d66-98bc-b4644d25d38e/istio-proxy/0.log" Jun 05 16:14:03.012576 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:03.012548 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/0.log" Jun 05 16:14:03.053744 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:03.053706 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/1.log" Jun 05 16:14:03.232506 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:03.232475 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-589d6fbc4f-q7srj_85847081-1304-405d-a9cf-4d0decc9cab3/router/0.log" Jun 05 16:14:03.864094 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:03.864053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cflnl_a659e16b-8ef8-4c28-9a8a-7c3c1bc9a9e6/serve-healthcheck-canary/0.log" Jun 05 16:14:04.450010 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:04.449972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zn98_68081149-2407-42fb-b80e-4ec9db98f708/kube-rbac-proxy/0.log" Jun 05 16:14:04.471279 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:04.471254 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zn98_68081149-2407-42fb-b80e-4ec9db98f708/exporter/0.log" Jun 05 16:14:04.491699 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:04.491674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9zn98_68081149-2407-42fb-b80e-4ec9db98f708/extractor/0.log" Jun 05 16:14:06.737692 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:06.737663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-594c4dc786-n78cq_70189bcd-7c60-4e55-a7ff-343d8e459ba3/nginx/0.log" Jun 05 16:14:07.253893 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:07.253860 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cbf6b767-9gt5n_cc100dce-1b78-4137-adfe-0a8970bea4d7/manager/0.log" Jun 05 16:14:07.273837 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:07.273810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56cbf6b767-9gt5n_cc100dce-1b78-4137-adfe-0a8970bea4d7/copy-manifests/0.log" Jun 05 16:14:07.360824 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:07.360791 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kn9td/perf-node-gather-daemonset-5gg7g" Jun 05 16:14:08.868911 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:08.868846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cf49c9d64-dzscx_a48bbaa1-a6d9-4913-8320-9f911eba8ead/manager/0.log" Jun 05 16:14:13.675367 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:13.675332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hbcwb_eb62c275-fd0c-4d66-98bc-b4644d25d38e/istio-proxy/0.log" Jun 05 16:14:13.808119 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:13.808079 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/0.log" Jun 05 16:14:13.853502 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:13.853466 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/1.log" Jun 05 16:14:14.016725 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:14.016682 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-589d6fbc4f-q7srj_85847081-1304-405d-a9cf-4d0decc9cab3/router/0.log" Jun 05 16:14:14.818325 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:14.818284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-br29h_ef3ada5e-8af7-4d56-a76c-3639a4f3836c/kube-storage-version-migrator-operator/1.log" Jun 05 16:14:14.819024 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:14.818657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-br29h_ef3ada5e-8af7-4d56-a76c-3639a4f3836c/kube-storage-version-migrator-operator/0.log" Jun 05 16:14:15.146415 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:15.146340 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hbcwb_eb62c275-fd0c-4d66-98bc-b4644d25d38e/istio-proxy/0.log" Jun 05 16:14:15.275889 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:15.275781 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/0.log" Jun 05 16:14:15.326699 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:15.326651 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/1.log" Jun 05 16:14:15.490555 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:15.490523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-589d6fbc4f-q7srj_85847081-1304-405d-a9cf-4d0decc9cab3/router/0.log" Jun 05 16:14:15.999004 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:15.998963 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/kube-multus-additional-cni-plugins/0.log" Jun 05 16:14:16.020408 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.020381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/egress-router-binary-copy/0.log" Jun 05 16:14:16.042379 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.042338 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/cni-plugins/0.log" Jun 05 16:14:16.068129 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.068102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/bond-cni-plugin/0.log" Jun 05 16:14:16.093562 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.093530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/routeoverride-cni/0.log" Jun 05 16:14:16.115204 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.115177 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/whereabouts-cni-bincopy/0.log" Jun 05 16:14:16.135494 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.135469 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-847rs_2dde1b38-29b4-43b1-86ef-d3a73b2ec6b6/whereabouts-cni/0.log" Jun 05 16:14:16.514738 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.514706 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mznbg_02f11721-7bdd-4820-80b1-873f4d5d3257/kube-multus/0.log" Jun 05 16:14:16.638173 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.638133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5gjm_a31ab34b-a195-4e7a-bccb-93cc46162468/network-metrics-daemon/0.log" Jun 05 16:14:16.661351 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:16.661304 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w5gjm_a31ab34b-a195-4e7a-bccb-93cc46162468/kube-rbac-proxy/0.log" Jun 05 16:14:17.072998 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.072933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795hbcwb_eb62c275-fd0c-4d66-98bc-b4644d25d38e/istio-proxy/0.log" Jun 05 16:14:17.203922 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.203890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/0.log" Jun 05 16:14:17.246507 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.246466 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6q92n_e82d232c-a59f-43e6-9955-6d65072b628e/istio-proxy/1.log" Jun 05 16:14:17.403919 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.403831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-589d6fbc4f-q7srj_85847081-1304-405d-a9cf-4d0decc9cab3/router/0.log" Jun 05 16:14:17.667128 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.667034 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-controller/0.log" Jun 05 16:14:17.687039 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.687007 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/1.log" Jun 05 16:14:17.687201 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.687065 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovn-acl-logging/0.log" Jun 05 16:14:17.706795 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.706720 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/kube-rbac-proxy-node/0.log" Jun 05 16:14:17.727161 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.727127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 16:14:17.746945 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.746918 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/northd/0.log" Jun 05 16:14:17.767902 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.767877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/nbdb/0.log" Jun 05 16:14:17.790392 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.790365 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/sbdb/0.log" Jun 05 16:14:17.840927 ip-10-0-129-173 kubenswrapper[2579]: I0605 16:14:17.840898 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g8dcq_3927e035-69f3-46fc-9786-3450d72d0281/ovnkube-controller/0.log"