Jun 10 17:28:33.699717 ip-10-0-133-83 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 17:28:33.699733 ip-10-0-133-83 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 17:28:33.699742 ip-10-0-133-83 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 17:28:33.699940 ip-10-0-133-83 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 17:28:45.218218 ip-10-0-133-83 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 17:28:45.218234 ip-10-0-133-83 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6ea8d5ead23247bda2abf356e423b40a -- Jun 10 17:31:15.563936 ip-10-0-133-83 systemd[1]: Starting Kubernetes Kubelet... Jun 10 17:31:15.921530 ip-10-0-133-83 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 17:31:15.921530 ip-10-0-133-83 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 17:31:15.921530 ip-10-0-133-83 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 17:31:15.921530 ip-10-0-133-83 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 17:31:15.921530 ip-10-0-133-83 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 17:31:15.922373 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.922294 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 17:31:15.928284 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928267 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:31:15.928284 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928282 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928287 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928291 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928295 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928297 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928300 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928307 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928310 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928313 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928315 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928318 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928320 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928323 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928325 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928327 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928330 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928332 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928334 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928337 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:31:15.928344 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928339 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928341 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928344 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928346 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928349 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928352 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928355 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928358 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928360 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928362 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928365 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928369 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928372 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928374 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928377 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928379 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928382 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928385 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928388 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928390 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:31:15.928794 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928392 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928395 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928397 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928401 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928403 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928405 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928407 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928410 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928412 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928414 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928417 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928419 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928421 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928433 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928436 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928439 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928442 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928445 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928447 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928450 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:31:15.929292 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928452 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928455 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928457 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928459 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928462 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928464 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928466 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928469 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928471 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928473 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928477 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928480 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928483 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928485 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928487 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928490 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928492 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928494 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928497 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928499 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:31:15.929773 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928501 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928504 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928506 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928508 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928511 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928514 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928517 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928519 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928522 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928524 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928527 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928529 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928531 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928534 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928536 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928538 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928541 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928545 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.928548 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929245 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:31:15.930223 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929251 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929254 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929257 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929260 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929263 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929266 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929270 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929274 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929277 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929280 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929282 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929285 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929287 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929289 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929292 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929295 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929298 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929301 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929304 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929307 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:31:15.930703 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929310 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929313 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929316 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929319 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929321 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929324 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929326 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929329 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929331 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929334 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929336 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929339 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929341 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929343 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929346 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929348 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929350 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929353 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929356 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:31:15.931194 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929358 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929360 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929363 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929366 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929368 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929370 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929373 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929376 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929380 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929382 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929385 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929388 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929391 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929394 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929396 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929398 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929401 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929403 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929406 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:31:15.931683 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929408 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929411 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929413 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929416 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929418 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929420 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929423 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929425 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929427 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929432 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929435 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929438 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929442 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929444 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929447 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929450 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929452 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929454 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929457 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929459 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:31:15.932134 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929461 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929464 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929466 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929469 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929472 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929474 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929477 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929479 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929482 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929484 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929487 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929489 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929491 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929494 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929496 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929498 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929501 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929503 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929506 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:31:15.932620 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929508 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929880 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929885 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929887 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929890 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929892 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929895 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929898 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929901 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929903 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929906 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929909 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929911 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929913 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929916 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929919 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929921 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929924 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929927 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929929 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:31:15.933072 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929932 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929934 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929936 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929939 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929941 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929944 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929946 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929948 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929951 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929955 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929959 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929962 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929964 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929967 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929970 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929973 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929975 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929978 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929986 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929989 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:31:15.933537 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929991 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929993 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929996 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.929998 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930001 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930003 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930006 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930008 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930011 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930013 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930015 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930018 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930020 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930023 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930026 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930028 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930030 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930033 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930035 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:31:15.934003 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930037 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930040 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930042 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930044 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930047 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930049 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930052 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930054 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930057 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930060 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930064 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930070 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930074 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930077 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930079 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930082 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930085 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930088 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930090 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:31:15.934514 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930093 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930096 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930098 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930101 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930103 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930106 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930109 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930111 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930114 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930116 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930119 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930121 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930124 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930126 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930128 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930130 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930133 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930135 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930137 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930140 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:31:15.935023 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930142 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930144 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930228 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930238 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930248 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930252 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930257 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930260 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930264 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930268 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930271 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930274 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930277 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930282 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930285 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930288 2580 flags.go:64] FLAG: --cgroup-root="" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930291 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930294 2580 flags.go:64] FLAG: --client-ca-file="" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930297 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930299 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930304 2580 flags.go:64] FLAG: --cluster-domain="" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930306 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930309 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930312 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 17:31:15.935490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930315 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930319 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930321 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930324 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930327 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930330 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930332 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930335 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930338 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930340 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930344 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930347 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930350 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930353 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930356 2580 flags.go:64] FLAG: --enable-server="true" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930360 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930364 2580 flags.go:64] FLAG: --event-burst="100" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930367 2580 flags.go:64] FLAG: --event-qps="50" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930370 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930372 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930375 2580 flags.go:64] FLAG: --eviction-hard="" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930381 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930384 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930387 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930389 2580 flags.go:64] FLAG: --eviction-soft="" Jun 10 17:31:15.936050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930392 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930395 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930398 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930401 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930404 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930406 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930409 2580 flags.go:64] FLAG: --feature-gates="" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930413 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930416 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930418 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930421 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930424 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930427 2580 flags.go:64] FLAG: --help="false" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930430 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-133-83.ec2.internal" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930433 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930436 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930438 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930442 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930445 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930448 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930451 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930454 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930457 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 17:31:15.936682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930460 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930463 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930465 2580 flags.go:64] FLAG: --kube-reserved="" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930468 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930471 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930475 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930477 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930480 2580 flags.go:64] FLAG: --lock-file="" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930483 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930485 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930488 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930493 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930496 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930498 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930501 2580 flags.go:64] FLAG: --logging-format="text" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930503 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930506 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930509 2580 flags.go:64] FLAG: --manifest-url="" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930512 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930516 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930519 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930523 2580 flags.go:64] FLAG: --max-pods="110" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930526 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930528 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930531 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 17:31:15.937246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930534 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930537 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930539 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930542 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930549 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930552 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930554 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930557 2580 flags.go:64] FLAG: --pod-cidr="" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930561 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930566 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930568 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930571 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930575 2580 flags.go:64] FLAG: --port="10250" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930578 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930581 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04e9774b17aebe612" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930584 2580 flags.go:64] FLAG: --qos-reserved="" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930586 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930589 2580 flags.go:64] FLAG: --register-node="true" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930592 2580 flags.go:64] FLAG: --register-with-taints="" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930596 2580 flags.go:64] FLAG: --registry-burst="10" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930598 2580 flags.go:64] FLAG: --registry-qps="5" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930601 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930603 2580 flags.go:64] FLAG: --reserved-memory="" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930607 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930610 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 17:31:15.937845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930613 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930615 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930618 2580 flags.go:64] FLAG: --runonce="false" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930620 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930623 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930626 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930629 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930631 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930634 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930637 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930656 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930662 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930666 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930670 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930673 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930676 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930679 2580 flags.go:64] FLAG: --system-cgroups="" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930682 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930687 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930691 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930694 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930699 2580 flags.go:64] FLAG: --tls-min-version="" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930701 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930704 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930707 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 17:31:15.938520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930710 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930713 2580 flags.go:64] FLAG: --v="2" Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930717 2580 flags.go:64] FLAG: --version="false" Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930722 2580 flags.go:64] FLAG: --vmodule="" Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930725 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.930728 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930861 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930865 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930868 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930871 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930874 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930877 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930879 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930882 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930884 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930887 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930889 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930893 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930895 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930898 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930900 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:31:15.939145 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930902 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930905 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930907 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930910 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930913 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930917 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930919 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930922 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930924 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930927 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930929 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930931 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930934 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930936 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930939 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930941 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930944 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930947 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930949 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930951 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:31:15.939665 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930954 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930957 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930959 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930962 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930964 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930966 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930969 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930971 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930975 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930978 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930981 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930983 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930985 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930988 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930990 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930993 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930996 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.930999 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931002 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:31:15.940162 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931006 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931008 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931011 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931014 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931017 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931020 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931022 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931025 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931028 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931031 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931033 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931037 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931040 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931043 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931045 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931047 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931050 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931052 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931054 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:31:15.940904 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931057 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931059 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931063 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931065 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931067 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931070 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931072 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931075 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931077 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931080 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931082 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931086 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931088 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931091 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931093 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931096 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931098 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931101 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931103 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931105 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:31:15.941384 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931108 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931110 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931114 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931117 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931120 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.931123 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.931128 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.938410 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.938427 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.939249 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.939264 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939331 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939336 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939340 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:31:15.941907 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939343 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939346 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939348 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939351 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939353 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939356 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939359 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939362 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939364 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939367 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939369 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939372 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939374 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939377 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939381 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939384 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939387 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939390 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939393 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939395 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:31:15.942245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939398 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939401 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939403 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939405 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939408 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939410 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939419 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939423 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939425 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939428 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939430 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939432 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939435 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939437 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939440 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939442 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939445 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939447 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939450 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939452 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:31:15.942734 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939454 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939457 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939459 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939462 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939464 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939467 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939469 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939472 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939474 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939478 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939482 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939485 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939487 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939489 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939492 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939494 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939496 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939500 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:31:15.943201 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939504 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939512 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939514 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939517 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939519 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939522 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939524 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939526 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939529 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939531 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939534 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939536 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939538 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939540 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939543 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939545 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939548 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939550 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939552 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939554 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:31:15.943632 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939557 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939560 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939562 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939565 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939567 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939570 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939572 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939574 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939577 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939579 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939582 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939584 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939587 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939589 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939597 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939599 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939602 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:31:15.944152 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939604 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.939609 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939777 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939783 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939786 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939788 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939791 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939794 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939796 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939799 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939802 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939804 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939807 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939809 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939812 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 17:31:15.944561 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939816 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939819 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939822 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939825 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939828 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939831 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939833 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939837 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939840 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939843 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939845 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939848 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939851 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939853 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939856 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939863 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939866 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939868 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939871 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 17:31:15.945036 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939873 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939875 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939878 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939880 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939883 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939885 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939887 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939889 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939892 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939894 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939896 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939899 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939901 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939903 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939906 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939908 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939911 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939913 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939916 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939918 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 17:31:15.945477 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939921 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939923 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939931 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939933 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939936 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939939 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939941 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939943 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939946 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.939986 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942134 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942260 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942265 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942270 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942276 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942279 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942282 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942286 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942289 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942292 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 17:31:15.945952 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942295 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942298 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942301 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942303 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942306 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942308 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942311 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942313 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942316 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942319 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942322 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942325 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942327 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942330 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942333 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942335 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942338 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942340 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942343 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942346 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 17:31:15.946402 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942348 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942351 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942353 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942358 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942360 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942363 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:15.942366 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.942371 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.942523 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.944733 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.946153 2580 server.go:1019] "Starting client certificate rotation" Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.946254 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 17:31:15.946884 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.946282 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 17:31:15.948521 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.948503 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 17:31:15.949922 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.949895 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 17:31:15.964086 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.964069 2580 log.go:25] "Validated CRI v1 runtime API" Jun 10 17:31:15.966839 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.966824 2580 log.go:25] "Validated CRI v1 image API" Jun 10 17:31:15.968345 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.968330 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 17:31:15.970447 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.970425 2580 fs.go:135] Filesystem UUIDs: map[03146bf5-1f2f-4cd9-88ad-f7b9d4833e78:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7eec8852-6725-4115-b068-da5ee0a99303:/dev/nvme0n1p3] Jun 10 17:31:15.970520 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.970444 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 17:31:15.972081 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.972065 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 17:31:15.976739 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.976608 2580 manager.go:216] Machine: {Timestamp:2026-06-10 17:31:15.974907208 +0000 UTC m=+0.297075317 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202352 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec209befacd75246d734386a97579dc3 SystemUUID:ec209bef-acd7-5246-d734-386a97579dc3 BootID:6ea8d5ea-d232-47bd-a2ab-f356e423b40a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:02:d8:e7:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:02:d8:e7:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:3c:db:2b:ff:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 17:31:15.976739 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.976731 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 17:31:15.976849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.976840 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 17:31:15.979594 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.979572 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 17:31:15.979734 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.979598 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 17:31:15.980331 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.980321 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 17:31:15.980362 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.980334 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 17:31:15.980362 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.980341 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 17:31:15.980927 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.980917 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 17:31:15.982018 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.982009 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 17:31:15.985174 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985162 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 10 17:31:15.985446 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985437 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 17:31:15.985477 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985467 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 10 17:31:15.985509 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985478 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 17:31:15.985509 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985488 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 17:31:15.985509 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985497 2580 kubelet.go:398] "Adding apiserver pod source" Jun 10 17:31:15.985509 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985506 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 17:31:15.985852 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985839 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 17:31:15.985895 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.985860 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 17:31:15.987608 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.987589 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 17:31:15.989194 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.989178 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 17:31:15.989267 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.989216 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 17:31:15.990343 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990294 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 17:31:15.990405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990351 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 17:31:15.990405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990361 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 17:31:15.990405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990371 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 17:31:15.990405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990382 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 17:31:15.990405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990390 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 17:31:15.990405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990402 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 17:31:15.990569 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990410 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 17:31:15.990569 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990419 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 17:31:15.990569 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990429 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 17:31:15.990569 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990452 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 17:31:15.990569 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.990460 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 17:31:15.991803 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.991790 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 17:31:15.991834 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.991805 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 17:31:15.993788 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.993769 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 17:31:15.993843 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:15.993823 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 17:31:15.993958 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:15.993942 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 17:31:15.995153 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.995140 2580 server.go:1268] "Started kubelet" Jun 10 17:31:15.995276 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.995238 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 17:31:15.995336 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.995291 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 17:31:15.995837 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.995819 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 17:31:15.996817 ip-10-0-133-83 systemd[1]: Started Kubernetes Kubelet. Jun 10 17:31:15.997814 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.997552 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 17:31:15.998106 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:15.998094 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 10 17:31:16.000081 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:15.999249 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-83.ec2.internal.18b7c88ac5a25b13 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-83.ec2.internal,UID:ip-10-0-133-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-83.ec2.internal,},FirstTimestamp:2026-06-10 17:31:15.995114259 +0000 UTC m=+0.317282370,LastTimestamp:2026-06-10 17:31:15.995114259 +0000 UTC m=+0.317282370,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-83.ec2.internal,}" Jun 10 17:31:16.001818 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.001798 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 17:31:16.003696 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.003681 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 17:31:16.003765 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.003753 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 17:31:16.003826 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.003769 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.004579 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004560 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 17:31:16.004682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004585 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 17:31:16.004682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004600 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 17:31:16.004682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004611 2580 factory.go:55] Registering systemd factory Jun 10 17:31:16.004682 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004628 2580 factory.go:223] Registration of the systemd container factory successfully Jun 10 17:31:16.004819 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004687 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 10 17:31:16.004819 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004696 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 10 17:31:16.004894 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004867 2580 factory.go:153] Registering CRI-O factory Jun 10 17:31:16.004894 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004881 2580 factory.go:223] Registration of the crio container factory successfully Jun 10 17:31:16.004956 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004924 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 17:31:16.004956 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004941 2580 factory.go:103] Registering Raw factory Jun 10 17:31:16.004956 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.004954 2580 manager.go:1196] Started watching for new ooms in manager Jun 10 17:31:16.005529 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.005506 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 17:31:16.005667 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.005622 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 17:31:16.006246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.006224 2580 manager.go:349] Starting recovery of all containers Jun 10 17:31:16.017195 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.017179 2580 manager.go:354] Recovery completed Jun 10 17:31:16.018539 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.018514 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-psk9k" Jun 10 17:31:16.021500 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.021489 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.023622 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.023605 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.023710 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.023660 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.023710 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.023675 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.023796 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.023732 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-psk9k" Jun 10 17:31:16.024248 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024232 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 17:31:16.024248 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024246 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 17:31:16.024248 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024247 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.024387 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024262 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 10 17:31:16.024923 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024911 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.024982 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024959 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.024982 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.024974 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.025532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.025520 2580 policy_none.go:49] "None policy: Start" Jun 10 17:31:16.025586 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.025535 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 17:31:16.025586 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.025545 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 17:31:16.026412 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.026401 2580 policy_none.go:47] "Start" Jun 10 17:31:16.062276 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062261 2580 manager.go:337] "Starting Device Plugin manager" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.062327 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062338 2580 server.go:87] "Starting device plugin registration server" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062663 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062697 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062797 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062875 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.062884 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.063419 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 17:31:16.074352 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.063460 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.075104 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.075078 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 17:31:16.076354 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.076337 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 17:31:16.076439 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.076374 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 17:31:16.076439 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.076395 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 17:31:16.076439 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.076435 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 17:31:16.078312 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.078273 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:31:16.163724 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.163682 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.164733 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.164715 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.164810 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.164748 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.164810 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.164760 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.164810 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.164785 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.173298 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.173258 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.173298 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.173279 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-83.ec2.internal\": node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.177153 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.177134 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal"] Jun 10 17:31:16.177214 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.177197 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.178374 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.178356 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.178438 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.178385 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.178438 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.178397 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.179446 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.179435 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.179548 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.179536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.179583 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.179562 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.180072 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.180058 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.180132 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.180082 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.180132 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.180063 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.180322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.180309 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.180369 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.180324 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.180369 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.180357 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.181574 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.181553 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.181675 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.181596 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 17:31:16.182608 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.182591 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jun 10 17:31:16.182715 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.182624 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 17:31:16.182715 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.182635 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jun 10 17:31:16.200239 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.200219 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.206461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.206429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69660b4a95ee98b363a3fafda40c0f19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"69660b4a95ee98b363a3fafda40c0f19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.206518 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.206470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69660b4a95ee98b363a3fafda40c0f19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"69660b4a95ee98b363a3fafda40c0f19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.206518 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.206504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86ea6e526d0e13d9297ab97bb88e6cf7-config\") pod \"kube-apiserver-proxy-ip-10-0-133-83.ec2.internal\" (UID: \"86ea6e526d0e13d9297ab97bb88e6cf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.219258 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.219243 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-83.ec2.internal\" not found" node="ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.225538 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.225523 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-83.ec2.internal\" not found" node="ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.300306 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.300273 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.306653 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.306620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69660b4a95ee98b363a3fafda40c0f19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"69660b4a95ee98b363a3fafda40c0f19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.306734 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.306660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69660b4a95ee98b363a3fafda40c0f19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"69660b4a95ee98b363a3fafda40c0f19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.306734 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.306681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86ea6e526d0e13d9297ab97bb88e6cf7-config\") pod \"kube-apiserver-proxy-ip-10-0-133-83.ec2.internal\" (UID: \"86ea6e526d0e13d9297ab97bb88e6cf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.306734 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.306723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86ea6e526d0e13d9297ab97bb88e6cf7-config\") pod \"kube-apiserver-proxy-ip-10-0-133-83.ec2.internal\" (UID: \"86ea6e526d0e13d9297ab97bb88e6cf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.306826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.306729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69660b4a95ee98b363a3fafda40c0f19-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"69660b4a95ee98b363a3fafda40c0f19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.306826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.306729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69660b4a95ee98b363a3fafda40c0f19-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"69660b4a95ee98b363a3fafda40c0f19\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.400835 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.400785 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.501601 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.501514 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.523976 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.523955 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.530813 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.530794 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jun 10 17:31:16.601837 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.601800 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.702337 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.702296 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.802961 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.802878 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.903405 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:16.903374 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:16.933608 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.933584 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:31:16.945522 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.945497 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 17:31:16.945683 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.945661 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 17:31:16.945731 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.945682 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 17:31:16.967361 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:16.967331 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:31:17.004358 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:17.004327 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jun 10 17:31:17.026617 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.026579 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 17:26:16 +0000 UTC" deadline="2028-01-12 07:20:50.620725017 +0000 UTC" Jun 10 17:31:17.026617 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.026606 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13933h49m33.594122041s" Jun 10 17:31:17.029029 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:17.029003 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69660b4a95ee98b363a3fafda40c0f19.slice/crio-d2679c9d025ad27dc9b81248b51e7c051ddf3113d4bdcf28bd84922d0e33288d WatchSource:0}: Error finding container d2679c9d025ad27dc9b81248b51e7c051ddf3113d4bdcf28bd84922d0e33288d: Status 404 returned error can't find the container with id d2679c9d025ad27dc9b81248b51e7c051ddf3113d4bdcf28bd84922d0e33288d Jun 10 17:31:17.029452 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:17.029431 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ea6e526d0e13d9297ab97bb88e6cf7.slice/crio-d9b90daa623c7939d465e94b200e9c6cf6184c5436b0b12fbe2229b130ab6d0a WatchSource:0}: Error finding container d9b90daa623c7939d465e94b200e9c6cf6184c5436b0b12fbe2229b130ab6d0a: Status 404 returned error can't find the container with id d9b90daa623c7939d465e94b200e9c6cf6184c5436b0b12fbe2229b130ab6d0a Jun 10 17:31:17.034494 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.034480 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:31:17.044065 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.044048 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:31:17.079940 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.079852 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" event={"ID":"86ea6e526d0e13d9297ab97bb88e6cf7","Type":"ContainerStarted","Data":"d9b90daa623c7939d465e94b200e9c6cf6184c5436b0b12fbe2229b130ab6d0a"} Jun 10 17:31:17.080946 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.080923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" event={"ID":"69660b4a95ee98b363a3fafda40c0f19","Type":"ContainerStarted","Data":"d2679c9d025ad27dc9b81248b51e7c051ddf3113d4bdcf28bd84922d0e33288d"} Jun 10 17:31:17.104157 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.104137 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jun 10 17:31:17.114696 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.114674 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 17:31:17.115830 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.115817 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jun 10 17:31:17.132725 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.132704 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 17:31:17.986865 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.986831 2580 apiserver.go:52] "Watching apiserver" Jun 10 17:31:17.995448 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.995419 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 17:31:17.996804 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.996775 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-gbvv6","openshift-ovn-kubernetes/ovnkube-node-5qlgr","kube-system/global-pull-secret-syncer-dfwx4","kube-system/konnectivity-agent-w6dtw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn","openshift-cluster-node-tuning-operator/tuned-4w9rx","openshift-dns/node-resolver-c4pf4","openshift-multus/multus-6b5jc","openshift-multus/network-metrics-daemon-22wk7","openshift-network-operator/iptables-alerter-n62zf","kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal","openshift-image-registry/node-ca-bs69v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal","openshift-multus/multus-additional-cni-plugins-mwm55"] Jun 10 17:31:17.999363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:17.999344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.001447 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.001420 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.001731 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.001711 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.002471 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.002274 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xjqnq\"" Jun 10 17:31:18.002471 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.002422 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.004453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.003717 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 17:31:18.004453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.003856 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.004453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.003988 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnv8w\"" Jun 10 17:31:18.004453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.004140 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 17:31:18.004453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.004368 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.004757 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.004473 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 17:31:18.004757 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.004671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.004848 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.004773 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:18.007348 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.007146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.009584 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.009378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.009584 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.009416 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 17:31:18.009584 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.009538 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-58zvf\"" Jun 10 17:31:18.009906 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.009860 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 17:31:18.011548 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.011502 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sj5vj\"" Jun 10 17:31:18.011686 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.011669 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 17:31:18.011811 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.011798 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.011941 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.011921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.013148 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.013131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.015110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-hosts-file\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.015209 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-tmp-dir\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.015209 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h47hz\" (UniqueName: \"kubernetes.io/projected/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-kube-api-access-h47hz\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.015209 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-os-release\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015209 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f10b4fd1-6df4-46ed-9e50-04be74267c91-cni-binary-copy\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015349 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-multus-certs\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015349 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-kubelet-config\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.015349 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015258 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wglp2\"" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015258 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-cni-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-k8s-cni-cncf-io\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-netns\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-cni-multus\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015439 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.015482 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-kubelet\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-hostroot\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdx47\" (UniqueName: \"kubernetes.io/projected/f10b4fd1-6df4-46ed-9e50-04be74267c91-kube-api-access-zdx47\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-socket-dir-parent\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-conf-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-dbus\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5783f82c-a430-409f-92c2-eb5116041413-agent-certs\") pod \"konnectivity-agent-w6dtw\" (UID: \"5783f82c-a430-409f-92c2-eb5116041413\") " pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5783f82c-a430-409f-92c2-eb5116041413-konnectivity-ca\") pod \"konnectivity-agent-w6dtw\" (UID: \"5783f82c-a430-409f-92c2-eb5116041413\") " pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-system-cni-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.015754 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.015744 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:18.016073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-cnibin\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.016073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-cni-bin\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.016073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-daemon-config\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.016073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.015861 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-etc-kubernetes\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.016560 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.016540 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 17:31:18.017602 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.017582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:18.017706 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.017668 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:18.019990 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.019975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.022232 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.022208 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.023100 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.022681 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.023100 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.022714 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.023100 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.022797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 17:31:18.023100 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.022918 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fxfcs\"" Jun 10 17:31:18.023100 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.023056 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 17:31:18.023748 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.023731 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 17:31:18.023990 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.023734 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 17:31:18.024969 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.024951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.025795 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.025383 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.025795 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.025399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k9b8j\"" Jun 10 17:31:18.025795 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.025420 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 17:31:18.025795 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.025420 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.027524 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.027507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2ld9h\"" Jun 10 17:31:18.027818 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.027795 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 17:31:18.027933 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.027897 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.027933 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.027806 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 17:31:18.029997 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.029981 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 17:31:18.030362 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.030324 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 17:31:18.030456 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.030396 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 17:31:18.030456 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.030442 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nxg9h\"" Jun 10 17:31:18.039443 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.039415 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nlpbh" Jun 10 17:31:18.047605 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.046881 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nlpbh" Jun 10 17:31:18.106715 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.106685 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 17:31:18.116348 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbb95776-0430-4c0f-99df-544ce8660d8b-ovn-node-metrics-cert\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.116496 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysconfig\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.116496 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-run\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.116496 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-var-lib-kubelet\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.116496 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-cnibin\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7rvm\" (UniqueName: \"kubernetes.io/projected/80ecff4b-b044-41eb-933a-5a9b633814ba-kube-api-access-m7rvm\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87kt\" (UniqueName: \"kubernetes.io/projected/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-kube-api-access-z87kt\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-multus-certs\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116570 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-cnibin\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116591 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80ecff4b-b044-41eb-933a-5a9b633814ba-iptables-alerter-script\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysctl-d\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-multus-certs\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-host\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-hostroot\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.116756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-ovnkube-config\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116762 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-hostroot\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-systemd\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-system-cni-dir\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-os-release\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-conf-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5783f82c-a430-409f-92c2-eb5116041413-agent-certs\") pod \"konnectivity-agent-w6dtw\" (UID: \"5783f82c-a430-409f-92c2-eb5116041413\") " pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-etc-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116976 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-conf-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.116989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-device-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117013 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-system-cni-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-kubelet\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-slash\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-system-cni-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-var-lib-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysctl-conf\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.117245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-sys\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-lib-modules\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-hosts-file\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h47hz\" (UniqueName: \"kubernetes.io/projected/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-kube-api-access-h47hz\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117261 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-hosts-file\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f10b4fd1-6df4-46ed-9e50-04be74267c91-cni-binary-copy\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-systemd-units\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117327 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117365 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-netns\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117428 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdx47\" (UniqueName: \"kubernetes.io/projected/f10b4fd1-6df4-46ed-9e50-04be74267c91-kube-api-access-zdx47\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-cni-netd\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117487 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-env-overrides\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-socket-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117514 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-netns\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.117989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szxzr\" (UniqueName: \"kubernetes.io/projected/8e0462a8-285c-48c8-82e5-77f7c39f514b-kube-api-access-szxzr\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/450368a7-691e-4f4c-a8db-5fb56042c69f-tmp\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjv8f\" (UniqueName: \"kubernetes.io/projected/56b2c968-078f-451e-a1e6-9563048127cb-kube-api-access-gjv8f\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-etc-selinux\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117667 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-cni-bin\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-daemon-config\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-cni-bin\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-tuned\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117799 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-cni-bin\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-os-release\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f10b4fd1-6df4-46ed-9e50-04be74267c91-cni-binary-copy\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.117986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80ecff4b-b044-41eb-933a-5a9b633814ba-host-slash\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-modprobe-d\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118041 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-cni-multus\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.118780 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-kubelet\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-log-socket\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vst7t\" (UniqueName: \"kubernetes.io/projected/450368a7-691e-4f4c-a8db-5fb56042c69f-kube-api-access-vst7t\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-socket-dir-parent\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5783f82c-a430-409f-92c2-eb5116041413-konnectivity-ca\") pod \"konnectivity-agent-w6dtw\" (UID: \"5783f82c-a430-409f-92c2-eb5116041413\") " pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118249 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-daemon-config\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-os-release\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-node-log\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118286 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-kubelet\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-ovnkube-script-lib\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-var-lib-cni-multus\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-kubernetes\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/748a318c-0372-46ed-92b9-68da6ef49669-host\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-etc-kubernetes\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.118433 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-run-netns\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.119532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118486 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-etc-kubernetes\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.118545 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:18.618509426 +0000 UTC m=+2.940677524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118576 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118629 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-socket-dir-parent\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zmbs\" (UniqueName: \"kubernetes.io/projected/bbb95776-0430-4c0f-99df-544ce8660d8b-kube-api-access-2zmbs\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-registration-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5783f82c-a430-409f-92c2-eb5116041413-konnectivity-ca\") pod \"konnectivity-agent-w6dtw\" (UID: \"5783f82c-a430-409f-92c2-eb5116041413\") " pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-tmp-dir\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.118976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-kubelet-config\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-systemd\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-ovn\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119073 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cnibin\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/748a318c-0372-46ed-92b9-68da6ef49669-serviceca\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-cni-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-k8s-cni-cncf-io\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.120186 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-sys-fs\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqd9p\" (UniqueName: \"kubernetes.io/projected/748a318c-0372-46ed-92b9-68da6ef49669-kube-api-access-fqd9p\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-dbus\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119367 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-dbus\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119627 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-tmp-dir\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-kubelet-config\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119809 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-multus-cni-dir\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.119847 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f10b4fd1-6df4-46ed-9e50-04be74267c91-host-run-k8s-cni-cncf-io\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.120921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.120751 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5783f82c-a430-409f-92c2-eb5116041413-agent-certs\") pod \"konnectivity-agent-w6dtw\" (UID: \"5783f82c-a430-409f-92c2-eb5116041413\") " pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.125012 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.124986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdx47\" (UniqueName: \"kubernetes.io/projected/f10b4fd1-6df4-46ed-9e50-04be74267c91-kube-api-access-zdx47\") pod \"multus-6b5jc\" (UID: \"f10b4fd1-6df4-46ed-9e50-04be74267c91\") " pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.126765 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.126745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h47hz\" (UniqueName: \"kubernetes.io/projected/29f2f3b8-ef75-49fb-a219-2c596d3a32ba-kube-api-access-h47hz\") pod \"node-resolver-c4pf4\" (UID: \"29f2f3b8-ef75-49fb-a219-2c596d3a32ba\") " pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.157964 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.157936 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:31:18.219997 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.219761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/450368a7-691e-4f4c-a8db-5fb56042c69f-tmp\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.220184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:18.220184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjv8f\" (UniqueName: \"kubernetes.io/projected/56b2c968-078f-451e-a1e6-9563048127cb-kube-api-access-gjv8f\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.220184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-etc-selinux\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.220184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.220184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-cni-bin\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-cni-bin\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-tuned\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220264 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80ecff4b-b044-41eb-933a-5a9b633814ba-host-slash\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-modprobe-d\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220298 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220322 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-log-socket\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220355 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-etc-selinux\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220368 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80ecff4b-b044-41eb-933a-5a9b633814ba-host-slash\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220360 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vst7t\" (UniqueName: \"kubernetes.io/projected/450368a7-691e-4f4c-a8db-5fb56042c69f-kube-api-access-vst7t\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220392 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-modprobe-d\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220394 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-log-socket\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-node-log\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.220461 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-ovnkube-script-lib\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220480 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-node-log\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-kubernetes\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/748a318c-0372-46ed-92b9-68da6ef49669-host\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-kubernetes\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-run-netns\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/748a318c-0372-46ed-92b9-68da6ef49669-host\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220606 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220610 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-run-netns\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220636 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zmbs\" (UniqueName: \"kubernetes.io/projected/bbb95776-0430-4c0f-99df-544ce8660d8b-kube-api-access-2zmbs\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-registration-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-systemd\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220767 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-registration-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220760 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-systemd\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220803 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-ovn\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cnibin\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/748a318c-0372-46ed-92b9-68da6ef49669-serviceca\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-sys-fs\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqd9p\" (UniqueName: \"kubernetes.io/projected/748a318c-0372-46ed-92b9-68da6ef49669-kube-api-access-fqd9p\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbb95776-0430-4c0f-99df-544ce8660d8b-ovn-node-metrics-cert\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.220995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysconfig\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-run\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-var-lib-kubelet\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rvm\" (UniqueName: \"kubernetes.io/projected/80ecff4b-b044-41eb-933a-5a9b633814ba-kube-api-access-m7rvm\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221084 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-sys-fs\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87kt\" (UniqueName: \"kubernetes.io/projected/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-kube-api-access-z87kt\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-ovn\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80ecff4b-b044-41eb-933a-5a9b633814ba-iptables-alerter-script\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221155 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cnibin\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysctl-d\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221219 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-ovnkube-script-lib\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.221571 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221277 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysctl-d\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-var-lib-kubelet\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221394 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-host\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221415 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-run-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysconfig\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221540 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-run\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221634 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/748a318c-0372-46ed-92b9-68da6ef49669-serviceca\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-ovnkube-config\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-host\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-systemd\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-system-cni-dir\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-os-release\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-etc-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-device-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221925 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-kubelet\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.222323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-slash\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.221974 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80ecff4b-b044-41eb-933a-5a9b633814ba-iptables-alerter-script\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-kubelet\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-var-lib-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysctl-conf\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222045 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-etc-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-sys\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-lib-modules\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-sys\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222139 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-sysctl-conf\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-system-cni-dir\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222174 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-slash\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-lib-modules\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.222240 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222214 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-device-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-systemd-units\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.222312 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:31:18.722293676 +0000 UTC m=+3.044461796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:18.223163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222337 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-ovnkube-config\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-os-release\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222393 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-systemd-units\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222423 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-var-lib-openvswitch\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222438 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222469 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-systemd\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-cni-netd\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222567 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbb95776-0430-4c0f-99df-544ce8660d8b-host-cni-netd\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-env-overrides\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-socket-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szxzr\" (UniqueName: \"kubernetes.io/projected/8e0462a8-285c-48c8-82e5-77f7c39f514b-kube-api-access-szxzr\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222920 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e0462a8-285c-48c8-82e5-77f7c39f514b-socket-dir\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.222983 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbb95776-0430-4c0f-99df-544ce8660d8b-env-overrides\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.223868 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.223053 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.224401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.223178 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/450368a7-691e-4f4c-a8db-5fb56042c69f-tmp\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.224401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.223294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/450368a7-691e-4f4c-a8db-5fb56042c69f-etc-tuned\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.224401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.224200 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbb95776-0430-4c0f-99df-544ce8660d8b-ovn-node-metrics-cert\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.229079 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.229062 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:18.229079 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.229081 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:18.229214 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.229090 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:18.229214 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.229145 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:31:18.729132785 +0000 UTC m=+3.051300880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:18.232155 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.232126 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zmbs\" (UniqueName: \"kubernetes.io/projected/bbb95776-0430-4c0f-99df-544ce8660d8b-kube-api-access-2zmbs\") pod \"ovnkube-node-5qlgr\" (UID: \"bbb95776-0430-4c0f-99df-544ce8660d8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.232534 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.232500 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7rvm\" (UniqueName: \"kubernetes.io/projected/80ecff4b-b044-41eb-933a-5a9b633814ba-kube-api-access-m7rvm\") pod \"iptables-alerter-n62zf\" (UID: \"80ecff4b-b044-41eb-933a-5a9b633814ba\") " pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.232630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.232537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqd9p\" (UniqueName: \"kubernetes.io/projected/748a318c-0372-46ed-92b9-68da6ef49669-kube-api-access-fqd9p\") pod \"node-ca-bs69v\" (UID: \"748a318c-0372-46ed-92b9-68da6ef49669\") " pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.232712 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.232690 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjv8f\" (UniqueName: \"kubernetes.io/projected/56b2c968-078f-451e-a1e6-9563048127cb-kube-api-access-gjv8f\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.232761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.232752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vst7t\" (UniqueName: \"kubernetes.io/projected/450368a7-691e-4f4c-a8db-5fb56042c69f-kube-api-access-vst7t\") pod \"tuned-4w9rx\" (UID: \"450368a7-691e-4f4c-a8db-5fb56042c69f\") " pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.233104 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.233082 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szxzr\" (UniqueName: \"kubernetes.io/projected/8e0462a8-285c-48c8-82e5-77f7c39f514b-kube-api-access-szxzr\") pod \"aws-ebs-csi-driver-node-lrnrn\" (UID: \"8e0462a8-285c-48c8-82e5-77f7c39f514b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.233194 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.233092 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87kt\" (UniqueName: \"kubernetes.io/projected/18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8-kube-api-access-z87kt\") pod \"multus-additional-cni-plugins-mwm55\" (UID: \"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8\") " pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.312353 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.312271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4pf4" Jun 10 17:31:18.319513 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.319489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6b5jc" Jun 10 17:31:18.330263 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.330239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:18.334837 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.334818 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" Jun 10 17:31:18.340320 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.340304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" Jun 10 17:31:18.347942 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.347920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:18.356545 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.356521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n62zf" Jun 10 17:31:18.363287 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.363268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mwm55" Jun 10 17:31:18.368955 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.368938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bs69v" Jun 10 17:31:18.625248 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.625176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:18.625372 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.625311 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:18.625372 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.625368 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:19.625354477 +0000 UTC m=+3.947522572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:18.726147 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.726112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:18.726348 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.726283 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:18.726392 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.726362 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:31:19.72634024 +0000 UTC m=+4.048508335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:18.826856 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:18.826806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:18.827051 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.827005 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:18.827051 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.827033 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:18.827051 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.827046 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:18.827199 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:18.827112 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:31:19.827094244 +0000 UTC m=+4.149262365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:19.050999 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:19.050898 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 17:26:18 +0000 UTC" deadline="2028-03-12 00:37:12.307710836 +0000 UTC" Jun 10 17:31:19.050999 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:19.050940 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15367h5m53.256774325s" Jun 10 17:31:19.285906 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.284782 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0462a8_285c_48c8_82e5_77f7c39f514b.slice/crio-f749fbc8ed6cf6e56f8b4fdb073cb8a0aadfd366869ac300a3177c4b615881ae WatchSource:0}: Error finding container f749fbc8ed6cf6e56f8b4fdb073cb8a0aadfd366869ac300a3177c4b615881ae: Status 404 returned error can't find the container with id f749fbc8ed6cf6e56f8b4fdb073cb8a0aadfd366869ac300a3177c4b615881ae Jun 10 17:31:19.287859 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.287839 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5783f82c_a430_409f_92c2_eb5116041413.slice/crio-4c732a68ee164f5bbdc702da4911eea36d075cb4b25adb4a1ee7bbf659fbff80 WatchSource:0}: Error finding container 4c732a68ee164f5bbdc702da4911eea36d075cb4b25adb4a1ee7bbf659fbff80: Status 404 returned error can't find the container with id 4c732a68ee164f5bbdc702da4911eea36d075cb4b25adb4a1ee7bbf659fbff80 Jun 10 17:31:19.290970 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.290946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f2f3b8_ef75_49fb_a219_2c596d3a32ba.slice/crio-2e92344e3efc30109e494d32182cfe2edce737fd96f32fe1376be74e81519d60 WatchSource:0}: Error finding container 2e92344e3efc30109e494d32182cfe2edce737fd96f32fe1376be74e81519d60: Status 404 returned error can't find the container with id 2e92344e3efc30109e494d32182cfe2edce737fd96f32fe1376be74e81519d60 Jun 10 17:31:19.292303 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.292194 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450368a7_691e_4f4c_a8db_5fb56042c69f.slice/crio-1622a0cbb23371f4cf65bbb86b1d6f8b52c58d067225213d5f20cb842e58212b WatchSource:0}: Error finding container 1622a0cbb23371f4cf65bbb86b1d6f8b52c58d067225213d5f20cb842e58212b: Status 404 returned error can't find the container with id 1622a0cbb23371f4cf65bbb86b1d6f8b52c58d067225213d5f20cb842e58212b Jun 10 17:31:19.293779 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.293674 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb95776_0430_4c0f_99df_544ce8660d8b.slice/crio-3d6eb4740dd7b7d10024224874925a52b3fb1bc6cd830c26c1c505aebe3c92f4 WatchSource:0}: Error finding container 3d6eb4740dd7b7d10024224874925a52b3fb1bc6cd830c26c1c505aebe3c92f4: Status 404 returned error can't find the container with id 3d6eb4740dd7b7d10024224874925a52b3fb1bc6cd830c26c1c505aebe3c92f4 Jun 10 17:31:19.299067 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.298426 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748a318c_0372_46ed_92b9_68da6ef49669.slice/crio-a113e01e40d8c7309480dc5ae00ddf65b32fa4c63b2c841c0e7ffe592d2f9133 WatchSource:0}: Error finding container a113e01e40d8c7309480dc5ae00ddf65b32fa4c63b2c841c0e7ffe592d2f9133: Status 404 returned error can't find the container with id a113e01e40d8c7309480dc5ae00ddf65b32fa4c63b2c841c0e7ffe592d2f9133 Jun 10 17:31:19.299205 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:19.299104 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10b4fd1_6df4_46ed_9e50_04be74267c91.slice/crio-0983539bcf746671fae9fa2728bd9c067aff779d9b9dd71baef3c7ada2a6afb9 WatchSource:0}: Error finding container 0983539bcf746671fae9fa2728bd9c067aff779d9b9dd71baef3c7ada2a6afb9: Status 404 returned error can't find the container with id 0983539bcf746671fae9fa2728bd9c067aff779d9b9dd71baef3c7ada2a6afb9 Jun 10 17:31:19.528232 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:19.528202 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 17:31:19.631503 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:19.631473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:19.631667 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.631627 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:19.631740 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.631728 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:21.631712881 +0000 UTC m=+5.953880980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:19.732698 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:19.732662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:19.732865 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.732777 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:19.732925 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.732864 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:31:21.732843068 +0000 UTC m=+6.055011166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:19.833910 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:19.833822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:19.834075 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.834049 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:19.834075 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.834074 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:19.834178 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.834087 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:19.834178 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:19.834157 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:31:21.83413791 +0000 UTC m=+6.156306021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:20.051477 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.051411 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 17:26:18 +0000 UTC" deadline="2028-02-07 22:36:03.364150985 +0000 UTC" Jun 10 17:31:20.051477 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.051475 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14573h4m43.31267983s" Jun 10 17:31:20.079407 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.079374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:20.079574 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:20.079509 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:20.080010 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.079990 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:20.080123 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:20.080101 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:20.080243 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.080229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:20.080323 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:20.080306 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:20.107403 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.107163 2580 generic.go:356] "Generic (PLEG): container finished" podID="69660b4a95ee98b363a3fafda40c0f19" containerID="a9f78028918031d64f12db2ad0fa2fae6ae74976c9ad47c1eb7357acd9f8bcbd" exitCode=0 Jun 10 17:31:20.107403 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.107257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" event={"ID":"69660b4a95ee98b363a3fafda40c0f19","Type":"ContainerDied","Data":"a9f78028918031d64f12db2ad0fa2fae6ae74976c9ad47c1eb7357acd9f8bcbd"} Jun 10 17:31:20.124158 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.124126 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bs69v" event={"ID":"748a318c-0372-46ed-92b9-68da6ef49669","Type":"ContainerStarted","Data":"a113e01e40d8c7309480dc5ae00ddf65b32fa4c63b2c841c0e7ffe592d2f9133"} Jun 10 17:31:20.135058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.134923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerStarted","Data":"c5083d283a760a80c26accadef782b83de6842f39412f4e8ce4377dba406dde5"} Jun 10 17:31:20.145216 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.145180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6b5jc" event={"ID":"f10b4fd1-6df4-46ed-9e50-04be74267c91","Type":"ContainerStarted","Data":"0983539bcf746671fae9fa2728bd9c067aff779d9b9dd71baef3c7ada2a6afb9"} Jun 10 17:31:20.158589 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.158550 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4pf4" event={"ID":"29f2f3b8-ef75-49fb-a219-2c596d3a32ba","Type":"ContainerStarted","Data":"2e92344e3efc30109e494d32182cfe2edce737fd96f32fe1376be74e81519d60"} Jun 10 17:31:20.161442 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.161334 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w6dtw" event={"ID":"5783f82c-a430-409f-92c2-eb5116041413","Type":"ContainerStarted","Data":"4c732a68ee164f5bbdc702da4911eea36d075cb4b25adb4a1ee7bbf659fbff80"} Jun 10 17:31:20.168988 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.168955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" event={"ID":"86ea6e526d0e13d9297ab97bb88e6cf7","Type":"ContainerStarted","Data":"4ad003976d8b50df5b3d3a0168ec791983adcb4a0cd07a86d6fc7c178b3bcd1b"} Jun 10 17:31:20.181199 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.181163 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n62zf" event={"ID":"80ecff4b-b044-41eb-933a-5a9b633814ba","Type":"ContainerStarted","Data":"4043ee7160cb9e2f63ed49767915545eb7a0f72f7c40b652f383b818cadea564"} Jun 10 17:31:20.183554 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.183497 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" podStartSLOduration=3.183479595 podStartE2EDuration="3.183479595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:20.182855705 +0000 UTC m=+4.505023824" watchObservedRunningTime="2026-06-10 17:31:20.183479595 +0000 UTC m=+4.505647713" Jun 10 17:31:20.194167 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.194135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"3d6eb4740dd7b7d10024224874925a52b3fb1bc6cd830c26c1c505aebe3c92f4"} Jun 10 17:31:20.209672 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.208956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" event={"ID":"450368a7-691e-4f4c-a8db-5fb56042c69f","Type":"ContainerStarted","Data":"1622a0cbb23371f4cf65bbb86b1d6f8b52c58d067225213d5f20cb842e58212b"} Jun 10 17:31:20.219385 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:20.219341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" event={"ID":"8e0462a8-285c-48c8-82e5-77f7c39f514b","Type":"ContainerStarted","Data":"f749fbc8ed6cf6e56f8b4fdb073cb8a0aadfd366869ac300a3177c4b615881ae"} Jun 10 17:31:21.240937 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:21.240810 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" event={"ID":"69660b4a95ee98b363a3fafda40c0f19","Type":"ContainerStarted","Data":"2d6e070fe2686bd785da5f1c1a15a676b2ab5eda2e2cac59660ed2f9a1b62505"} Jun 10 17:31:21.261474 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:21.260703 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" podStartSLOduration=4.260680962 podStartE2EDuration="4.260680962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:21.259007345 +0000 UTC m=+5.581175461" watchObservedRunningTime="2026-06-10 17:31:21.260680962 +0000 UTC m=+5.582849080" Jun 10 17:31:21.652306 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:21.652215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:21.652500 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.652433 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:21.652500 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.652496 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:25.652478376 +0000 UTC m=+9.974646486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:21.753279 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:21.752613 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:21.753279 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.752845 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:21.753279 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.752911 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:31:25.752892529 +0000 UTC m=+10.075060627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:21.853326 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:21.853284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:21.853521 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.853505 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:21.853596 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.853527 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:21.853596 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.853541 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:21.853749 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:21.853597 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:31:25.853578595 +0000 UTC m=+10.175746694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:22.078977 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:22.078896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:22.079140 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:22.079026 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:22.079421 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:22.079401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:22.079526 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:22.079507 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:22.079583 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:22.079571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:22.079689 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:22.079667 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:24.077415 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:24.076937 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:24.077415 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:24.077076 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:24.077415 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:24.077115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:24.077415 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:24.077189 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:24.077415 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:24.077340 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:24.078098 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:24.077458 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:25.690969 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:25.690930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:25.691422 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.691137 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:25.691422 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.691200 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:33.691186006 +0000 UTC m=+18.013354105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:25.792159 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:25.791523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:25.792159 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.791758 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:25.792159 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.791825 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:31:33.791805162 +0000 UTC m=+18.113973261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:25.892624 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:25.892580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:25.892819 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.892787 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:25.892819 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.892805 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:25.892819 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.892818 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:25.892983 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:25.892880 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:31:33.892859772 +0000 UTC m=+18.215027877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:26.078686 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:26.078270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:26.078686 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:26.078354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:26.078686 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:26.078358 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:26.078686 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:26.078479 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:26.078686 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:26.078493 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:26.078686 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:26.078580 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:28.077634 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:28.077598 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:28.077634 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:28.077614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:28.078100 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:28.077739 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:28.078146 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:28.078103 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:28.078146 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:28.078143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:28.078241 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:28.078222 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:30.077105 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:30.077067 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:30.077513 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:30.077201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:30.078053 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:30.077635 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:30.078053 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:30.077805 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:30.078053 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:30.077927 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:30.078053 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:30.078019 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:32.077305 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:32.077129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:32.077305 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:32.077130 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:32.077305 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:32.077261 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:32.077897 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:32.077377 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:32.077897 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:32.077410 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:32.077897 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:32.077489 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:33.754534 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:33.754496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:33.755010 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.754672 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:33.755010 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.754756 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:49.754732974 +0000 UTC m=+34.076901071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:33.855904 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:33.855869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:33.856083 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.856036 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:33.856142 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.856129 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:31:49.856105733 +0000 UTC m=+34.178273856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:33.957137 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:33.957098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:33.957334 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.957303 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:33.957334 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.957338 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:33.957473 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.957352 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:33.957473 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:33.957419 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:31:49.957399139 +0000 UTC m=+34.279567248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:34.076989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:34.076905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:34.077160 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:34.076911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:34.077160 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:34.077033 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:34.077160 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:34.077048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:34.077160 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:34.077136 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:34.077329 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:34.077200 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:36.077354 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:36.077307 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:36.077905 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:36.077412 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:36.077905 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:36.077469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:36.077905 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:36.077590 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:36.077905 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:36.077637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:36.077905 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:36.077716 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:38.077168 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.077132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:38.077168 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.077154 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:38.078006 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:38.077275 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:38.078006 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.077133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:38.078006 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:38.077414 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:38.078006 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:38.077518 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:38.274303 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.274051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bs69v" event={"ID":"748a318c-0372-46ed-92b9-68da6ef49669","Type":"ContainerStarted","Data":"77f749f1d57dc9d6c1374918651da977a8c65b7de2b4a127519c6512df3fdcce"} Jun 10 17:31:38.276331 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.276299 2580 generic.go:356] "Generic (PLEG): container finished" podID="18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8" containerID="ce183acf245b9bfece54207af46277a72130b0835635d5aab115d0a449184344" exitCode=0 Jun 10 17:31:38.276503 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.276484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerDied","Data":"ce183acf245b9bfece54207af46277a72130b0835635d5aab115d0a449184344"} Jun 10 17:31:38.281163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.281141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6b5jc" event={"ID":"f10b4fd1-6df4-46ed-9e50-04be74267c91","Type":"ContainerStarted","Data":"4383390d3a84ea5f923d6924f79cd371e6e5ccd9a5a236be500dc67eea7a1ef6"} Jun 10 17:31:38.282615 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.282593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4pf4" event={"ID":"29f2f3b8-ef75-49fb-a219-2c596d3a32ba","Type":"ContainerStarted","Data":"970c7f81ef9cefba5cc7fbc116e1d2b9129646007cfb2633a9760e246d9f00ea"} Jun 10 17:31:38.284083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.284061 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w6dtw" event={"ID":"5783f82c-a430-409f-92c2-eb5116041413","Type":"ContainerStarted","Data":"03bab46a0f1cc15ecbc980e92160fbbf522a5c78cc017f340d8775e5bb6a085d"} Jun 10 17:31:38.286162 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.286138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"08108fd372c487b3091b068e2f101f1749188f3cb0ab70afa4aa233e99bff644"} Jun 10 17:31:38.286248 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.286214 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"afbd51a4659213e08622f1e2b2edcecce2f1dd8b1062ede6787674061a1e36e4"} Jun 10 17:31:38.286298 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.286266 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"256f14e1b25bf322f5fa1ccb7811f2db909d566e02cf434457666a2ca6e701c9"} Jun 10 17:31:38.286338 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.286312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"40506c79fd5947584b8c02a74669a277b5f9582da63076fd4a204f8fa4ef0242"} Jun 10 17:31:38.287481 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.287450 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" event={"ID":"450368a7-691e-4f4c-a8db-5fb56042c69f","Type":"ContainerStarted","Data":"57f00817dd9cbb903e1575c6f58b306cdfddeece976d70f4da871582e4269fa6"} Jun 10 17:31:38.289749 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.289727 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" event={"ID":"8e0462a8-285c-48c8-82e5-77f7c39f514b","Type":"ContainerStarted","Data":"9052d4b73a0ad1426d0c50d147cd80afa7daddde6d2f26f56280a21fa6faf87f"} Jun 10 17:31:38.304367 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.304326 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c4pf4" podStartSLOduration=3.795057985 podStartE2EDuration="22.304313191s" totalImagesPullingTime="18.509255206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:38.304173705 +0000 UTC m=+22.626341821" watchObservedRunningTime="2026-06-10 17:31:38.304313191 +0000 UTC m=+22.626481305" Jun 10 17:31:38.304575 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.304557 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bs69v" podStartSLOduration=3.850937446 podStartE2EDuration="22.304550327s" totalImagesPullingTime="18.453612881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:38.290703808 +0000 UTC m=+22.612871926" watchObservedRunningTime="2026-06-10 17:31:38.304550327 +0000 UTC m=+22.626718443" Jun 10 17:31:38.322631 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.322580 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6b5jc" podStartSLOduration=3.811493153 podStartE2EDuration="22.322562563s" totalImagesPullingTime="18.51106941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:38.322027251 +0000 UTC m=+22.644195371" watchObservedRunningTime="2026-06-10 17:31:38.322562563 +0000 UTC m=+22.644730678" Jun 10 17:31:38.336911 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.336865 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w6dtw" podStartSLOduration=8.475139348 podStartE2EDuration="22.33685025s" totalImagesPullingTime="13.861710902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:38.33674139 +0000 UTC m=+22.658909498" watchObservedRunningTime="2026-06-10 17:31:38.33685025 +0000 UTC m=+22.659018366" Jun 10 17:31:38.353274 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.353224 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4w9rx" podStartSLOduration=3.842979984 podStartE2EDuration="22.353205243s" totalImagesPullingTime="18.510225259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:38.352758445 +0000 UTC m=+22.674926559" watchObservedRunningTime="2026-06-10 17:31:38.353205243 +0000 UTC m=+22.675373360" Jun 10 17:31:38.807467 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:38.807300 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 17:31:39.076631 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:39.076447 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T17:31:38.807463699Z","UUID":"5ff8ca4e-d2bc-4da5-86f2-149425dd0f63","Handler":null,"Name":"","Endpoint":""} Jun 10 17:31:39.077926 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:39.077902 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 17:31:39.078297 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:39.077947 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 17:31:39.296413 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:39.296375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"9246b1a95d0b5ac5a771251822183c53adcfd3d46f3c6d49df85962089a066e1"} Jun 10 17:31:39.296591 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:39.296458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"8f74c6561495d364c94b0ab4276b9251400d2491e4a3410fc4eb6822920ea9ea"} Jun 10 17:31:39.299454 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:39.299422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" event={"ID":"8e0462a8-285c-48c8-82e5-77f7c39f514b","Type":"ContainerStarted","Data":"500a056dae053bdfa6f305445a1920f68500cd68a01ff328adde9e2a51054200"} Jun 10 17:31:40.077280 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.077236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:40.077469 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.077286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:40.077469 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.077254 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:40.077469 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:40.077392 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:40.077623 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:40.077494 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:40.077623 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:40.077574 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:40.302750 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.302716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n62zf" event={"ID":"80ecff4b-b044-41eb-933a-5a9b633814ba","Type":"ContainerStarted","Data":"7e284bff51a55d8b3cb45ad6df7f02e2fd111a2d27d4ca66576ae4d8bf1ee38b"} Jun 10 17:31:40.305141 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.305108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" event={"ID":"8e0462a8-285c-48c8-82e5-77f7c39f514b","Type":"ContainerStarted","Data":"c903187ec5e56c4934a583e15ed2e166f586f8bed18cc4e86d0e0a7d4bc3c2c3"} Jun 10 17:31:40.317421 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.317366 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n62zf" podStartSLOduration=5.863933473 podStartE2EDuration="24.31734719s" totalImagesPullingTime="18.453413717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:40.316527629 +0000 UTC m=+24.638695750" watchObservedRunningTime="2026-06-10 17:31:40.31734719 +0000 UTC m=+24.639515308" Jun 10 17:31:40.333937 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:40.333829 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lrnrn" podStartSLOduration=8.995026093 podStartE2EDuration="24.333813568s" totalImagesPullingTime="15.338787475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:40.333339281 +0000 UTC m=+24.655507407" watchObservedRunningTime="2026-06-10 17:31:40.333813568 +0000 UTC m=+24.655981684" Jun 10 17:31:41.311169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:41.311130 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"238bf5069a2dd85a42f1580f8230bdde8bfdc03b71feef807663e0aee1da3155"} Jun 10 17:31:41.767243 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:41.767203 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:41.767848 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:41.767829 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:42.076842 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:42.076764 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:42.076842 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:42.076812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:42.077106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:42.076904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:42.077106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:42.076966 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:42.077106 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:42.076994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:42.077106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:42.077073 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:42.313079 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:42.313037 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:42.313606 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:42.313492 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w6dtw" Jun 10 17:31:43.318723 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.318466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" event={"ID":"bbb95776-0430-4c0f-99df-544ce8660d8b","Type":"ContainerStarted","Data":"883b7dca0a79d41914b8f7313f7ee9ddde8f1d78d08f472a20bcbdadb5cac230"} Jun 10 17:31:43.319185 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.318815 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:43.319185 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.318853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:43.320918 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.320892 2580 generic.go:356] "Generic (PLEG): container finished" podID="18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8" containerID="38a05f8e7f8511e97e3cda25b75771a2e0dde0cb3d5624c9561b02481ac388de" exitCode=0 Jun 10 17:31:43.321029 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.320950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerDied","Data":"38a05f8e7f8511e97e3cda25b75771a2e0dde0cb3d5624c9561b02481ac388de"} Jun 10 17:31:43.335392 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.335369 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:43.347504 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:43.347466 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" podStartSLOduration=8.780090323 podStartE2EDuration="27.347452725s" totalImagesPullingTime="18.567362402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:43.347302604 +0000 UTC m=+27.669470722" watchObservedRunningTime="2026-06-10 17:31:43.347452725 +0000 UTC m=+27.669620842" Jun 10 17:31:44.077274 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.077236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:44.077453 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:44.077349 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:44.077453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.077247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:44.077453 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:44.077413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:44.077453 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.077233 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:44.077673 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:44.077458 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:44.323203 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.323167 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:44.338353 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.338273 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:31:44.736079 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.735910 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbvv6"] Jun 10 17:31:44.736252 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.736223 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:44.736353 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:44.736333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:44.738536 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.738508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-22wk7"] Jun 10 17:31:44.738693 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.738623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:44.738782 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:44.738756 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:44.739137 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.739116 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dfwx4"] Jun 10 17:31:44.739220 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:44.739212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:44.739322 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:44.739303 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:45.327558 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:45.327523 2580 generic.go:356] "Generic (PLEG): container finished" podID="18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8" containerID="e02fc8f05243b10e4676ac77ece77e2d287ff1dfbdc2bc160b7dea4f0aa159e6" exitCode=0 Jun 10 17:31:45.327989 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:45.327603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerDied","Data":"e02fc8f05243b10e4676ac77ece77e2d287ff1dfbdc2bc160b7dea4f0aa159e6"} Jun 10 17:31:46.078118 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:46.078083 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:46.078266 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:46.078159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:46.078266 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:46.078232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:46.078347 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:46.078325 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:47.076615 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:47.076579 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:47.077199 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:47.076703 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:47.335082 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:47.334984 2580 generic.go:356] "Generic (PLEG): container finished" podID="18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8" containerID="ef2c3309373539c72d8e7000451674eb128e9c9a55500424e09b0007b1531e04" exitCode=0 Jun 10 17:31:47.335082 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:47.335033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerDied","Data":"ef2c3309373539c72d8e7000451674eb128e9c9a55500424e09b0007b1531e04"} Jun 10 17:31:48.077171 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:48.077138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:48.077808 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:48.077138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:48.077808 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:48.077291 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:48.077808 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:48.077339 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:49.076761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:49.076729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:49.076956 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.076871 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfwx4" podUID="6b4e1a2a-9967-43f0-8cdd-59edeb208fc1" Jun 10 17:31:49.782149 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:49.782111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:49.782587 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.782225 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:49.782587 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.782298 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret podName:6b4e1a2a-9967-43f0-8cdd-59edeb208fc1 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:21.782284623 +0000 UTC m=+66.104452722 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret") pod "global-pull-secret-syncer-dfwx4" (UID: "6b4e1a2a-9967-43f0-8cdd-59edeb208fc1") : object "kube-system"/"original-pull-secret" not registered Jun 10 17:31:49.882745 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:49.882710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:49.882915 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.882819 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:49.882915 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.882873 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:32:21.882859375 +0000 UTC m=+66.205027471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 17:31:49.983216 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:49.983179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:49.983379 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.983357 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 17:31:49.983379 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.983379 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 17:31:49.983457 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.983389 2580 projected.go:196] Error preparing data for projected volume kube-api-access-9gnq7 for pod openshift-network-diagnostics/network-check-target-gbvv6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:49.983457 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:49.983442 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7 podName:40ac4132-9428-444a-8f2a-34ddebf4fe5d nodeName:}" failed. No retries permitted until 2026-06-10 17:32:21.983428484 +0000 UTC m=+66.305596582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9gnq7" (UniqueName: "kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7") pod "network-check-target-gbvv6" (UID: "40ac4132-9428-444a-8f2a-34ddebf4fe5d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 17:31:50.077853 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.077585 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:50.078023 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.077593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:50.078023 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.077905 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbvv6" podUID="40ac4132-9428-444a-8f2a-34ddebf4fe5d" Jun 10 17:31:50.078023 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.077948 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:31:50.560973 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.560936 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeReady" Jun 10 17:31:50.561146 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.561103 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 17:31:50.595245 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.595212 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f76c75bc8-cpgdl"] Jun 10 17:31:50.617107 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.616972 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x27wn"] Jun 10 17:31:50.617257 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.617138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.621414 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.621389 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xt9r7\"" Jun 10 17:31:50.621681 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.621664 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 17:31:50.621832 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.621818 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 17:31:50.621959 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.621947 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 17:31:50.626995 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.626804 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 17:31:50.630992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.630969 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2dfbm"] Jun 10 17:31:50.631111 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.631094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.633416 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.633393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 17:31:50.633634 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.633618 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 17:31:50.633740 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.633461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqnwj\"" Jun 10 17:31:50.643050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.643027 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f76c75bc8-cpgdl"] Jun 10 17:31:50.643171 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.643062 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x27wn"] Jun 10 17:31:50.643171 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.643101 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dfbm"] Jun 10 17:31:50.643270 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.643189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.645900 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.645639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gd7vx\"" Jun 10 17:31:50.645900 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.645670 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 17:31:50.645900 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.645680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 17:31:50.645900 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.645696 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 17:31:50.790608 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-ca-trust-extracted\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-installation-pull-secrets\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-bound-sa-token\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5p2c\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-kube-api-access-g5p2c\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fedef23-1c8a-4e54-aea0-341b98460186-tmp-dir\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fedef23-1c8a-4e54-aea0-341b98460186-config-volume\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-certificates\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.790974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqnlg\" (UniqueName: \"kubernetes.io/projected/2fedef23-1c8a-4e54-aea0-341b98460186-kube-api-access-lqnlg\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.791027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-image-registry-private-configuration\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.791057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-trusted-ca\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.791522 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.791093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tttwm\" (UniqueName: \"kubernetes.io/projected/3bf03637-eac7-4dbf-bca7-1c8c73275d67-kube-api-access-tttwm\") pod \"ingress-canary-2dfbm\" (UID: \"3bf03637-eac7-4dbf-bca7-1c8c73275d67\") " pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.791522 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.791120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bf03637-eac7-4dbf-bca7-1c8c73275d67-cert\") pod \"ingress-canary-2dfbm\" (UID: \"3bf03637-eac7-4dbf-bca7-1c8c73275d67\") " pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.891992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.891906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-image-registry-private-configuration\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.891992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.891957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-trusted-ca\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892200 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tttwm\" (UniqueName: \"kubernetes.io/projected/3bf03637-eac7-4dbf-bca7-1c8c73275d67-kube-api-access-tttwm\") pod \"ingress-canary-2dfbm\" (UID: \"3bf03637-eac7-4dbf-bca7-1c8c73275d67\") " pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.892200 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bf03637-eac7-4dbf-bca7-1c8c73275d67-cert\") pod \"ingress-canary-2dfbm\" (UID: \"3bf03637-eac7-4dbf-bca7-1c8c73275d67\") " pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-ca-trust-extracted\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-installation-pull-secrets\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-bound-sa-token\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5p2c\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-kube-api-access-g5p2c\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fedef23-1c8a-4e54-aea0-341b98460186-tmp-dir\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fedef23-1c8a-4e54-aea0-341b98460186-config-volume\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.892745 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.892745 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-certificates\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892745 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqnlg\" (UniqueName: \"kubernetes.io/projected/2fedef23-1c8a-4e54-aea0-341b98460186-kube-api-access-lqnlg\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.892745 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.892735 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-ca-trust-extracted\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.892924 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.892780 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:31:50.892924 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.892800 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:31:50.892924 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.892838 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:31:50.892924 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.892859 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:51.392838571 +0000 UTC m=+35.715006690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:31:50.892924 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:50.892897 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:51.392879354 +0000 UTC m=+35.715047456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:31:50.893577 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.893441 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fedef23-1c8a-4e54-aea0-341b98460186-config-volume\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.893577 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.893461 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-trusted-ca\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.893577 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.893450 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fedef23-1c8a-4e54-aea0-341b98460186-tmp-dir\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.893977 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.893960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-certificates\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.897291 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.897274 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bf03637-eac7-4dbf-bca7-1c8c73275d67-cert\") pod \"ingress-canary-2dfbm\" (UID: \"3bf03637-eac7-4dbf-bca7-1c8c73275d67\") " pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.897291 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.897282 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-image-registry-private-configuration\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.897610 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.897589 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-installation-pull-secrets\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.902084 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.902063 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-bound-sa-token\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.902729 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.902683 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5p2c\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-kube-api-access-g5p2c\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:50.903348 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.903109 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqnlg\" (UniqueName: \"kubernetes.io/projected/2fedef23-1c8a-4e54-aea0-341b98460186-kube-api-access-lqnlg\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:50.903879 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.903858 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tttwm\" (UniqueName: \"kubernetes.io/projected/3bf03637-eac7-4dbf-bca7-1c8c73275d67-kube-api-access-tttwm\") pod \"ingress-canary-2dfbm\" (UID: \"3bf03637-eac7-4dbf-bca7-1c8c73275d67\") " pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:50.953174 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:50.953127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dfbm" Jun 10 17:31:51.077072 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:51.077040 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:31:51.079743 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:51.079713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 17:31:51.397269 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:51.397233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:51.397473 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:51.397299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:51.397473 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:51.397374 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:31:51.397473 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:51.397395 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:31:51.397473 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:51.397422 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:31:51.397473 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:51.397465 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:52.397443822 +0000 UTC m=+36.719611923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:31:51.397778 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:51.397479 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:52.397473587 +0000 UTC m=+36.719641685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:31:51.661762 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:51.661532 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dfbm"] Jun 10 17:31:51.716226 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:31:51.716189 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf03637_eac7_4dbf_bca7_1c8c73275d67.slice/crio-a306b71df5a34be4500470bec5ad7b36df91d32088a215ef6a6e75d0e095e08c WatchSource:0}: Error finding container a306b71df5a34be4500470bec5ad7b36df91d32088a215ef6a6e75d0e095e08c: Status 404 returned error can't find the container with id a306b71df5a34be4500470bec5ad7b36df91d32088a215ef6a6e75d0e095e08c Jun 10 17:31:52.076980 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.076802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:31:52.077425 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.076861 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:31:52.080888 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.080861 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 17:31:52.080888 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.080879 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 17:31:52.081054 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.080879 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtfgg\"" Jun 10 17:31:52.081054 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.080877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d9nks\"" Jun 10 17:31:52.081054 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.080880 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 17:31:52.348787 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.348748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dfbm" event={"ID":"3bf03637-eac7-4dbf-bca7-1c8c73275d67","Type":"ContainerStarted","Data":"a306b71df5a34be4500470bec5ad7b36df91d32088a215ef6a6e75d0e095e08c"} Jun 10 17:31:52.351244 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.351219 2580 generic.go:356] "Generic (PLEG): container finished" podID="18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8" containerID="378ec394da67ed00766cafff0acdaeea0b1df7899a4b555cacbebcb1fe9c7240" exitCode=0 Jun 10 17:31:52.351373 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.351255 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerDied","Data":"378ec394da67ed00766cafff0acdaeea0b1df7899a4b555cacbebcb1fe9c7240"} Jun 10 17:31:52.403541 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.403509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:52.403742 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:52.403575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:52.403742 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:52.403707 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:31:52.403742 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:52.403729 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:31:52.403742 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:52.403731 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:31:52.403958 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:52.403784 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:54.403770274 +0000 UTC m=+38.725938369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:31:52.403958 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:52.403799 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:54.40379369 +0000 UTC m=+38.725961785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:31:53.356792 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:53.356756 2580 generic.go:356] "Generic (PLEG): container finished" podID="18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8" containerID="346007a92d9f05f0c6ebef7188a495d6869cc419b092c61e9f51ec18bc265fb2" exitCode=0 Jun 10 17:31:53.357146 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:53.356823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerDied","Data":"346007a92d9f05f0c6ebef7188a495d6869cc419b092c61e9f51ec18bc265fb2"} Jun 10 17:31:54.363521 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:54.363482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwm55" event={"ID":"18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8","Type":"ContainerStarted","Data":"586ea22805441901434e765479a59477693311a9c378d10a898454b8b5b4fa55"} Jun 10 17:31:54.388301 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:54.388243 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mwm55" podStartSLOduration=8.863351655 podStartE2EDuration="38.388227756s" totalImagesPullingTime="29.524876101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:54.386241931 +0000 UTC m=+38.708410065" watchObservedRunningTime="2026-06-10 17:31:54.388227756 +0000 UTC m=+38.710395872" Jun 10 17:31:54.420563 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:54.420529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:54.420769 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:54.420611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:54.420769 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:54.420725 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:31:54.420769 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:54.420757 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:31:54.420912 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:54.420778 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:31:54.420912 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:54.420796 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:58.420775945 +0000 UTC m=+42.742944040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:31:54.420912 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:54.420830 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:31:58.420812851 +0000 UTC m=+42.742980950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:31:55.367678 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:55.367628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dfbm" event={"ID":"3bf03637-eac7-4dbf-bca7-1c8c73275d67","Type":"ContainerStarted","Data":"c2851e08b5418bc1b191aca511fb37a221a3e531ace7bb3f2cfa4e20368d35b4"} Jun 10 17:31:55.384592 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:55.384543 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2dfbm" podStartSLOduration=2.338495732 podStartE2EDuration="5.384526277s" totalImagesPullingTime="3.046030545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:31:55.38310888 +0000 UTC m=+39.705277018" watchObservedRunningTime="2026-06-10 17:31:55.384526277 +0000 UTC m=+39.706694390" Jun 10 17:31:58.451470 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:58.451427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:31:58.451907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:31:58.451508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:31:58.451907 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:58.451576 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:31:58.451907 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:58.451601 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:31:58.451907 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:58.451612 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:31:58.451907 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:58.451641 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:06.451624231 +0000 UTC m=+50.773792330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:31:58.451907 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:31:58.451673 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:06.451666462 +0000 UTC m=+50.773834560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:32:06.512583 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:06.512535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:32:06.512583 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:06.512589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:32:06.513165 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:06.512697 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:32:06.513165 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:06.512713 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:32:06.513165 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:06.512732 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:32:06.513165 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:06.512749 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:22.512735536 +0000 UTC m=+66.834903631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:32:06.513165 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:06.512789 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:22.512775683 +0000 UTC m=+66.834943778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:32:16.350922 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:16.350894 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5qlgr" Jun 10 17:32:21.825877 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:21.825830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:32:21.828563 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:21.828546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 17:32:21.840012 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:21.839986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b4e1a2a-9967-43f0-8cdd-59edeb208fc1-original-pull-secret\") pod \"global-pull-secret-syncer-dfwx4\" (UID: \"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1\") " pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:32:21.926564 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:21.926519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:32:21.929083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:21.929068 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 17:32:21.937089 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:21.937073 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 17:32:21.937140 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:21.937131 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:33:25.937115462 +0000 UTC m=+130.259283563 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : secret "metrics-daemon-secret" not found Jun 10 17:32:21.987759 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:21.987716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfwx4" Jun 10 17:32:22.028058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.028006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:32:22.030758 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.030738 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 17:32:22.040973 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.040945 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 17:32:22.052120 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.052075 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnq7\" (UniqueName: \"kubernetes.io/projected/40ac4132-9428-444a-8f2a-34ddebf4fe5d-kube-api-access-9gnq7\") pod \"network-check-target-gbvv6\" (UID: \"40ac4132-9428-444a-8f2a-34ddebf4fe5d\") " pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:32:22.089806 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.089737 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtfgg\"" Jun 10 17:32:22.097740 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.097710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:32:22.114596 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.114567 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dfwx4"] Jun 10 17:32:22.118153 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:32:22.118122 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4e1a2a_9967_43f0_8cdd_59edeb208fc1.slice/crio-5cab2fcfd95fb0e135e258f45f0e790a25583480471e8b2e0ded5461a8eae0f6 WatchSource:0}: Error finding container 5cab2fcfd95fb0e135e258f45f0e790a25583480471e8b2e0ded5461a8eae0f6: Status 404 returned error can't find the container with id 5cab2fcfd95fb0e135e258f45f0e790a25583480471e8b2e0ded5461a8eae0f6 Jun 10 17:32:22.222059 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.222016 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbvv6"] Jun 10 17:32:22.225446 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:32:22.225420 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ac4132_9428_444a_8f2a_34ddebf4fe5d.slice/crio-ab688ec9ea7bf8feb0205f12ba47ba65a5655aac7eff6eef3d2cfb783990e520 WatchSource:0}: Error finding container ab688ec9ea7bf8feb0205f12ba47ba65a5655aac7eff6eef3d2cfb783990e520: Status 404 returned error can't find the container with id ab688ec9ea7bf8feb0205f12ba47ba65a5655aac7eff6eef3d2cfb783990e520 Jun 10 17:32:22.432605 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.432508 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbvv6" event={"ID":"40ac4132-9428-444a-8f2a-34ddebf4fe5d","Type":"ContainerStarted","Data":"ab688ec9ea7bf8feb0205f12ba47ba65a5655aac7eff6eef3d2cfb783990e520"} Jun 10 17:32:22.433543 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.433517 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dfwx4" event={"ID":"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1","Type":"ContainerStarted","Data":"5cab2fcfd95fb0e135e258f45f0e790a25583480471e8b2e0ded5461a8eae0f6"} Jun 10 17:32:22.531114 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.531075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:32:22.531271 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:22.531133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:32:22.531271 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:22.531231 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:32:22.531271 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:22.531245 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:32:22.531271 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:22.531246 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:32:22.531399 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:22.531312 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:54.531293344 +0000 UTC m=+98.853461440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:32:22.531399 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:22.531327 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:32:54.531319414 +0000 UTC m=+98.853487510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:32:25.444605 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:25.444474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbvv6" event={"ID":"40ac4132-9428-444a-8f2a-34ddebf4fe5d","Type":"ContainerStarted","Data":"1129e3a4007c39d2fad10a8f43142d6115066a41464a61255c17fc6e7e2a1631"} Jun 10 17:32:25.445058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:25.444662 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:32:25.460672 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:25.460598 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gbvv6" podStartSLOduration=66.577902354 podStartE2EDuration="1m9.460575962s" totalImagesPullingTime="2.882673608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:32:25.459171042 +0000 UTC m=+69.781339162" watchObservedRunningTime="2026-06-10 17:32:25.460575962 +0000 UTC m=+69.782744084" Jun 10 17:32:27.451196 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:27.451152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dfwx4" event={"ID":"6b4e1a2a-9967-43f0-8cdd-59edeb208fc1","Type":"ContainerStarted","Data":"fb749984cbec2cc127a6079fa61963eae6069462c3c1586403782abb0c768dd6"} Jun 10 17:32:27.472845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:27.472794 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dfwx4" podStartSLOduration=67.041132567 podStartE2EDuration="1m11.472777642s" totalImagesPullingTime="4.431645075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:32:27.47230268 +0000 UTC m=+71.794470798" watchObservedRunningTime="2026-06-10 17:32:27.472777642 +0000 UTC m=+71.794945760" Jun 10 17:32:54.554603 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:54.554485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:32:54.554603 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:54.554559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:32:54.555106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:54.554661 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:32:54.555106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:54.554673 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:32:54.555106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:54.554679 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:32:54.555106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:54.554723 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:33:58.554709621 +0000 UTC m=+162.876877716 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:32:54.555106 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:32:54.554735 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:33:58.554729867 +0000 UTC m=+162.876897962 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:32:56.450554 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:32:56.450518 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gbvv6" Jun 10 17:33:25.962007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:33:25.961958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:33:25.962548 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:25.962128 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 17:33:25.962548 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:25.962212 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs podName:56b2c968-078f-451e-a1e6-9563048127cb nodeName:}" failed. No retries permitted until 2026-06-10 17:35:27.96219267 +0000 UTC m=+252.284360765 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs") pod "network-metrics-daemon-22wk7" (UID: "56b2c968-078f-451e-a1e6-9563048127cb") : secret "metrics-daemon-secret" not found Jun 10 17:33:53.630901 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:53.630855 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" Jun 10 17:33:53.642037 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:53.642004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x27wn" podUID="2fedef23-1c8a-4e54-aea0-341b98460186" Jun 10 17:33:53.657010 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:33:53.656982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x27wn" Jun 10 17:33:53.657115 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:33:53.656988 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:33:55.091463 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:55.091424 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-22wk7" podUID="56b2c968-078f-451e-a1e6-9563048127cb" Jun 10 17:33:58.584000 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:33:58.583951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:33:58.584468 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:33:58.584022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:33:58.584468 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:58.584122 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 17:33:58.584468 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:58.584129 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 17:33:58.584468 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:58.584208 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls podName:2fedef23-1c8a-4e54-aea0-341b98460186 nodeName:}" failed. No retries permitted until 2026-06-10 17:36:00.584191246 +0000 UTC m=+284.906359346 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls") pod "dns-default-x27wn" (UID: "2fedef23-1c8a-4e54-aea0-341b98460186") : secret "dns-default-metrics-tls" not found Jun 10 17:33:58.584468 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:58.584134 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f76c75bc8-cpgdl: secret "image-registry-tls" not found Jun 10 17:33:58.584468 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:33:58.584282 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls podName:90712d7b-2ad2-4e88-a5ba-de728e1d77f5 nodeName:}" failed. No retries permitted until 2026-06-10 17:36:00.584269984 +0000 UTC m=+284.906438079 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls") pod "image-registry-f76c75bc8-cpgdl" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5") : secret "image-registry-tls" not found Jun 10 17:34:07.077241 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:07.077151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:34:46.151978 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.151942 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4"] Jun 10 17:34:46.155198 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.155177 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6"] Jun 10 17:34:46.155314 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.155294 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" Jun 10 17:34:46.157722 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.157693 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-d9mm4"] Jun 10 17:34:46.157857 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.157834 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:34:46.157857 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.157843 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.158028 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.158009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8jh2k\"" Jun 10 17:34:46.158147 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.158126 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 17:34:46.159914 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.159898 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 17:34:46.160020 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.159919 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 17:34:46.160201 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.160185 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2wlq4\"" Jun 10 17:34:46.160509 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.160489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.162766 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.162366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ggk4n\"" Jun 10 17:34:46.162836 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.162793 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 17:34:46.163042 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.163002 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 17:34:46.163042 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.163016 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:34:46.163042 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.163034 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 17:34:46.164730 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.164705 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4"] Jun 10 17:34:46.165603 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.165583 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6"] Jun 10 17:34:46.167429 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.167409 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-d9mm4"] Jun 10 17:34:46.168433 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.168412 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 17:34:46.216271 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/200f2e18-3f93-419d-96da-462c31e3c021-config\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.216423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.216423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.216423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f2e18-3f93-419d-96da-462c31e3c021-trusted-ca\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.216423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvrwc\" (UniqueName: \"kubernetes.io/projected/200f2e18-3f93-419d-96da-462c31e3c021-kube-api-access-tvrwc\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.216423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/200f2e18-3f93-419d-96da-462c31e3c021-serving-cert\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.216581 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.216514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjx7m\" (UniqueName: \"kubernetes.io/projected/1f2087c0-e5aa-4bfe-a98e-d358b3f2c242-kube-api-access-rjx7m\") pod \"volume-data-source-validator-78dd696465-5bjp4\" (UID: \"1f2087c0-e5aa-4bfe-a98e-d358b3f2c242\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" Jun 10 17:34:46.246488 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.246460 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st"] Jun 10 17:34:46.249271 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.249257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.251688 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.251667 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 17:34:46.251800 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.251734 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:34:46.251880 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.251864 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 17:34:46.251928 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.251876 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fqnw5\"" Jun 10 17:34:46.252225 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.252210 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 17:34:46.253786 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.253764 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d"] Jun 10 17:34:46.256307 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.256290 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-kztrg"] Jun 10 17:34:46.256432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.256416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.258901 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.258873 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 17:34:46.259137 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.259115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.259920 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.259903 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st"] Jun 10 17:34:46.260841 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.260720 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 17:34:46.260841 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.260758 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 17:34:46.260841 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.260798 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 17:34:46.261063 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.260911 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nd6vw\"" Jun 10 17:34:46.261192 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.261178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 17:34:46.261480 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.261468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9s746\"" Jun 10 17:34:46.261587 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.261571 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 17:34:46.261818 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.261804 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 17:34:46.261886 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.261827 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 17:34:46.267685 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.267668 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 17:34:46.272323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.272304 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-kztrg"] Jun 10 17:34:46.279365 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.279341 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d"] Jun 10 17:34:46.317804 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.317765 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/200f2e18-3f93-419d-96da-462c31e3c021-config\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.317958 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.317809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9da83fbf-3933-4871-8c10-8461d9500ced-trusted-ca-bundle\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.317958 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.317840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.317958 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.317903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvrwc\" (UniqueName: \"kubernetes.io/projected/200f2e18-3f93-419d-96da-462c31e3c021-kube-api-access-tvrwc\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.317958 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.317927 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 17:34:46.317958 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.317938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f2e18-3f93-419d-96da-462c31e3c021-trusted-ca\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.317980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed144d4c-1d23-4dd5-a4df-6279a77e8691-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.317993 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert podName:3239c6f1-eea4-4758-ab8f-6bbf55d5d08d nodeName:}" failed. No retries permitted until 2026-06-10 17:34:46.817976965 +0000 UTC m=+211.140145061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvnh6" (UID: "3239c6f1-eea4-4758-ab8f-6bbf55d5d08d") : secret "networking-console-plugin-cert" not found Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxjv\" (UniqueName: \"kubernetes.io/projected/2828d5bc-8860-447d-82ab-5727002bee49-kube-api-access-2mxjv\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9da83fbf-3933-4871-8c10-8461d9500ced-snapshots\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5kcn\" (UniqueName: \"kubernetes.io/projected/ed144d4c-1d23-4dd5-a4df-6279a77e8691-kube-api-access-l5kcn\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2828d5bc-8860-447d-82ab-5727002bee49-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.318169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkjkt\" (UniqueName: \"kubernetes.io/projected/9da83fbf-3933-4871-8c10-8461d9500ced-kube-api-access-kkjkt\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.318437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjx7m\" (UniqueName: \"kubernetes.io/projected/1f2087c0-e5aa-4bfe-a98e-d358b3f2c242-kube-api-access-rjx7m\") pod \"volume-data-source-validator-78dd696465-5bjp4\" (UID: \"1f2087c0-e5aa-4bfe-a98e-d358b3f2c242\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" Jun 10 17:34:46.318437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9da83fbf-3933-4871-8c10-8461d9500ced-tmp\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.318437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9da83fbf-3933-4871-8c10-8461d9500ced-serving-cert\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.318437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.318437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9da83fbf-3933-4871-8c10-8461d9500ced-service-ca-bundle\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.318585 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2828d5bc-8860-447d-82ab-5727002bee49-config\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.318585 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318472 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/200f2e18-3f93-419d-96da-462c31e3c021-config\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.318585 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/200f2e18-3f93-419d-96da-462c31e3c021-serving-cert\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.318585 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.318538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.319163 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.319067 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.319493 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.319473 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/200f2e18-3f93-419d-96da-462c31e3c021-trusted-ca\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.320854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.320835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/200f2e18-3f93-419d-96da-462c31e3c021-serving-cert\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.326291 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.326271 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvrwc\" (UniqueName: \"kubernetes.io/projected/200f2e18-3f93-419d-96da-462c31e3c021-kube-api-access-tvrwc\") pod \"console-operator-668fdbf85c-d9mm4\" (UID: \"200f2e18-3f93-419d-96da-462c31e3c021\") " pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.326392 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.326356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjx7m\" (UniqueName: \"kubernetes.io/projected/1f2087c0-e5aa-4bfe-a98e-d358b3f2c242-kube-api-access-rjx7m\") pod \"volume-data-source-validator-78dd696465-5bjp4\" (UID: \"1f2087c0-e5aa-4bfe-a98e-d358b3f2c242\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" Jun 10 17:34:46.350420 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.350395 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6484d6f5fc-q6mtj"] Jun 10 17:34:46.354769 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.354752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.357390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357369 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 17:34:46.357390 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357381 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 17:34:46.357576 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357399 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 17:34:46.357576 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357466 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 17:34:46.357700 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357635 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wmtll\"" Jun 10 17:34:46.357817 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 17:34:46.357817 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.357815 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 17:34:46.365530 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.365508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6484d6f5fc-q6mtj"] Jun 10 17:34:46.419770 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.419691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxjv\" (UniqueName: \"kubernetes.io/projected/2828d5bc-8860-447d-82ab-5727002bee49-kube-api-access-2mxjv\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.419770 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.419737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9da83fbf-3933-4871-8c10-8461d9500ced-snapshots\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.419770 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.419766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5kcn\" (UniqueName: \"kubernetes.io/projected/ed144d4c-1d23-4dd5-a4df-6279a77e8691-kube-api-access-l5kcn\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.419992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.419791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2828d5bc-8860-447d-82ab-5727002bee49-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.419992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.419927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjkt\" (UniqueName: \"kubernetes.io/projected/9da83fbf-3933-4871-8c10-8461d9500ced-kube-api-access-kkjkt\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.419992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.419978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9da83fbf-3933-4871-8c10-8461d9500ced-tmp\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.420113 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9da83fbf-3933-4871-8c10-8461d9500ced-serving-cert\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.420113 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.420113 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9da83fbf-3933-4871-8c10-8461d9500ced-service-ca-bundle\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.420270 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-default-certificate\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.420270 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2828d5bc-8860-447d-82ab-5727002bee49-config\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.420270 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.420186 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:46.420270 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-stats-auth\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.420516 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.420288 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls podName:ed144d4c-1d23-4dd5-a4df-6279a77e8691 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:46.920264548 +0000 UTC m=+211.242432658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5kk5d" (UID: "ed144d4c-1d23-4dd5-a4df-6279a77e8691") : secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:46.420516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9da83fbf-3933-4871-8c10-8461d9500ced-trusted-ca-bundle\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.420516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.420516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9da83fbf-3933-4871-8c10-8461d9500ced-tmp\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.420516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420436 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9da83fbf-3933-4871-8c10-8461d9500ced-snapshots\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.420516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.420831 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smf89\" (UniqueName: \"kubernetes.io/projected/59e73a71-13de-44ec-8d7f-46785d02cf33-kube-api-access-smf89\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.420831 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed144d4c-1d23-4dd5-a4df-6279a77e8691-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.420921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420877 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2828d5bc-8860-447d-82ab-5727002bee49-config\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.420968 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.420788 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9da83fbf-3933-4871-8c10-8461d9500ced-service-ca-bundle\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.421546 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.421522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ed144d4c-1d23-4dd5-a4df-6279a77e8691-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.421714 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.421697 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9da83fbf-3933-4871-8c10-8461d9500ced-trusted-ca-bundle\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.422451 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.422431 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2828d5bc-8860-447d-82ab-5727002bee49-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.422591 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.422576 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9da83fbf-3933-4871-8c10-8461d9500ced-serving-cert\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.429191 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.429169 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxjv\" (UniqueName: \"kubernetes.io/projected/2828d5bc-8860-447d-82ab-5727002bee49-kube-api-access-2mxjv\") pod \"service-ca-operator-6bc5ff68f5-jq2st\" (UID: \"2828d5bc-8860-447d-82ab-5727002bee49\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.429775 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.429753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjkt\" (UniqueName: \"kubernetes.io/projected/9da83fbf-3933-4871-8c10-8461d9500ced-kube-api-access-kkjkt\") pod \"insights-operator-896549976-kztrg\" (UID: \"9da83fbf-3933-4871-8c10-8461d9500ced\") " pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.429854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.429758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5kcn\" (UniqueName: \"kubernetes.io/projected/ed144d4c-1d23-4dd5-a4df-6279a77e8691-kube-api-access-l5kcn\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.466221 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.466193 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" Jun 10 17:34:46.478986 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.478967 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:46.522007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.521336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-stats-auth\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.522007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.521391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.522007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.521437 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.522007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.521468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smf89\" (UniqueName: \"kubernetes.io/projected/59e73a71-13de-44ec-8d7f-46785d02cf33-kube-api-access-smf89\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.522007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.521554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-default-certificate\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.522602 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.522568 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:47.02254525 +0000 UTC m=+211.344713368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : configmap references non-existent config key: service-ca.crt Jun 10 17:34:46.522838 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.522807 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 17:34:46.522918 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.522874 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:47.022856832 +0000 UTC m=+211.345024937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : secret "router-metrics-certs-default" not found Jun 10 17:34:46.525024 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.525001 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-default-certificate\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.525114 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.525049 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-stats-auth\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.532016 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.531975 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smf89\" (UniqueName: \"kubernetes.io/projected/59e73a71-13de-44ec-8d7f-46785d02cf33-kube-api-access-smf89\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:46.558278 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.558248 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" Jun 10 17:34:46.572965 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.572935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-kztrg" Jun 10 17:34:46.604063 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.604030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4"] Jun 10 17:34:46.607337 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:34:46.607133 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2087c0_e5aa_4bfe_a98e_d358b3f2c242.slice/crio-4250415cff15fdcfe143538ccf9f9d0a67c65cc71d750b91838148d91049466e WatchSource:0}: Error finding container 4250415cff15fdcfe143538ccf9f9d0a67c65cc71d750b91838148d91049466e: Status 404 returned error can't find the container with id 4250415cff15fdcfe143538ccf9f9d0a67c65cc71d750b91838148d91049466e Jun 10 17:34:46.617347 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.617279 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-d9mm4"] Jun 10 17:34:46.623240 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:34:46.623212 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200f2e18_3f93_419d_96da_462c31e3c021.slice/crio-9a7bd9268ec43eb5986df3a308312d82300226bb54c64984e34d8427a25aa45f WatchSource:0}: Error finding container 9a7bd9268ec43eb5986df3a308312d82300226bb54c64984e34d8427a25aa45f: Status 404 returned error can't find the container with id 9a7bd9268ec43eb5986df3a308312d82300226bb54c64984e34d8427a25aa45f Jun 10 17:34:46.702572 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.702543 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st"] Jun 10 17:34:46.705726 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:34:46.705701 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2828d5bc_8860_447d_82ab_5727002bee49.slice/crio-45f48715c768d56c290c6b950da0f9916f5def00ca3abc9753a82a6497c4236e WatchSource:0}: Error finding container 45f48715c768d56c290c6b950da0f9916f5def00ca3abc9753a82a6497c4236e: Status 404 returned error can't find the container with id 45f48715c768d56c290c6b950da0f9916f5def00ca3abc9753a82a6497c4236e Jun 10 17:34:46.721128 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.721102 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-kztrg"] Jun 10 17:34:46.723815 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:34:46.723784 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da83fbf_3933_4871_8c10_8461d9500ced.slice/crio-8cc3678f87d1f1f702e3ba36b01b7251e766c4287803b101b54787fe8b6bfa5f WatchSource:0}: Error finding container 8cc3678f87d1f1f702e3ba36b01b7251e766c4287803b101b54787fe8b6bfa5f: Status 404 returned error can't find the container with id 8cc3678f87d1f1f702e3ba36b01b7251e766c4287803b101b54787fe8b6bfa5f Jun 10 17:34:46.788680 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.788630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" event={"ID":"200f2e18-3f93-419d-96da-462c31e3c021","Type":"ContainerStarted","Data":"9a7bd9268ec43eb5986df3a308312d82300226bb54c64984e34d8427a25aa45f"} Jun 10 17:34:46.789695 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.789673 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" event={"ID":"1f2087c0-e5aa-4bfe-a98e-d358b3f2c242","Type":"ContainerStarted","Data":"4250415cff15fdcfe143538ccf9f9d0a67c65cc71d750b91838148d91049466e"} Jun 10 17:34:46.790611 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.790583 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" event={"ID":"2828d5bc-8860-447d-82ab-5727002bee49","Type":"ContainerStarted","Data":"45f48715c768d56c290c6b950da0f9916f5def00ca3abc9753a82a6497c4236e"} Jun 10 17:34:46.791506 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.791486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kztrg" event={"ID":"9da83fbf-3933-4871-8c10-8461d9500ced","Type":"ContainerStarted","Data":"8cc3678f87d1f1f702e3ba36b01b7251e766c4287803b101b54787fe8b6bfa5f"} Jun 10 17:34:46.823940 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.823905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:46.824065 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.824047 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 17:34:46.824118 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.824105 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert podName:3239c6f1-eea4-4758-ab8f-6bbf55d5d08d nodeName:}" failed. No retries permitted until 2026-06-10 17:34:47.824089593 +0000 UTC m=+212.146257690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvnh6" (UID: "3239c6f1-eea4-4758-ab8f-6bbf55d5d08d") : secret "networking-console-plugin-cert" not found Jun 10 17:34:46.925003 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:46.924917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:46.925130 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.925048 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:46.925130 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:46.925108 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls podName:ed144d4c-1d23-4dd5-a4df-6279a77e8691 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:47.925093998 +0000 UTC m=+212.247262094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5kk5d" (UID: "ed144d4c-1d23-4dd5-a4df-6279a77e8691") : secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:47.025348 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:47.025317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:47.025521 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:47.025376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:47.025521 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.025480 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 17:34:47.025633 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.025560 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:48.025538997 +0000 UTC m=+212.347707110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : secret "router-metrics-certs-default" not found Jun 10 17:34:47.025633 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.025595 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:48.025576346 +0000 UTC m=+212.347744457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : configmap references non-existent config key: service-ca.crt Jun 10 17:34:47.797983 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:47.797680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" event={"ID":"1f2087c0-e5aa-4bfe-a98e-d358b3f2c242","Type":"ContainerStarted","Data":"f1e232e47f60da805da8bb28efd20591d1dcd3f5d72401f97a6afe9d7c0a5ff4"} Jun 10 17:34:47.812455 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:47.812337 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5bjp4" podStartSLOduration=0.699825963 podStartE2EDuration="1.812316112s" totalImagesPullingTime="1.112490149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:34:47.811751122 +0000 UTC m=+212.133919240" watchObservedRunningTime="2026-06-10 17:34:47.812316112 +0000 UTC m=+212.134484231" Jun 10 17:34:47.833023 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.832967 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 17:34:47.833187 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.833092 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert podName:3239c6f1-eea4-4758-ab8f-6bbf55d5d08d nodeName:}" failed. No retries permitted until 2026-06-10 17:34:49.833043164 +0000 UTC m=+214.155211263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvnh6" (UID: "3239c6f1-eea4-4758-ab8f-6bbf55d5d08d") : secret "networking-console-plugin-cert" not found Jun 10 17:34:47.833324 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:47.833296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:47.935365 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:47.934392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:47.935365 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.934550 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:47.935365 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:47.934614 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls podName:ed144d4c-1d23-4dd5-a4df-6279a77e8691 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:49.934594514 +0000 UTC m=+214.256762629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5kk5d" (UID: "ed144d4c-1d23-4dd5-a4df-6279a77e8691") : secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:48.035742 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:48.035630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:48.035742 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:48.035718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:48.035962 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:48.035821 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 17:34:48.035962 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:48.035889 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:50.035866229 +0000 UTC m=+214.358034331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : configmap references non-existent config key: service-ca.crt Jun 10 17:34:48.035962 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:48.035916 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:50.03590591 +0000 UTC m=+214.358074010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : secret "router-metrics-certs-default" not found Jun 10 17:34:49.733402 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.733367 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn"] Jun 10 17:34:49.737485 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.737461 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" Jun 10 17:34:49.740243 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.740212 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 17:34:49.740346 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.740225 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 17:34:49.740346 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.740225 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xmg6r\"" Jun 10 17:34:49.748014 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.747988 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn"] Jun 10 17:34:49.852222 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.852193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln94w\" (UniqueName: \"kubernetes.io/projected/00d3677b-33d1-40c2-9e26-82bbe553cb03-kube-api-access-ln94w\") pod \"migrator-955ffdf5f-gf4tn\" (UID: \"00d3677b-33d1-40c2-9e26-82bbe553cb03\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" Jun 10 17:34:49.852300 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.852272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:49.852367 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:49.852355 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 17:34:49.852418 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:49.852410 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert podName:3239c6f1-eea4-4758-ab8f-6bbf55d5d08d nodeName:}" failed. No retries permitted until 2026-06-10 17:34:53.852395176 +0000 UTC m=+218.174563271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvnh6" (UID: "3239c6f1-eea4-4758-ab8f-6bbf55d5d08d") : secret "networking-console-plugin-cert" not found Jun 10 17:34:49.953300 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.953263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:49.953484 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.953311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln94w\" (UniqueName: \"kubernetes.io/projected/00d3677b-33d1-40c2-9e26-82bbe553cb03-kube-api-access-ln94w\") pod \"migrator-955ffdf5f-gf4tn\" (UID: \"00d3677b-33d1-40c2-9e26-82bbe553cb03\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" Jun 10 17:34:49.953572 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:49.953552 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:49.953663 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:49.953629 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls podName:ed144d4c-1d23-4dd5-a4df-6279a77e8691 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:53.953601845 +0000 UTC m=+218.275769964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5kk5d" (UID: "ed144d4c-1d23-4dd5-a4df-6279a77e8691") : secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:49.962502 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:49.962297 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln94w\" (UniqueName: \"kubernetes.io/projected/00d3677b-33d1-40c2-9e26-82bbe553cb03-kube-api-access-ln94w\") pod \"migrator-955ffdf5f-gf4tn\" (UID: \"00d3677b-33d1-40c2-9e26-82bbe553cb03\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" Jun 10 17:34:50.050184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.050124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" Jun 10 17:34:50.054285 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.054258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:50.054369 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.054333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:50.054464 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:50.054444 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 17:34:50.054539 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:50.054491 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:54.054469771 +0000 UTC m=+218.376637881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : configmap references non-existent config key: service-ca.crt Jun 10 17:34:50.054615 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:50.054558 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:34:54.054534411 +0000 UTC m=+218.376702520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : secret "router-metrics-certs-default" not found Jun 10 17:34:50.192487 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.192453 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn"] Jun 10 17:34:50.195892 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:34:50.195861 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d3677b_33d1_40c2_9e26_82bbe553cb03.slice/crio-879417b6bdf7f3d867ed0d073311d5a9f69ae35846e8b77fc8e9bf1fa0ea42b6 WatchSource:0}: Error finding container 879417b6bdf7f3d867ed0d073311d5a9f69ae35846e8b77fc8e9bf1fa0ea42b6: Status 404 returned error can't find the container with id 879417b6bdf7f3d867ed0d073311d5a9f69ae35846e8b77fc8e9bf1fa0ea42b6 Jun 10 17:34:50.809679 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.809366 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" event={"ID":"2828d5bc-8860-447d-82ab-5727002bee49","Type":"ContainerStarted","Data":"f8e9b82f9579722f2510d998e57474e11139a5ae5c8faa2d40c65d274d2eb9b2"} Jun 10 17:34:50.810885 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.810853 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" event={"ID":"00d3677b-33d1-40c2-9e26-82bbe553cb03","Type":"ContainerStarted","Data":"879417b6bdf7f3d867ed0d073311d5a9f69ae35846e8b77fc8e9bf1fa0ea42b6"} Jun 10 17:34:50.812826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.812795 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kztrg" event={"ID":"9da83fbf-3933-4871-8c10-8461d9500ced","Type":"ContainerStarted","Data":"786c1da4bac706985647fe8e6473d9bfa470b94eca75e31e4bbf8f06b94f0584"} Jun 10 17:34:50.814943 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.814921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/0.log" Jun 10 17:34:50.815069 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.814965 2580 generic.go:356] "Generic (PLEG): container finished" podID="200f2e18-3f93-419d-96da-462c31e3c021" containerID="a109e99e3f79397937544a0ce2f1346b63910ab57fcf0f106ff94365492d03cf" exitCode=255 Jun 10 17:34:50.815069 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.814994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" event={"ID":"200f2e18-3f93-419d-96da-462c31e3c021","Type":"ContainerDied","Data":"a109e99e3f79397937544a0ce2f1346b63910ab57fcf0f106ff94365492d03cf"} Jun 10 17:34:50.815278 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.815261 2580 scope.go:117] "RemoveContainer" containerID="a109e99e3f79397937544a0ce2f1346b63910ab57fcf0f106ff94365492d03cf" Jun 10 17:34:50.828452 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:50.825914 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" podStartSLOduration=1.665525738 podStartE2EDuration="4.825897264s" totalImagesPullingTime="3.160371526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:34:50.823967206 +0000 UTC m=+215.146135327" watchObservedRunningTime="2026-06-10 17:34:50.825897264 +0000 UTC m=+215.148065382" Jun 10 17:34:51.821455 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.821412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" event={"ID":"00d3677b-33d1-40c2-9e26-82bbe553cb03","Type":"ContainerStarted","Data":"db7da05dcc9dacd497ad63c1a063231cbe0b527faf487cf443ce8cd82b802159"} Jun 10 17:34:51.821934 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.821509 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" event={"ID":"00d3677b-33d1-40c2-9e26-82bbe553cb03","Type":"ContainerStarted","Data":"7236be551e996b0c4860e143357bb9c7345f31b97b5b1f003158a0332267906e"} Jun 10 17:34:51.823288 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.823266 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/1.log" Jun 10 17:34:51.823678 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.823662 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/0.log" Jun 10 17:34:51.823764 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.823695 2580 generic.go:356] "Generic (PLEG): container finished" podID="200f2e18-3f93-419d-96da-462c31e3c021" containerID="8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208" exitCode=255 Jun 10 17:34:51.823764 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.823724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" event={"ID":"200f2e18-3f93-419d-96da-462c31e3c021","Type":"ContainerDied","Data":"8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208"} Jun 10 17:34:51.823867 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.823778 2580 scope.go:117] "RemoveContainer" containerID="a109e99e3f79397937544a0ce2f1346b63910ab57fcf0f106ff94365492d03cf" Jun 10 17:34:51.824048 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.824023 2580 scope.go:117] "RemoveContainer" containerID="8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208" Jun 10 17:34:51.824262 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:51.824215 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-d9mm4_openshift-console-operator(200f2e18-3f93-419d-96da-462c31e3c021)\"" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" podUID="200f2e18-3f93-419d-96da-462c31e3c021" Jun 10 17:34:51.835424 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.835307 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-kztrg" podStartSLOduration=2.686778057 podStartE2EDuration="5.835289081s" totalImagesPullingTime="3.148511024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:34:50.858212315 +0000 UTC m=+215.180380435" watchObservedRunningTime="2026-06-10 17:34:51.835289081 +0000 UTC m=+216.157457200" Jun 10 17:34:51.836945 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:51.836898 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-gf4tn" podStartSLOduration=1.6634332189999999 podStartE2EDuration="2.836881374s" totalImagesPullingTime="1.173448155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:34:51.834838233 +0000 UTC m=+216.157006377" watchObservedRunningTime="2026-06-10 17:34:51.836881374 +0000 UTC m=+216.159049494" Jun 10 17:34:52.829536 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:52.829507 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/1.log" Jun 10 17:34:52.830051 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:52.829983 2580 scope.go:117] "RemoveContainer" containerID="8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208" Jun 10 17:34:52.830185 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:52.830163 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-d9mm4_openshift-console-operator(200f2e18-3f93-419d-96da-462c31e3c021)\"" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" podUID="200f2e18-3f93-419d-96da-462c31e3c021" Jun 10 17:34:53.887521 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:53.887484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:34:53.887915 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:53.887605 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 17:34:53.887915 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:53.887676 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert podName:3239c6f1-eea4-4758-ab8f-6bbf55d5d08d nodeName:}" failed. No retries permitted until 2026-06-10 17:35:01.887641465 +0000 UTC m=+226.209809562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvnh6" (UID: "3239c6f1-eea4-4758-ab8f-6bbf55d5d08d") : secret "networking-console-plugin-cert" not found Jun 10 17:34:53.988204 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:53.988172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:34:53.988353 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:53.988335 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:53.988411 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:53.988401 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls podName:ed144d4c-1d23-4dd5-a4df-6279a77e8691 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:01.988382622 +0000 UTC m=+226.310550720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5kk5d" (UID: "ed144d4c-1d23-4dd5-a4df-6279a77e8691") : secret "cluster-monitoring-operator-tls" not found Jun 10 17:34:54.089120 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:54.089091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:54.089281 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:54.089139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:34:54.089281 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:54.089243 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 17:34:54.089382 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:54.089293 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:02.089280643 +0000 UTC m=+226.411448744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : configmap references non-existent config key: service-ca.crt Jun 10 17:34:54.089382 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:54.089311 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:02.089303566 +0000 UTC m=+226.411471667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : secret "router-metrics-certs-default" not found Jun 10 17:34:54.661462 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:54.661430 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4pf4_29f2f3b8-ef75-49fb-a219-2c596d3a32ba/dns-node-resolver/0.log" Jun 10 17:34:55.461050 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:55.461019 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bs69v_748a318c-0372-46ed-92b9-68da6ef49669/node-ca/0.log" Jun 10 17:34:56.260640 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:56.260607 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dfbm_3bf03637-eac7-4dbf-bca7-1c8c73275d67/serve-healthcheck-canary/0.log" Jun 10 17:34:56.479988 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:56.479961 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:56.480423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:56.480019 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:34:56.480423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:56.480392 2580 scope.go:117] "RemoveContainer" containerID="8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208" Jun 10 17:34:56.480608 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:34:56.480586 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-d9mm4_openshift-console-operator(200f2e18-3f93-419d-96da-462c31e3c021)\"" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" podUID="200f2e18-3f93-419d-96da-462c31e3c021" Jun 10 17:34:56.861381 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:56.861315 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-gf4tn_00d3677b-33d1-40c2-9e26-82bbe553cb03/migrator/0.log" Jun 10 17:34:57.060805 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:34:57.060775 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-gf4tn_00d3677b-33d1-40c2-9e26-82bbe553cb03/graceful-termination/0.log" Jun 10 17:35:01.954026 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:01.953992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:35:01.954433 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:01.954134 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 17:35:01.954433 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:01.954200 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert podName:3239c6f1-eea4-4758-ab8f-6bbf55d5d08d nodeName:}" failed. No retries permitted until 2026-06-10 17:35:17.954184533 +0000 UTC m=+242.276352633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qvnh6" (UID: "3239c6f1-eea4-4758-ab8f-6bbf55d5d08d") : secret "networking-console-plugin-cert" not found Jun 10 17:35:02.054589 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:02.054560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:35:02.054738 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:02.054720 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 17:35:02.054803 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:02.054793 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls podName:ed144d4c-1d23-4dd5-a4df-6279a77e8691 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:18.054779712 +0000 UTC m=+242.376947809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-5kk5d" (UID: "ed144d4c-1d23-4dd5-a4df-6279a77e8691") : secret "cluster-monitoring-operator-tls" not found Jun 10 17:35:02.154919 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:02.154892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:02.155029 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:02.154932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:02.155029 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:02.155015 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 17:35:02.155096 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:02.155071 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:18.15505811 +0000 UTC m=+242.477226206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : secret "router-metrics-certs-default" not found Jun 10 17:35:02.155096 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:02.155090 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle podName:59e73a71-13de-44ec-8d7f-46785d02cf33 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:18.155078658 +0000 UTC m=+242.477246757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle") pod "router-default-6484d6f5fc-q6mtj" (UID: "59e73a71-13de-44ec-8d7f-46785d02cf33") : configmap references non-existent config key: service-ca.crt Jun 10 17:35:09.077728 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.077692 2580 scope.go:117] "RemoveContainer" containerID="8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208" Jun 10 17:35:09.884465 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.884431 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:35:09.884976 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.884957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/1.log" Jun 10 17:35:09.885030 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.884996 2580 generic.go:356] "Generic (PLEG): container finished" podID="200f2e18-3f93-419d-96da-462c31e3c021" containerID="e32f1b4bbbd12b1618e73ad6e5b6753ce3f081153de3dc553e8350aea93041d6" exitCode=255 Jun 10 17:35:09.885078 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.885056 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" event={"ID":"200f2e18-3f93-419d-96da-462c31e3c021","Type":"ContainerDied","Data":"e32f1b4bbbd12b1618e73ad6e5b6753ce3f081153de3dc553e8350aea93041d6"} Jun 10 17:35:09.885120 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.885111 2580 scope.go:117] "RemoveContainer" containerID="8b8e24bf07f0fc961e5f864171fc6f0070e670795d365c5ab89e5e43a34d7208" Jun 10 17:35:09.885435 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:09.885407 2580 scope.go:117] "RemoveContainer" containerID="e32f1b4bbbd12b1618e73ad6e5b6753ce3f081153de3dc553e8350aea93041d6" Jun 10 17:35:09.885660 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:09.885614 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-d9mm4_openshift-console-operator(200f2e18-3f93-419d-96da-462c31e3c021)\"" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" podUID="200f2e18-3f93-419d-96da-462c31e3c021" Jun 10 17:35:10.889768 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:10.889734 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:35:12.194359 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.194319 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m6mw4"] Jun 10 17:35:12.198767 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.198742 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.202560 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.202524 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m95g2\"" Jun 10 17:35:12.202560 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.202551 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 17:35:12.202738 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.202551 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 17:35:12.210090 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.210067 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m6mw4"] Jun 10 17:35:12.337242 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.337218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff72039c-1496-4dc5-9700-304a54c66348-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.337354 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.337264 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72039c-1496-4dc5-9700-304a54c66348-data-volume\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.337425 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.337335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6n5c\" (UniqueName: \"kubernetes.io/projected/ff72039c-1496-4dc5-9700-304a54c66348-kube-api-access-d6n5c\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.337425 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.337385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff72039c-1496-4dc5-9700-304a54c66348-crio-socket\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.337501 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.337441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff72039c-1496-4dc5-9700-304a54c66348-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438062 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff72039c-1496-4dc5-9700-304a54c66348-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438147 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72039c-1496-4dc5-9700-304a54c66348-data-volume\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438147 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6n5c\" (UniqueName: \"kubernetes.io/projected/ff72039c-1496-4dc5-9700-304a54c66348-kube-api-access-d6n5c\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438260 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff72039c-1496-4dc5-9700-304a54c66348-crio-socket\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438260 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff72039c-1496-4dc5-9700-304a54c66348-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438260 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438217 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff72039c-1496-4dc5-9700-304a54c66348-crio-socket\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438463 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438447 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff72039c-1496-4dc5-9700-304a54c66348-data-volume\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.438627 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.438609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff72039c-1496-4dc5-9700-304a54c66348-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.440528 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.440508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff72039c-1496-4dc5-9700-304a54c66348-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.446341 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.446292 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6n5c\" (UniqueName: \"kubernetes.io/projected/ff72039c-1496-4dc5-9700-304a54c66348-kube-api-access-d6n5c\") pod \"insights-runtime-extractor-m6mw4\" (UID: \"ff72039c-1496-4dc5-9700-304a54c66348\") " pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.508621 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.508602 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m6mw4" Jun 10 17:35:12.632909 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.632881 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m6mw4"] Jun 10 17:35:12.635611 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:12.635583 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff72039c_1496_4dc5_9700_304a54c66348.slice/crio-de5fd777e1ed2ba1019006dd3097926bc55b12446969116e990dce26d67f8fc5 WatchSource:0}: Error finding container de5fd777e1ed2ba1019006dd3097926bc55b12446969116e990dce26d67f8fc5: Status 404 returned error can't find the container with id de5fd777e1ed2ba1019006dd3097926bc55b12446969116e990dce26d67f8fc5 Jun 10 17:35:12.898159 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.898125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6mw4" event={"ID":"ff72039c-1496-4dc5-9700-304a54c66348","Type":"ContainerStarted","Data":"ea0924e0be41007d8ff83710c0aeb6844feb2c4393a0fa076738f31395a6e61d"} Jun 10 17:35:12.898287 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:12.898189 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6mw4" event={"ID":"ff72039c-1496-4dc5-9700-304a54c66348","Type":"ContainerStarted","Data":"de5fd777e1ed2ba1019006dd3097926bc55b12446969116e990dce26d67f8fc5"} Jun 10 17:35:13.902403 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:13.902369 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6mw4" event={"ID":"ff72039c-1496-4dc5-9700-304a54c66348","Type":"ContainerStarted","Data":"8238d118c68cbdd1f1d6ed1c9a42d2149df003b4593140165e50f72b059bbaca"} Jun 10 17:35:14.907491 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:14.907458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m6mw4" event={"ID":"ff72039c-1496-4dc5-9700-304a54c66348","Type":"ContainerStarted","Data":"4b2b084a0f21b68f71df689d85cd875e31caf243a40919eca1a00e0df849e3bc"} Jun 10 17:35:14.926315 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:14.926233 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m6mw4" podStartSLOduration=0.99358501 podStartE2EDuration="2.926218504s" totalImagesPullingTime="1.932633494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:14.924412718 +0000 UTC m=+239.246580836" watchObservedRunningTime="2026-06-10 17:35:14.926218504 +0000 UTC m=+239.248386621" Jun 10 17:35:16.479502 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:16.479472 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:35:16.479896 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:16.479527 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:35:16.479896 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:16.479771 2580 scope.go:117] "RemoveContainer" containerID="e32f1b4bbbd12b1618e73ad6e5b6753ce3f081153de3dc553e8350aea93041d6" Jun 10 17:35:16.479967 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:16.479895 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-d9mm4_openshift-console-operator(200f2e18-3f93-419d-96da-462c31e3c021)\"" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" podUID="200f2e18-3f93-419d-96da-462c31e3c021" Jun 10 17:35:17.977205 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:17.977149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:35:17.979688 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:17.979667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3239c6f1-eea4-4758-ab8f-6bbf55d5d08d-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qvnh6\" (UID: \"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:35:18.078164 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.078123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:35:18.080772 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.080750 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed144d4c-1d23-4dd5-a4df-6279a77e8691-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-5kk5d\" (UID: \"ed144d4c-1d23-4dd5-a4df-6279a77e8691\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:35:18.178630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.178591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:18.178630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.178631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:18.179214 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.179186 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59e73a71-13de-44ec-8d7f-46785d02cf33-service-ca-bundle\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:18.181085 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.181057 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59e73a71-13de-44ec-8d7f-46785d02cf33-metrics-certs\") pod \"router-default-6484d6f5fc-q6mtj\" (UID: \"59e73a71-13de-44ec-8d7f-46785d02cf33\") " pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:18.276750 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.276673 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2wlq4\"" Jun 10 17:35:18.284764 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.284743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" Jun 10 17:35:18.369677 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.369636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nd6vw\"" Jun 10 17:35:18.377693 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.377667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" Jun 10 17:35:18.412582 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.412547 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6"] Jun 10 17:35:18.416176 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:18.416149 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3239c6f1_eea4_4758_ab8f_6bbf55d5d08d.slice/crio-29718c402507790817987d5cbc04122c5546ae6253cb894d71019f5ab01209e5 WatchSource:0}: Error finding container 29718c402507790817987d5cbc04122c5546ae6253cb894d71019f5ab01209e5: Status 404 returned error can't find the container with id 29718c402507790817987d5cbc04122c5546ae6253cb894d71019f5ab01209e5 Jun 10 17:35:18.466675 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.466633 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wmtll\"" Jun 10 17:35:18.474656 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.474607 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:18.511810 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.511672 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d"] Jun 10 17:35:18.515245 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:18.515210 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded144d4c_1d23_4dd5_a4df_6279a77e8691.slice/crio-ce96d15566df72640830e5813783b7be701c1dea2c296b64dec1b13dd870dc4e WatchSource:0}: Error finding container ce96d15566df72640830e5813783b7be701c1dea2c296b64dec1b13dd870dc4e: Status 404 returned error can't find the container with id ce96d15566df72640830e5813783b7be701c1dea2c296b64dec1b13dd870dc4e Jun 10 17:35:18.607173 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.607152 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6484d6f5fc-q6mtj"] Jun 10 17:35:18.609382 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:18.609359 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e73a71_13de_44ec_8d7f_46785d02cf33.slice/crio-4e6abcc71b3e89963ffa0c4413dab16d3e7b1c998617817234579e363b41621a WatchSource:0}: Error finding container 4e6abcc71b3e89963ffa0c4413dab16d3e7b1c998617817234579e363b41621a: Status 404 returned error can't find the container with id 4e6abcc71b3e89963ffa0c4413dab16d3e7b1c998617817234579e363b41621a Jun 10 17:35:18.923222 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.923133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" event={"ID":"59e73a71-13de-44ec-8d7f-46785d02cf33","Type":"ContainerStarted","Data":"1307c73c2d1c06cfbcb04d3b068fe75328b099b6c60bb47a26b09c10afb6d20b"} Jun 10 17:35:18.923222 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.923194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" event={"ID":"59e73a71-13de-44ec-8d7f-46785d02cf33","Type":"ContainerStarted","Data":"4e6abcc71b3e89963ffa0c4413dab16d3e7b1c998617817234579e363b41621a"} Jun 10 17:35:18.924600 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.924569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" event={"ID":"ed144d4c-1d23-4dd5-a4df-6279a77e8691","Type":"ContainerStarted","Data":"ce96d15566df72640830e5813783b7be701c1dea2c296b64dec1b13dd870dc4e"} Jun 10 17:35:18.925818 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.925797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" event={"ID":"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d","Type":"ContainerStarted","Data":"29718c402507790817987d5cbc04122c5546ae6253cb894d71019f5ab01209e5"} Jun 10 17:35:18.941570 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:18.941527 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" podStartSLOduration=32.941514791 podStartE2EDuration="32.941514791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:18.941098026 +0000 UTC m=+243.263266168" watchObservedRunningTime="2026-06-10 17:35:18.941514791 +0000 UTC m=+243.263682909" Jun 10 17:35:19.475636 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:19.475588 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:19.478495 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:19.478469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:19.931705 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:19.931630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" event={"ID":"3239c6f1-eea4-4758-ab8f-6bbf55d5d08d","Type":"ContainerStarted","Data":"4d663ee41686c783e170ffaa1e32e62b5f7846adf687d4d61511ce5589e69c5f"} Jun 10 17:35:19.932031 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:19.932007 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:19.933274 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:19.933251 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6484d6f5fc-q6mtj" Jun 10 17:35:19.946662 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:19.946599 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qvnh6" podStartSLOduration=32.613293996 podStartE2EDuration="33.946584294s" totalImagesPullingTime="1.333290298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:19.94532983 +0000 UTC m=+244.267497947" watchObservedRunningTime="2026-06-10 17:35:19.946584294 +0000 UTC m=+244.268752412" Jun 10 17:35:20.851320 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.851293 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q"] Jun 10 17:35:20.854317 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.854301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:20.856687 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.856633 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 17:35:20.856792 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.856692 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xsgcf\"" Jun 10 17:35:20.863200 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.863178 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q"] Jun 10 17:35:20.900904 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.900881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54382e37-796a-4480-97d0-edbcdd16aeb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cch4q\" (UID: \"54382e37-796a-4480-97d0-edbcdd16aeb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:20.936010 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.935985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" event={"ID":"ed144d4c-1d23-4dd5-a4df-6279a77e8691","Type":"ContainerStarted","Data":"0059e8b82573a2686205873338f3d9f1cc02bf3b2192f5eb35ebfeb5eec2f06b"} Jun 10 17:35:20.951289 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:20.951247 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-5kk5d" podStartSLOduration=33.086011077 podStartE2EDuration="34.951234867s" totalImagesPullingTime="1.86522379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:20.950134189 +0000 UTC m=+245.272302308" watchObservedRunningTime="2026-06-10 17:35:20.951234867 +0000 UTC m=+245.273402986" Jun 10 17:35:21.002159 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:21.002135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54382e37-796a-4480-97d0-edbcdd16aeb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cch4q\" (UID: \"54382e37-796a-4480-97d0-edbcdd16aeb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:21.002272 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:21.002240 2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 17:35:21.002332 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:21.002295 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54382e37-796a-4480-97d0-edbcdd16aeb9-tls-certificates podName:54382e37-796a-4480-97d0-edbcdd16aeb9 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:21.502277957 +0000 UTC m=+245.824446069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/54382e37-796a-4480-97d0-edbcdd16aeb9-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-cch4q" (UID: "54382e37-796a-4480-97d0-edbcdd16aeb9") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 17:35:21.506309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:21.506268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54382e37-796a-4480-97d0-edbcdd16aeb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cch4q\" (UID: \"54382e37-796a-4480-97d0-edbcdd16aeb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:21.509054 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:21.509030 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/54382e37-796a-4480-97d0-edbcdd16aeb9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-cch4q\" (UID: \"54382e37-796a-4480-97d0-edbcdd16aeb9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:21.764625 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:21.764547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:21.894969 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:21.894948 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q"] Jun 10 17:35:21.897473 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:21.897444 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54382e37_796a_4480_97d0_edbcdd16aeb9.slice/crio-4bdb7798d1a4c6a4147861c5dabe206c412efd84ea9d7bf30bae264ffcf520e5 WatchSource:0}: Error finding container 4bdb7798d1a4c6a4147861c5dabe206c412efd84ea9d7bf30bae264ffcf520e5: Status 404 returned error can't find the container with id 4bdb7798d1a4c6a4147861c5dabe206c412efd84ea9d7bf30bae264ffcf520e5 Jun 10 17:35:21.940489 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:21.940465 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" event={"ID":"54382e37-796a-4480-97d0-edbcdd16aeb9","Type":"ContainerStarted","Data":"4bdb7798d1a4c6a4147861c5dabe206c412efd84ea9d7bf30bae264ffcf520e5"} Jun 10 17:35:23.948629 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:23.948593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" event={"ID":"54382e37-796a-4480-97d0-edbcdd16aeb9","Type":"ContainerStarted","Data":"e969c185748198397dab0f2db3bf12afdcb265498b73af9df3f1cb8e6caa6834"} Jun 10 17:35:23.949077 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:23.948804 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:23.953235 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:23.953214 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" Jun 10 17:35:23.964671 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:23.964615 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-cch4q" podStartSLOduration=2.538526827 podStartE2EDuration="3.964602418s" totalImagesPullingTime="1.426075591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:23.963571609 +0000 UTC m=+248.285739725" watchObservedRunningTime="2026-06-10 17:35:23.964602418 +0000 UTC m=+248.286770536" Jun 10 17:35:28.050415 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:28.050363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:35:28.053065 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:28.053038 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56b2c968-078f-451e-a1e6-9563048127cb-metrics-certs\") pod \"network-metrics-daemon-22wk7\" (UID: \"56b2c968-078f-451e-a1e6-9563048127cb\") " pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:35:28.079829 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:28.079800 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d9nks\"" Jun 10 17:35:28.087888 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:28.087867 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-22wk7" Jun 10 17:35:28.215377 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:28.215349 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-22wk7"] Jun 10 17:35:28.218057 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:28.218029 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b2c968_078f_451e_a1e6_9563048127cb.slice/crio-457a6df9077ed764e5df6ce6f26f647982823404ecb09cb46e575aed5c9e5da9 WatchSource:0}: Error finding container 457a6df9077ed764e5df6ce6f26f647982823404ecb09cb46e575aed5c9e5da9: Status 404 returned error can't find the container with id 457a6df9077ed764e5df6ce6f26f647982823404ecb09cb46e575aed5c9e5da9 Jun 10 17:35:28.967515 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:28.967384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-22wk7" event={"ID":"56b2c968-078f-451e-a1e6-9563048127cb","Type":"ContainerStarted","Data":"457a6df9077ed764e5df6ce6f26f647982823404ecb09cb46e575aed5c9e5da9"} Jun 10 17:35:29.233836 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.233813 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl"] Jun 10 17:35:29.238072 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.238053 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.240678 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.240636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 17:35:29.241592 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.241554 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 17:35:29.241592 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.241561 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ctsfz\"" Jun 10 17:35:29.241592 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.241555 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 17:35:29.246579 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.246559 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl"] Jun 10 17:35:29.257590 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.257563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxm4t\" (UniqueName: \"kubernetes.io/projected/021dd10b-1941-48b0-b056-36715efaa51b-kube-api-access-fxm4t\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.257712 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.257622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021dd10b-1941-48b0-b056-36715efaa51b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.257778 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.257750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.257888 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.257865 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.258517 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.258494 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9w2j9"] Jun 10 17:35:29.262531 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.262510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.265212 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.265029 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 17:35:29.265212 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.265087 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 17:35:29.265212 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.265139 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wg8c4\"" Jun 10 17:35:29.265212 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.265183 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 17:35:29.359032 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54594941-10bc-49d6-8586-b66ae115e8a6-metrics-client-ca\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359160 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.359160 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359077 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-tls\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359231 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:29.359172 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 10 17:35:29.359231 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:29.359230 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-tls podName:021dd10b-1941-48b0-b056-36715efaa51b nodeName:}" failed. No retries permitted until 2026-06-10 17:35:29.859213315 +0000 UTC m=+254.181381414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-qhbsl" (UID: "021dd10b-1941-48b0-b056-36715efaa51b") : secret "openshift-state-metrics-tls" not found Jun 10 17:35:29.359300 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxm4t\" (UniqueName: \"kubernetes.io/projected/021dd10b-1941-48b0-b056-36715efaa51b-kube-api-access-fxm4t\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.359300 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpp2\" (UniqueName: \"kubernetes.io/projected/54594941-10bc-49d6-8586-b66ae115e8a6-kube-api-access-zbpp2\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021dd10b-1941-48b0-b056-36715efaa51b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.359363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359335 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-root\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.359467 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359467 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-wtmp\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359542 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359542 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-sys\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.359660 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.359607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-textfile\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.360136 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.360112 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/021dd10b-1941-48b0-b056-36715efaa51b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.361882 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.361863 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.369714 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.369695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxm4t\" (UniqueName: \"kubernetes.io/projected/021dd10b-1941-48b0-b056-36715efaa51b-kube-api-access-fxm4t\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.460943 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.460916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54594941-10bc-49d6-8586-b66ae115e8a6-metrics-client-ca\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461016 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.460960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-tls\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461016 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.460989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpp2\" (UniqueName: \"kubernetes.io/projected/54594941-10bc-49d6-8586-b66ae115e8a6-kube-api-access-zbpp2\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461101 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-root\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461101 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461101 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-wtmp\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461101 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:29.461054 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 17:35:29.461101 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461322 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:29.461105 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-tls podName:54594941-10bc-49d6-8586-b66ae115e8a6 nodeName:}" failed. No retries permitted until 2026-06-10 17:35:29.961088193 +0000 UTC m=+254.283256291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-tls") pod "node-exporter-9w2j9" (UID: "54594941-10bc-49d6-8586-b66ae115e8a6") : secret "node-exporter-tls" not found Jun 10 17:35:29.461322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-root\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-sys\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-textfile\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461232 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-wtmp\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54594941-10bc-49d6-8586-b66ae115e8a6-sys\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461513 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461474 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-textfile\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461608 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461592 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.461696 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.461682 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54594941-10bc-49d6-8586-b66ae115e8a6-metrics-client-ca\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.463281 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.463264 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.469339 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.469317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpp2\" (UniqueName: \"kubernetes.io/projected/54594941-10bc-49d6-8586-b66ae115e8a6-kube-api-access-zbpp2\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.864423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.864388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.866966 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.866943 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/021dd10b-1941-48b0-b056-36715efaa51b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-qhbsl\" (UID: \"021dd10b-1941-48b0-b056-36715efaa51b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:29.964975 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.964942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-tls\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.967697 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.967673 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54594941-10bc-49d6-8586-b66ae115e8a6-node-exporter-tls\") pod \"node-exporter-9w2j9\" (UID: \"54594941-10bc-49d6-8586-b66ae115e8a6\") " pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:29.973580 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.973552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-22wk7" event={"ID":"56b2c968-078f-451e-a1e6-9563048127cb","Type":"ContainerStarted","Data":"830c95afe3f0ad1fface990a525a384b3f64779c03cb854aae3c7600f36b312b"} Jun 10 17:35:29.973708 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.973605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-22wk7" event={"ID":"56b2c968-078f-451e-a1e6-9563048127cb","Type":"ContainerStarted","Data":"77e45b1398bc06416dc362f87043aaea831b5ac18cc7692609af052c361de60d"} Jun 10 17:35:29.988516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:29.988472 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-22wk7" podStartSLOduration=253.121509043 podStartE2EDuration="4m13.988456311s" totalImagesPullingTime="866.947268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:29.987988463 +0000 UTC m=+254.310156575" watchObservedRunningTime="2026-06-10 17:35:29.988456311 +0000 UTC m=+254.310624504" Jun 10 17:35:30.077939 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.077913 2580 scope.go:117] "RemoveContainer" containerID="e32f1b4bbbd12b1618e73ad6e5b6753ce3f081153de3dc553e8350aea93041d6" Jun 10 17:35:30.159272 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.159247 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" Jun 10 17:35:30.171561 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.171538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9w2j9" Jun 10 17:35:30.185688 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:30.185622 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54594941_10bc_49d6_8586_b66ae115e8a6.slice/crio-48793bb80ac4d975a0a026dccb7f9d2fc8a72fafcc4c0de4bacc9cbef6f33da7 WatchSource:0}: Error finding container 48793bb80ac4d975a0a026dccb7f9d2fc8a72fafcc4c0de4bacc9cbef6f33da7: Status 404 returned error can't find the container with id 48793bb80ac4d975a0a026dccb7f9d2fc8a72fafcc4c0de4bacc9cbef6f33da7 Jun 10 17:35:30.303241 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.303210 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl"] Jun 10 17:35:30.306001 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:30.305971 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021dd10b_1941_48b0_b056_36715efaa51b.slice/crio-80916b2a67d3aafb114469c2896851e6f89f256c5871a65a1013c99c368e8a17 WatchSource:0}: Error finding container 80916b2a67d3aafb114469c2896851e6f89f256c5871a65a1013c99c368e8a17: Status 404 returned error can't find the container with id 80916b2a67d3aafb114469c2896851e6f89f256c5871a65a1013c99c368e8a17 Jun 10 17:35:30.980606 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.980568 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9w2j9" event={"ID":"54594941-10bc-49d6-8586-b66ae115e8a6","Type":"ContainerStarted","Data":"48793bb80ac4d975a0a026dccb7f9d2fc8a72fafcc4c0de4bacc9cbef6f33da7"} Jun 10 17:35:30.983009 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.982977 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" event={"ID":"021dd10b-1941-48b0-b056-36715efaa51b","Type":"ContainerStarted","Data":"6df7ab1421129ab28cb5203df9f8a4cf415f78aed03d06de6d553d2d27c58e34"} Jun 10 17:35:30.983145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.983042 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" event={"ID":"021dd10b-1941-48b0-b056-36715efaa51b","Type":"ContainerStarted","Data":"5dcd1ddd4499c7349ccd51a72c1814459bc6dceb85ae30cb7aaf7ce69ca39481"} Jun 10 17:35:30.983145 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.983071 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" event={"ID":"021dd10b-1941-48b0-b056-36715efaa51b","Type":"ContainerStarted","Data":"80916b2a67d3aafb114469c2896851e6f89f256c5871a65a1013c99c368e8a17"} Jun 10 17:35:30.985224 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.985200 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:35:30.985816 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.985794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" event={"ID":"200f2e18-3f93-419d-96da-462c31e3c021","Type":"ContainerStarted","Data":"e031f9748e919d535c802db4b144cfe1f04af56bc2e1973342e069571aa2b1ce"} Jun 10 17:35:30.986285 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:30.986266 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:35:31.002721 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:31.002609 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" podStartSLOduration=41.755873439 podStartE2EDuration="45.002595511s" totalImagesPullingTime="3.246722072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:31.001540776 +0000 UTC m=+255.323708896" watchObservedRunningTime="2026-06-10 17:35:31.002595511 +0000 UTC m=+255.324763633" Jun 10 17:35:31.153233 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:31.153209 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-d9mm4" Jun 10 17:35:31.990206 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:31.990176 2580 generic.go:356] "Generic (PLEG): container finished" podID="54594941-10bc-49d6-8586-b66ae115e8a6" containerID="05bddf30b445e45185fa14c750eac0c81b35c36306cef5918e90725b9bdae417" exitCode=0 Jun 10 17:35:31.990672 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:31.990261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9w2j9" event={"ID":"54594941-10bc-49d6-8586-b66ae115e8a6","Type":"ContainerDied","Data":"05bddf30b445e45185fa14c750eac0c81b35c36306cef5918e90725b9bdae417"} Jun 10 17:35:31.992639 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:31.992607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" event={"ID":"021dd10b-1941-48b0-b056-36715efaa51b","Type":"ContainerStarted","Data":"a11fa27e261d1668bfcdfbe8b0ba2904d11b0282a26bf843d41a628424bcf753"} Jun 10 17:35:32.026857 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.026813 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-qhbsl" podStartSLOduration=2.00410607 podStartE2EDuration="3.026800459s" totalImagesPullingTime="1.022694389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:32.025314155 +0000 UTC m=+256.347482272" watchObservedRunningTime="2026-06-10 17:35:32.026800459 +0000 UTC m=+256.348968579" Jun 10 17:35:32.233122 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.233092 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6964f77cb8-5tkqd"] Jun 10 17:35:32.236815 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.236788 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.239357 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239327 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tdnpr\"" Jun 10 17:35:32.239357 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 17:35:32.239699 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 17:35:32.239699 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239404 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 17:35:32.239699 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6jvvl8tjmf82o\"" Jun 10 17:35:32.239880 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239766 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 17:35:32.239880 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.239779 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 17:35:32.247840 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.247821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6964f77cb8-5tkqd"] Jun 10 17:35:32.286662 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286768 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286768 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a30fd4-a2e7-4817-84f7-532450a88cf5-metrics-client-ca\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-tls\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-grpc-tls\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286991 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8k2t\" (UniqueName: \"kubernetes.io/projected/61a30fd4-a2e7-4817-84f7-532450a88cf5-kube-api-access-m8k2t\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.286991 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.286899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387624 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387759 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387759 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387877 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a30fd4-a2e7-4817-84f7-532450a88cf5-metrics-client-ca\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387877 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-tls\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387877 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.387877 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-grpc-tls\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.388070 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.387901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8k2t\" (UniqueName: \"kubernetes.io/projected/61a30fd4-a2e7-4817-84f7-532450a88cf5-kube-api-access-m8k2t\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.388786 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.388726 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a30fd4-a2e7-4817-84f7-532450a88cf5-metrics-client-ca\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.390473 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.390414 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.390592 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.390569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-tls\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.390883 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.390859 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.390971 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.390947 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.390971 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.390967 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-grpc-tls\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.391055 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.390952 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/61a30fd4-a2e7-4817-84f7-532450a88cf5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.395065 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.395043 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8k2t\" (UniqueName: \"kubernetes.io/projected/61a30fd4-a2e7-4817-84f7-532450a88cf5-kube-api-access-m8k2t\") pod \"thanos-querier-6964f77cb8-5tkqd\" (UID: \"61a30fd4-a2e7-4817-84f7-532450a88cf5\") " pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.546435 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.546363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:32.679220 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.679190 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6964f77cb8-5tkqd"] Jun 10 17:35:32.681259 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:32.681227 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a30fd4_a2e7_4817_84f7_532450a88cf5.slice/crio-82e814d2ae012a274c0339b50a96cf8866cd0ae646026f698fe5f94502808879 WatchSource:0}: Error finding container 82e814d2ae012a274c0339b50a96cf8866cd0ae646026f698fe5f94502808879: Status 404 returned error can't find the container with id 82e814d2ae012a274c0339b50a96cf8866cd0ae646026f698fe5f94502808879 Jun 10 17:35:32.998749 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.998716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9w2j9" event={"ID":"54594941-10bc-49d6-8586-b66ae115e8a6","Type":"ContainerStarted","Data":"68e1464343d1359181b64863cd8d52a5418188fbf078d35c85a77444d0e01afa"} Jun 10 17:35:32.999108 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:32.998783 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9w2j9" event={"ID":"54594941-10bc-49d6-8586-b66ae115e8a6","Type":"ContainerStarted","Data":"c7bd4e1df7745c38aba0f6a953740629ca7370def09cef1630e86f6edfc10e02"} Jun 10 17:35:33.000146 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:33.000121 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"82e814d2ae012a274c0339b50a96cf8866cd0ae646026f698fe5f94502808879"} Jun 10 17:35:33.017412 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:33.017370 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9w2j9" podStartSLOduration=3.045669588 podStartE2EDuration="4.017355105s" totalImagesPullingTime="873.423672ms" totalInitContainerRuntime="98.261845ms" isStatefulPod=true podCreationTimestamp="2026-06-10 17:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:33.016749458 +0000 UTC m=+257.338917614" watchObservedRunningTime="2026-06-10 17:35:33.017355105 +0000 UTC m=+257.339523222" Jun 10 17:35:35.010514 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.010480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"7e543419826a5af0eacba94760141aaf54d2999db126d07648a1c99f2852c253"} Jun 10 17:35:35.010822 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.010549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"cc39d4232af3d135f81f7ad4c82ef2439c6d8c2c75e00a18ee99fb6b7579a2fa"} Jun 10 17:35:35.010822 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.010578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"0b8841f8d8441f0ba6edf641217f60d72c3782e6abe01971b26d687f0d55eef4"} Jun 10 17:35:35.444065 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.444028 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:35:35.448252 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.448225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.450919 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.450894 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 17:35:35.451016 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.450920 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 17:35:35.451016 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.450976 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 17:35:35.451222 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.451197 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 17:35:35.451333 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.451237 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.451897 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.451927 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.451950 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.452006 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fksgc\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.452138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.452143 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.452176 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 17:35:35.452432 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.452317 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 17:35:35.452979 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.452613 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4cfp3fbhpq3f0\"" Jun 10 17:35:35.453075 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.453019 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 17:35:35.454984 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.454958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 17:35:35.458166 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.458142 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 17:35:35.462994 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.462971 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:35:35.511484 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511542 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nszc9\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-kube-api-access-nszc9\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511765 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.511849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.511965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.512043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512290 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.512081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512290 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.512154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.512290 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.512179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.612817 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613007 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.612981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nszc9\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-kube-api-access-nszc9\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.613321 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.614098 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.614098 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613376 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.614098 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.613393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.614633 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.614281 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.614633 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.614426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.615446 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.615131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.615446 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.615410 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.615940 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.615916 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.616165 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.616105 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.618760 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.618620 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.618760 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.618625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.618760 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.618717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.619046 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.619018 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.619423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.619398 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.619721 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.619678 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.619845 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.619821 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.620278 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.620252 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.620362 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.620255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.620743 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.620712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.620988 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.620964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.621630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.621609 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.624763 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.624739 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nszc9\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-kube-api-access-nszc9\") pod \"prometheus-k8s-0\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.760208 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.760188 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:35.905436 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:35.905410 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:35:35.908206 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:35:35.908177 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1f0b4a_0574_4180_a9ac_b2cb4de405b4.slice/crio-9ced56fe250b30471b1c6b8e9c52bbb2c27fdba07e6e168db77432262f07f1c6 WatchSource:0}: Error finding container 9ced56fe250b30471b1c6b8e9c52bbb2c27fdba07e6e168db77432262f07f1c6: Status 404 returned error can't find the container with id 9ced56fe250b30471b1c6b8e9c52bbb2c27fdba07e6e168db77432262f07f1c6 Jun 10 17:35:36.015630 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:36.015599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"9ced56fe250b30471b1c6b8e9c52bbb2c27fdba07e6e168db77432262f07f1c6"} Jun 10 17:35:36.020504 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:36.018940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"bcce69a8f6f14545036b0a419c78d561d4a9420351e8b09c5b6c8f80a84fe766"} Jun 10 17:35:36.020504 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:36.019011 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"67bd9d8ea8e5f8329d6176ad18ca3de6fe2981ff068feb20856bdc49bf40eee7"} Jun 10 17:35:36.020504 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:36.019049 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" event={"ID":"61a30fd4-a2e7-4817-84f7-532450a88cf5","Type":"ContainerStarted","Data":"98cd244c89d56235cd741de0813960b794b0d3adfd9d0fc7a73f1eb616a4b825"} Jun 10 17:35:36.020504 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:36.019722 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:36.039804 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:36.039754 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" podStartSLOduration=1.197379074 podStartE2EDuration="4.039740083s" totalImagesPullingTime="2.842361009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:35:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:36.038704619 +0000 UTC m=+260.360872739" watchObservedRunningTime="2026-06-10 17:35:36.039740083 +0000 UTC m=+260.361908201" Jun 10 17:35:37.024349 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:37.024311 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" exitCode=0 Jun 10 17:35:37.024688 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:37.024399 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} Jun 10 17:35:41.046460 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.046423 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} Jun 10 17:35:41.046826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.046502 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} Jun 10 17:35:41.046826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.046547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} Jun 10 17:35:41.046826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.046590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} Jun 10 17:35:41.046826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.046626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} Jun 10 17:35:41.046826 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.046687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerStarted","Data":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} Jun 10 17:35:41.075391 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:41.075344 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.755902345 podStartE2EDuration="6.07533087s" totalImagesPullingTime="4.298511252s" totalInitContainerRuntime="20.917273ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:35:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:35:41.073230388 +0000 UTC m=+265.395398505" watchObservedRunningTime="2026-06-10 17:35:41.07533087 +0000 UTC m=+265.397498988" Jun 10 17:35:42.031597 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:42.031565 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6964f77cb8-5tkqd" Jun 10 17:35:45.761091 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:45.761056 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:35:56.111273 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:56.111230 2580 generic.go:356] "Generic (PLEG): container finished" podID="2828d5bc-8860-447d-82ab-5727002bee49" containerID="f8e9b82f9579722f2510d998e57474e11139a5ae5c8faa2d40c65d274d2eb9b2" exitCode=0 Jun 10 17:35:56.111752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:56.111277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" event={"ID":"2828d5bc-8860-447d-82ab-5727002bee49","Type":"ContainerDied","Data":"f8e9b82f9579722f2510d998e57474e11139a5ae5c8faa2d40c65d274d2eb9b2"} Jun 10 17:35:56.111752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:56.111614 2580 scope.go:117] "RemoveContainer" containerID="f8e9b82f9579722f2510d998e57474e11139a5ae5c8faa2d40c65d274d2eb9b2" Jun 10 17:35:56.658293 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:56.658255 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x27wn" podUID="2fedef23-1c8a-4e54-aea0-341b98460186" Jun 10 17:35:56.658437 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:35:56.658309 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" Jun 10 17:35:57.117729 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:57.117684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jq2st" event={"ID":"2828d5bc-8860-447d-82ab-5727002bee49","Type":"ContainerStarted","Data":"9858461d18e3029f3c9ca89809d19a473a38017ae3cb57ddf7b5d7579f01e79c"} Jun 10 17:35:57.118171 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:57.117743 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x27wn" Jun 10 17:35:57.118171 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:35:57.117709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:36:00.609582 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.609554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:36:00.610065 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.609628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:36:00.612220 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.612185 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2fedef23-1c8a-4e54-aea0-341b98460186-metrics-tls\") pod \"dns-default-x27wn\" (UID: \"2fedef23-1c8a-4e54-aea0-341b98460186\") " pod="openshift-dns/dns-default-x27wn" Jun 10 17:36:00.612220 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.612207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"image-registry-f76c75bc8-cpgdl\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:36:00.723024 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.722982 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dqnwj\"" Jun 10 17:36:00.723156 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.723085 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xt9r7\"" Jun 10 17:36:00.729167 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.729144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:36:00.729372 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.729348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x27wn" Jun 10 17:36:00.888975 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.888945 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f76c75bc8-cpgdl"] Jun 10 17:36:00.894071 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:36:00.894041 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90712d7b_2ad2_4e88_a5ba_de728e1d77f5.slice/crio-cfbff3eeee35f333191e6439e2bccdcd6f4a3bc5dc655f62d53ddff0770eb427 WatchSource:0}: Error finding container cfbff3eeee35f333191e6439e2bccdcd6f4a3bc5dc655f62d53ddff0770eb427: Status 404 returned error can't find the container with id cfbff3eeee35f333191e6439e2bccdcd6f4a3bc5dc655f62d53ddff0770eb427 Jun 10 17:36:00.904675 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:00.904626 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x27wn"] Jun 10 17:36:00.908784 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:36:00.908742 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fedef23_1c8a_4e54_aea0_341b98460186.slice/crio-0bc548077cab5386f7188e9894f78343dacbc8dcd91d0c4eb75cb615a6b5b53b WatchSource:0}: Error finding container 0bc548077cab5386f7188e9894f78343dacbc8dcd91d0c4eb75cb615a6b5b53b: Status 404 returned error can't find the container with id 0bc548077cab5386f7188e9894f78343dacbc8dcd91d0c4eb75cb615a6b5b53b Jun 10 17:36:01.134847 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:01.134814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x27wn" event={"ID":"2fedef23-1c8a-4e54-aea0-341b98460186","Type":"ContainerStarted","Data":"0bc548077cab5386f7188e9894f78343dacbc8dcd91d0c4eb75cb615a6b5b53b"} Jun 10 17:36:01.136303 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:01.136271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" event={"ID":"90712d7b-2ad2-4e88-a5ba-de728e1d77f5","Type":"ContainerStarted","Data":"b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a"} Jun 10 17:36:01.136435 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:01.136326 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" event={"ID":"90712d7b-2ad2-4e88-a5ba-de728e1d77f5","Type":"ContainerStarted","Data":"cfbff3eeee35f333191e6439e2bccdcd6f4a3bc5dc655f62d53ddff0770eb427"} Jun 10 17:36:01.136435 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:01.136367 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:36:01.155610 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:01.155506 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" podStartSLOduration=285.155484273 podStartE2EDuration="4m45.155484273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:36:01.153625528 +0000 UTC m=+285.475793649" watchObservedRunningTime="2026-06-10 17:36:01.155484273 +0000 UTC m=+285.477652392" Jun 10 17:36:03.147412 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:03.147377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x27wn" event={"ID":"2fedef23-1c8a-4e54-aea0-341b98460186","Type":"ContainerStarted","Data":"b4678a631c572bf84c1b7d9cdec54efc53e6e93506d8983dcc90bdba366e661a"} Jun 10 17:36:03.147951 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:03.147440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x27wn" event={"ID":"2fedef23-1c8a-4e54-aea0-341b98460186","Type":"ContainerStarted","Data":"9d0d2685171921b76fe615a8553e02b4eefe15c346647451d3b015549d957ad1"} Jun 10 17:36:03.147951 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:03.147484 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x27wn" Jun 10 17:36:03.163915 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:03.163869 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x27wn" podStartSLOduration=251.64383878 podStartE2EDuration="4m13.163855662s" totalImagesPullingTime="1.520016882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:36:03.161893117 +0000 UTC m=+287.484061235" watchObservedRunningTime="2026-06-10 17:36:03.163855662 +0000 UTC m=+287.486023779" Jun 10 17:36:11.182506 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:11.182468 2580 generic.go:356] "Generic (PLEG): container finished" podID="9da83fbf-3933-4871-8c10-8461d9500ced" containerID="786c1da4bac706985647fe8e6473d9bfa470b94eca75e31e4bbf8f06b94f0584" exitCode=0 Jun 10 17:36:11.182906 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:11.182538 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kztrg" event={"ID":"9da83fbf-3933-4871-8c10-8461d9500ced","Type":"ContainerDied","Data":"786c1da4bac706985647fe8e6473d9bfa470b94eca75e31e4bbf8f06b94f0584"} Jun 10 17:36:11.182954 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:11.182922 2580 scope.go:117] "RemoveContainer" containerID="786c1da4bac706985647fe8e6473d9bfa470b94eca75e31e4bbf8f06b94f0584" Jun 10 17:36:12.188454 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:12.188424 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kztrg" event={"ID":"9da83fbf-3933-4871-8c10-8461d9500ced","Type":"ContainerStarted","Data":"ddaafc47c36ee6b0644e98ad6ef3bd00815db8b4949ea1030b4e8a75d69cd98a"} Jun 10 17:36:13.153505 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:13.153471 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x27wn" Jun 10 17:36:16.023481 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:16.023421 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:36:16.024838 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:16.024816 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:36:16.036102 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:16.036082 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 17:36:20.733909 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:20.733859 2580 patch_prober.go:28] interesting pod/image-registry-f76c75bc8-cpgdl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 17:36:20.735629 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:20.733933 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 17:36:22.145869 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:22.145843 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:36:35.760932 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:35.760897 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:35.777283 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:35.777262 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:36.299669 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:36.299625 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:39.926426 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:39.926383 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f76c75bc8-cpgdl"] Jun 10 17:36:53.764539 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764491 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:36:53.764947 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764819 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="prometheus" containerID="cri-o://96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" gracePeriod=600 Jun 10 17:36:53.764947 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764846 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy" containerID="cri-o://6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" gracePeriod=600 Jun 10 17:36:53.764947 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764895 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="config-reloader" containerID="cri-o://7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" gracePeriod=600 Jun 10 17:36:53.764947 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764877 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-web" containerID="cri-o://eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" gracePeriod=600 Jun 10 17:36:53.765141 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764862 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="thanos-sidecar" containerID="cri-o://5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" gracePeriod=600 Jun 10 17:36:53.765141 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:53.764921 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" gracePeriod=600 Jun 10 17:36:54.013053 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.013029 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.123117 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123034 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-db\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123117 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123077 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-0\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123117 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123104 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-web-config\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-kube-rbac-proxy\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123241 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-trusted-ca-bundle\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123305 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-metrics-client-certs\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123337 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123365 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-serving-certs-ca-bundle\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123400 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nszc9\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-kube-api-access-nszc9\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123432 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-tls\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123463 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123494 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-thanos-prometheus-http-client-file\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123520 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-2\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123574 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config-out\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123597 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123637 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-grpc-tls\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123669 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123682 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-metrics-client-ca\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123719 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-kubelet-serving-ca-bundle\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.123761 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123755 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-1\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.124507 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.123807 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-tls-assets\") pod \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\" (UID: \"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4\") " Jun 10 17:36:54.124507 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.124074 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.124507 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.124081 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.125407 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.124698 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.125407 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.124872 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:36:54.125597 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.125494 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.126302 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.125868 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.126302 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.126007 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.126474 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.126349 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:36:54.126474 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.126417 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.127274 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.127245 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:36:54.127411 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.127283 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config-out" (OuterVolumeSpecName: "config-out") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:36:54.127974 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.127936 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.128081 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.128003 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-kube-api-access-nszc9" (OuterVolumeSpecName: "kube-api-access-nszc9") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "kube-api-access-nszc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:36:54.128680 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.128597 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.128784 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.128717 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.128784 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.128737 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.128784 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.128766 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config" (OuterVolumeSpecName: "config") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.129101 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.129081 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.129508 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.129489 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.139104 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.139083 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-web-config" (OuterVolumeSpecName: "web-config") pod "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" (UID: "bc1f0b4a-0574-4180-a9ac-b2cb4de405b4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:36:54.224952 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224918 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config-out\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.224952 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224944 2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-config\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.224952 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224954 2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-grpc-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224965 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-metrics-client-ca\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224974 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224983 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224991 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-tls-assets\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.224999 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-db\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225007 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225015 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-web-config\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225025 2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-kube-rbac-proxy\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225033 2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-metrics-client-certs\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225042 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225051 2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225060 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nszc9\" (UniqueName: \"kubernetes.io/projected/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-kube-api-access-nszc9\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225070 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225078 2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225087 2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.225181 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.225096 2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:36:54.361035 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361000 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" exitCode=0 Jun 10 17:36:54.361035 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361029 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" exitCode=0 Jun 10 17:36:54.361035 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361036 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" exitCode=0 Jun 10 17:36:54.361035 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361042 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" exitCode=0 Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361048 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" exitCode=0 Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361054 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" exitCode=0 Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361080 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361076 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361214 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361242 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} Jun 10 17:36:54.361286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361274 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} Jun 10 17:36:54.361559 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361289 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.361559 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} Jun 10 17:36:54.361559 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} Jun 10 17:36:54.361559 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.361353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bc1f0b4a-0574-4180-a9ac-b2cb4de405b4","Type":"ContainerDied","Data":"9ced56fe250b30471b1c6b8e9c52bbb2c27fdba07e6e168db77432262f07f1c6"} Jun 10 17:36:54.369559 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.369400 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.377360 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.377344 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.384673 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.384633 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.387674 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.386129 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:36:54.392090 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.392071 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:36:54.397424 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.397405 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.404309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.404290 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.411895 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.411879 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.415197 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415173 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:36:54.415523 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415507 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="config-reloader" Jun 10 17:36:54.415563 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415528 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="config-reloader" Jun 10 17:36:54.415563 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415553 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="init-config-reloader" Jun 10 17:36:54.415563 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415560 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="init-config-reloader" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415570 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-web" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415575 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-web" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415581 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-thanos" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415586 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-thanos" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415597 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="thanos-sidecar" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415602 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="thanos-sidecar" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415608 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415613 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415619 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="prometheus" Jun 10 17:36:54.415665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415624 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="prometheus" Jun 10 17:36:54.416083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415699 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="thanos-sidecar" Jun 10 17:36:54.416083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415707 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="prometheus" Jun 10 17:36:54.416083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415713 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-thanos" Jun 10 17:36:54.416083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415720 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy-web" Jun 10 17:36:54.416083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415732 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="kube-rbac-proxy" Jun 10 17:36:54.416083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.415742 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" containerName="config-reloader" Jun 10 17:36:54.419750 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.419728 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.420051 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.420028 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.420119 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420060 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} err="failed to get container status \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" Jun 10 17:36:54.420119 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420093 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.420339 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.420323 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.420339 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.420416 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420343 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} err="failed to get container status \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" Jun 10 17:36:54.420416 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420356 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.420735 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.420704 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.420840 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420743 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} err="failed to get container status \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" Jun 10 17:36:54.420840 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.420765 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.421071 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.421050 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.421124 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421083 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} err="failed to get container status \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" Jun 10 17:36:54.421124 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421097 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.421375 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.421360 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.421437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421378 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} err="failed to get container status \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" Jun 10 17:36:54.421437 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421389 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.421604 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.421586 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.421721 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421606 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} err="failed to get container status \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" Jun 10 17:36:54.421721 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421619 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.421916 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:36:54.421898 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.421981 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421923 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} err="failed to get container status \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" Jun 10 17:36:54.421981 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.421945 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.422169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422152 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} err="failed to get container status \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" Jun 10 17:36:54.422237 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422169 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.422395 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422377 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} err="failed to get container status \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" Jun 10 17:36:54.422446 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422396 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.422668 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422620 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} err="failed to get container status \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" Jun 10 17:36:54.422772 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422670 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.422772 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422762 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fksgc\"" Jun 10 17:36:54.422877 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422764 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 17:36:54.422977 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422934 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} err="failed to get container status \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" Jun 10 17:36:54.423024 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.422978 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.423061 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423021 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 17:36:54.423109 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423075 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 17:36:54.423206 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423189 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 17:36:54.423259 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423244 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 17:36:54.423306 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423257 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} err="failed to get container status \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" Jun 10 17:36:54.423306 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423285 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.423412 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 17:36:54.423412 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423414 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 17:36:54.423572 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423474 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 17:36:54.423572 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423538 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} err="failed to get container status \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" Jun 10 17:36:54.423572 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423556 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 17:36:54.423572 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423561 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.423808 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423728 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 17:36:54.423898 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423879 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} err="failed to get container status \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" Jun 10 17:36:54.423967 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.423900 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.424020 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424003 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 17:36:54.424020 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424011 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 17:36:54.424115 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424030 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4cfp3fbhpq3f0\"" Jun 10 17:36:54.424115 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 17:36:54.424363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424335 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} err="failed to get container status \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" Jun 10 17:36:54.424447 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424366 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.424707 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424674 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} err="failed to get container status \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" Jun 10 17:36:54.424788 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424708 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.424957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424936 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} err="failed to get container status \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" Jun 10 17:36:54.424957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.424959 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.425266 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.425248 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} err="failed to get container status \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" Jun 10 17:36:54.425266 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.425267 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.425538 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.425512 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} err="failed to get container status \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" Jun 10 17:36:54.425607 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.425541 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.425821 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.425800 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} err="failed to get container status \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" Jun 10 17:36:54.425899 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.425824 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.426171 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426118 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} err="failed to get container status \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" Jun 10 17:36:54.426256 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426173 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.426465 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426435 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} err="failed to get container status \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" Jun 10 17:36:54.426532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426467 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.426738 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426713 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} err="failed to get container status \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" Jun 10 17:36:54.426738 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426737 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.426988 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426942 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} err="failed to get container status \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" Jun 10 17:36:54.426988 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426967 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 17:36:54.427177 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.426969 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.427870 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.427814 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} err="failed to get container status \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" Jun 10 17:36:54.427870 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.427836 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.428159 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.428136 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} err="failed to get container status \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" Jun 10 17:36:54.428275 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.428162 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.428570 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.428541 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} err="failed to get container status \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" Jun 10 17:36:54.428570 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.428570 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.428993 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.428963 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} err="failed to get container status \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" Jun 10 17:36:54.429093 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.428995 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.429093 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429043 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 17:36:54.429270 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429249 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} err="failed to get container status \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" Jun 10 17:36:54.429340 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429272 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.429532 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429515 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} err="failed to get container status \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" Jun 10 17:36:54.429593 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429533 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.429794 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429774 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} err="failed to get container status \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" Jun 10 17:36:54.429874 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.429795 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.430032 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430010 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} err="failed to get container status \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" Jun 10 17:36:54.430088 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430035 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.430285 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430264 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} err="failed to get container status \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" Jun 10 17:36:54.430285 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430285 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.430490 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430474 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} err="failed to get container status \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" Jun 10 17:36:54.430536 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430490 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.430803 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430772 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} err="failed to get container status \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" Jun 10 17:36:54.430803 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.430792 2580 scope.go:117] "RemoveContainer" containerID="c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e" Jun 10 17:36:54.431018 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431000 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e"} err="failed to get container status \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": rpc error: code = NotFound desc = could not find container \"c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e\": container with ID starting with c205ed80c160c5c0c4f1dd46440c9adc83a3949ee7efb1ef07346119046d9e7e not found: ID does not exist" Jun 10 17:36:54.431090 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431019 2580 scope.go:117] "RemoveContainer" containerID="6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39" Jun 10 17:36:54.431257 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431239 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39"} err="failed to get container status \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": rpc error: code = NotFound desc = could not find container \"6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39\": container with ID starting with 6ac29e4855c09319e2a381cffebcc946966e21ab6dadad37d23259e791b88e39 not found: ID does not exist" Jun 10 17:36:54.431314 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431259 2580 scope.go:117] "RemoveContainer" containerID="eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1" Jun 10 17:36:54.431485 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431466 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1"} err="failed to get container status \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": rpc error: code = NotFound desc = could not find container \"eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1\": container with ID starting with eefeef6b3b9cd1fa6ae820a69177585e06e32e1cac0e73410b3772ef72cc9fa1 not found: ID does not exist" Jun 10 17:36:54.431485 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431482 2580 scope.go:117] "RemoveContainer" containerID="5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183" Jun 10 17:36:54.431685 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431667 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183"} err="failed to get container status \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": rpc error: code = NotFound desc = could not find container \"5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183\": container with ID starting with 5f6d093cb0d3bba10b8c71792bb2362f13a6fb531abba8a54df731afa3a6f183 not found: ID does not exist" Jun 10 17:36:54.431740 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431685 2580 scope.go:117] "RemoveContainer" containerID="7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5" Jun 10 17:36:54.431886 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431867 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5"} err="failed to get container status \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": rpc error: code = NotFound desc = could not find container \"7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5\": container with ID starting with 7d42c7ea3ef951fc4cb5d489d73a858c9b77243a1c43f500297eb5a38ea029d5 not found: ID does not exist" Jun 10 17:36:54.431934 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.431887 2580 scope.go:117] "RemoveContainer" containerID="96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d" Jun 10 17:36:54.432083 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.432066 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d"} err="failed to get container status \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": rpc error: code = NotFound desc = could not find container \"96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d\": container with ID starting with 96067826c1079b8f98083ca0868aaa00ac3a681bf1c92ee040d993466f71228d not found: ID does not exist" Jun 10 17:36:54.432127 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.432084 2580 scope.go:117] "RemoveContainer" containerID="2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849" Jun 10 17:36:54.432322 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.432305 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849"} err="failed to get container status \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": rpc error: code = NotFound desc = could not find container \"2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849\": container with ID starting with 2e17b8e96e0a672ddbcc4628878c6a0cfa5ee23039d5eced07b4252cb7fec849 not found: ID does not exist" Jun 10 17:36:54.437169 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.437145 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:36:54.526486 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526486 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/359f275c-e2b7-41ca-b05d-672dbc59a65e-config-out\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/359f275c-e2b7-41ca-b05d-672dbc59a65e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.526752 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-config\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-web-config\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.526966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bg8\" (UniqueName: \"kubernetes.io/projected/359f275c-e2b7-41ca-b05d-672dbc59a65e-kube-api-access-s2bg8\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.527418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.527169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628629 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628629 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-web-config\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628629 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bg8\" (UniqueName: \"kubernetes.io/projected/359f275c-e2b7-41ca-b05d-672dbc59a65e-kube-api-access-s2bg8\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.628957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.628952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629109 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/359f275c-e2b7-41ca-b05d-672dbc59a65e-config-out\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/359f275c-e2b7-41ca-b05d-672dbc59a65e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-config\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.629309 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.630063 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629339 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.630063 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629445 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.630063 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.630063 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.629821 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.630285 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.630129 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.630458 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.630430 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.632033 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.632001 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-web-config\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.632756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.632462 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.632756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.632492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.632756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.632606 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.632973 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.632949 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.633039 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.633016 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.633546 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.633513 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.633951 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.633927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.634276 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.634248 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/359f275c-e2b7-41ca-b05d-672dbc59a65e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.634572 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.634551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/359f275c-e2b7-41ca-b05d-672dbc59a65e-config-out\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.634965 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.634941 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.635161 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.635142 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/359f275c-e2b7-41ca-b05d-672dbc59a65e-config\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.635438 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.635418 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/359f275c-e2b7-41ca-b05d-672dbc59a65e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.637415 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.637392 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bg8\" (UniqueName: \"kubernetes.io/projected/359f275c-e2b7-41ca-b05d-672dbc59a65e-kube-api-access-s2bg8\") pod \"prometheus-k8s-0\" (UID: \"359f275c-e2b7-41ca-b05d-672dbc59a65e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.731631 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.731588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:36:54.885026 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:54.885000 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 17:36:54.886883 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:36:54.886852 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359f275c_e2b7_41ca_b05d_672dbc59a65e.slice/crio-d5c8b87f86f52896836a7d6f939e5bea07a84ce347d71669e7f404c97b8e5291 WatchSource:0}: Error finding container d5c8b87f86f52896836a7d6f939e5bea07a84ce347d71669e7f404c97b8e5291: Status 404 returned error can't find the container with id d5c8b87f86f52896836a7d6f939e5bea07a84ce347d71669e7f404c97b8e5291 Jun 10 17:36:55.367203 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:55.367164 2580 generic.go:356] "Generic (PLEG): container finished" podID="359f275c-e2b7-41ca-b05d-672dbc59a65e" containerID="b76070ea38cc857bbb4748382255069628b2046ca8b15ad3618a3f994aa61867" exitCode=0 Jun 10 17:36:55.367378 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:55.367215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerDied","Data":"b76070ea38cc857bbb4748382255069628b2046ca8b15ad3618a3f994aa61867"} Jun 10 17:36:55.367378 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:55.367273 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"d5c8b87f86f52896836a7d6f939e5bea07a84ce347d71669e7f404c97b8e5291"} Jun 10 17:36:56.083297 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.083258 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc1f0b4a-0574-4180-a9ac-b2cb4de405b4" path="/var/lib/kubelet/pods/bc1f0b4a-0574-4180-a9ac-b2cb4de405b4/volumes" Jun 10 17:36:56.374740 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.374627 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"523dcd622139017356f02e65a3be65bb6410096b6d86e7239bc89f61a860d1fe"} Jun 10 17:36:56.374889 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.374740 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"f33a24bede5b3d43ea1b69af7f3ca84c4cbd416c0963e0a3ffd789470388ca15"} Jun 10 17:36:56.374889 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.374767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"3f47d5dd2672af792abf6e25eef4ac58ecc3fa6042faabe367d9b34f6f671f66"} Jun 10 17:36:56.374889 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.374799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"48e8069569fad139f77db3d0cedbb3356ca51ecd485d71fbe48a23c7857807e4"} Jun 10 17:36:56.374889 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.374824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"1c4f947b452986ab281ac798d125f9c4f4228ddf629402564ada9b19288c4658"} Jun 10 17:36:56.374889 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.374855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"359f275c-e2b7-41ca-b05d-672dbc59a65e","Type":"ContainerStarted","Data":"1ffda7579813c21413ab04b948978b22b4b79e08829c4d886a5993b4394e55e7"} Jun 10 17:36:56.402510 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:56.402238 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.382132336 podStartE2EDuration="2.40221827s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.085934ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:36:56.401525713 +0000 UTC m=+340.723693830" watchObservedRunningTime="2026-06-10 17:36:56.40221827 +0000 UTC m=+340.724386391" Jun 10 17:36:59.732177 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:36:59.732122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:37:04.947785 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:04.947689 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" containerName="registry" containerID="cri-o://b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a" gracePeriod=30 Jun 10 17:37:05.205798 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.205738 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:37:05.320878 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.320845 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-certificates\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321062 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.320900 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-installation-pull-secrets\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321062 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.320926 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-image-registry-private-configuration\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321062 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.320949 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-trusted-ca\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321232 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321129 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-bound-sa-token\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321232 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321204 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-ca-trust-extracted\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321344 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321236 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321344 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321271 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5p2c\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-kube-api-access-g5p2c\") pod \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\" (UID: \"90712d7b-2ad2-4e88-a5ba-de728e1d77f5\") " Jun 10 17:37:05.321440 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321351 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:37:05.321496 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321453 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:37:05.321568 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321546 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-trusted-ca\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.321627 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.321572 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-certificates\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.323760 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.323719 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:37:05.323760 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.323738 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-kube-api-access-g5p2c" (OuterVolumeSpecName: "kube-api-access-g5p2c") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "kube-api-access-g5p2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:37:05.323931 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.323848 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:37:05.323931 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.323875 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:37:05.324017 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.323981 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:37:05.329874 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.329848 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "90712d7b-2ad2-4e88-a5ba-de728e1d77f5" (UID: "90712d7b-2ad2-4e88-a5ba-de728e1d77f5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:37:05.412842 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.412808 2580 generic.go:356] "Generic (PLEG): container finished" podID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" containerID="b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a" exitCode=0 Jun 10 17:37:05.412996 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.412847 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" Jun 10 17:37:05.412996 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.412882 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" event={"ID":"90712d7b-2ad2-4e88-a5ba-de728e1d77f5","Type":"ContainerDied","Data":"b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a"} Jun 10 17:37:05.412996 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.412922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f76c75bc8-cpgdl" event={"ID":"90712d7b-2ad2-4e88-a5ba-de728e1d77f5","Type":"ContainerDied","Data":"cfbff3eeee35f333191e6439e2bccdcd6f4a3bc5dc655f62d53ddff0770eb427"} Jun 10 17:37:05.412996 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.412940 2580 scope.go:117] "RemoveContainer" containerID="b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a" Jun 10 17:37:05.422070 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422049 2580 scope.go:117] "RemoveContainer" containerID="b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a" Jun 10 17:37:05.422308 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:37:05.422289 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a\": container with ID starting with b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a not found: ID does not exist" containerID="b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a" Jun 10 17:37:05.422372 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422320 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a"} err="failed to get container status \"b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a\": rpc error: code = NotFound desc = could not find container \"b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a\": container with ID starting with b07e85a6af85cf87ff3138bf869a82be556973ed17c725e067a2cada546d633a not found: ID does not exist" Jun 10 17:37:05.422372 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422353 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-installation-pull-secrets\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.422448 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422375 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-image-registry-private-configuration\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.422448 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422385 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-bound-sa-token\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.422448 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422397 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-ca-trust-extracted\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.422448 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422411 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-registry-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.422448 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.422419 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5p2c\" (UniqueName: \"kubernetes.io/projected/90712d7b-2ad2-4e88-a5ba-de728e1d77f5-kube-api-access-g5p2c\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:37:05.434248 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.434220 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f76c75bc8-cpgdl"] Jun 10 17:37:05.437681 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:05.437631 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f76c75bc8-cpgdl"] Jun 10 17:37:06.082126 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:06.082088 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" path="/var/lib/kubelet/pods/90712d7b-2ad2-4e88-a5ba-de728e1d77f5/volumes" Jun 10 17:37:54.732060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:54.732013 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:37:54.748044 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:54.748016 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:37:55.628902 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:37:55.628873 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 17:38:42.116405 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.116373 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r"] Jun 10 17:38:42.116916 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.116724 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" containerName="registry" Jun 10 17:38:42.116916 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.116737 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" containerName="registry" Jun 10 17:38:42.116916 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.116804 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="90712d7b-2ad2-4e88-a5ba-de728e1d77f5" containerName="registry" Jun 10 17:38:42.119844 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.119829 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.122467 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.122441 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 17:38:42.122671 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.122512 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w7vh7\"" Jun 10 17:38:42.122671 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.122626 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 17:38:42.122836 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.122754 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 17:38:42.122836 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.122783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 17:38:42.142750 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.142728 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r"] Jun 10 17:38:42.241907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.241873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.241907 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.241911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-manifests\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.242113 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.241933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs2xk\" (UniqueName: \"kubernetes.io/projected/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-kube-api-access-qs2xk\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.242113 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.242056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-tmp\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.242113 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.242109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.343188 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.343151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.343363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.343195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-manifests\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.343363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.343220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs2xk\" (UniqueName: \"kubernetes.io/projected/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-kube-api-access-qs2xk\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.343363 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.343266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-tmp\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.343515 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.343411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.343707 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.343679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-manifests\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.345703 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.345678 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-tmp\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.345789 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.345756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.345906 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.345888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.356294 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.356273 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs2xk\" (UniqueName: \"kubernetes.io/projected/c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0-kube-api-access-qs2xk\") pod \"opendatahub-operator-controller-manager-55bf9956cc-79p2r\" (UID: \"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0\") " pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.430374 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.430276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:42.571667 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.571616 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r"] Jun 10 17:38:42.574603 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:38:42.574577 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a5fcdc_e3d0_4c04_a00a_66a60cd8ccc0.slice/crio-15550c875ebffa28bdc7c90090f1fea1c1545554bc3da7fc83c2ebacc866a8e3 WatchSource:0}: Error finding container 15550c875ebffa28bdc7c90090f1fea1c1545554bc3da7fc83c2ebacc866a8e3: Status 404 returned error can't find the container with id 15550c875ebffa28bdc7c90090f1fea1c1545554bc3da7fc83c2ebacc866a8e3 Jun 10 17:38:42.576717 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.576700 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:38:42.814665 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:42.814608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" event={"ID":"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0","Type":"ContainerStarted","Data":"15550c875ebffa28bdc7c90090f1fea1c1545554bc3da7fc83c2ebacc866a8e3"} Jun 10 17:38:45.829960 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:45.829923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" event={"ID":"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0","Type":"ContainerStarted","Data":"eedba9ce921d8bad066f5e141ef3975594fd5606c69072acfec4338d36596538"} Jun 10 17:38:46.835771 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:46.835732 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0" containerID="eedba9ce921d8bad066f5e141ef3975594fd5606c69072acfec4338d36596538" exitCode=0 Jun 10 17:38:46.836253 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:46.835823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" event={"ID":"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0","Type":"ContainerDied","Data":"eedba9ce921d8bad066f5e141ef3975594fd5606c69072acfec4338d36596538"} Jun 10 17:38:47.843143 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:47.843105 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" event={"ID":"c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0","Type":"ContainerStarted","Data":"0c924b8483b94122f7ef1175e60d6d51ad955951b11c925b1404abe19013a674"} Jun 10 17:38:47.843750 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:47.843217 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:38:47.865401 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:47.865350 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" podStartSLOduration=1.8142891159999999 podStartE2EDuration="5.865335261s" totalImagesPullingTime="3.12918999s" totalInitContainerRuntime="921.856155ms" isStatefulPod=false podCreationTimestamp="2026-06-10 17:38:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:38:47.863372815 +0000 UTC m=+452.185540933" watchObservedRunningTime="2026-06-10 17:38:47.865335261 +0000 UTC m=+452.187503378" Jun 10 17:38:58.855921 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:38:58.855892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55bf9956cc-79p2r" Jun 10 17:39:01.132784 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.132735 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd"] Jun 10 17:39:01.142288 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.142263 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.145111 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.145085 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd"] Jun 10 17:39:01.145408 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.145387 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tjbpt\"" Jun 10 17:39:01.146346 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.146321 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 17:39:01.146702 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.146632 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 17:39:01.146832 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.146707 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 17:39:01.146832 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.146723 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 17:39:01.146832 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.146674 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 17:39:01.307160 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.307125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f8533dbf-f233-4860-a56c-1fe97a98d659-manager-config\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.307352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.307200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8533dbf-f233-4860-a56c-1fe97a98d659-metrics-cert\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.307352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.307237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tng\" (UniqueName: \"kubernetes.io/projected/f8533dbf-f233-4860-a56c-1fe97a98d659-kube-api-access-s4tng\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.307352 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.307264 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8533dbf-f233-4860-a56c-1fe97a98d659-cert\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.415849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.408433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f8533dbf-f233-4860-a56c-1fe97a98d659-manager-config\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.415849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.408534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8533dbf-f233-4860-a56c-1fe97a98d659-metrics-cert\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.415849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.408671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tng\" (UniqueName: \"kubernetes.io/projected/f8533dbf-f233-4860-a56c-1fe97a98d659-kube-api-access-s4tng\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.415849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.408721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8533dbf-f233-4860-a56c-1fe97a98d659-cert\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.415849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.410009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f8533dbf-f233-4860-a56c-1fe97a98d659-manager-config\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.415849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.411860 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f8533dbf-f233-4860-a56c-1fe97a98d659-metrics-cert\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.417073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.417049 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8533dbf-f233-4860-a56c-1fe97a98d659-cert\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.418297 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.418277 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tng\" (UniqueName: \"kubernetes.io/projected/f8533dbf-f233-4860-a56c-1fe97a98d659-kube-api-access-s4tng\") pod \"lws-controller-manager-6648fffc94-7s9nd\" (UID: \"f8533dbf-f233-4860-a56c-1fe97a98d659\") " pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.454422 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.454389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:01.599025 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.598962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd"] Jun 10 17:39:01.601679 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:39:01.601620 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8533dbf_f233_4860_a56c_1fe97a98d659.slice/crio-814e5f28d75be682024db2e2d181fd32d65dd6b4649048df5a25e835c058a2ca WatchSource:0}: Error finding container 814e5f28d75be682024db2e2d181fd32d65dd6b4649048df5a25e835c058a2ca: Status 404 returned error can't find the container with id 814e5f28d75be682024db2e2d181fd32d65dd6b4649048df5a25e835c058a2ca Jun 10 17:39:01.907708 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:01.907669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" event={"ID":"f8533dbf-f233-4860-a56c-1fe97a98d659","Type":"ContainerStarted","Data":"814e5f28d75be682024db2e2d181fd32d65dd6b4649048df5a25e835c058a2ca"} Jun 10 17:39:03.743635 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.743178 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n"] Jun 10 17:39:03.747987 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.747945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:03.750340 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.750313 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 17:39:03.750470 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.750374 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 17:39:03.750778 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.750759 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r8krb\"" Jun 10 17:39:03.757609 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.757549 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n"] Jun 10 17:39:03.932086 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.932051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tls-certs\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:03.932086 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.932097 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tmp\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:03.932342 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:03.932134 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tfwq\" (UniqueName: \"kubernetes.io/projected/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-kube-api-access-4tfwq\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.033769 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.033662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tls-certs\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.033769 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.033716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tmp\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.033769 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.033759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tfwq\" (UniqueName: \"kubernetes.io/projected/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-kube-api-access-4tfwq\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.034073 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:39:04.033827 2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 17:39:04.034073 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:39:04.033893 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tls-certs podName:1cc4012c-e2eb-42b7-b556-d4597cb3ab82 nodeName:}" failed. No retries permitted until 2026-06-10 17:39:04.533875592 +0000 UTC m=+468.856043688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tls-certs") pod "kube-auth-proxy-596f9fd7bd-42n7n" (UID: "1cc4012c-e2eb-42b7-b556-d4597cb3ab82") : secret "kube-auth-proxy-tls" not found Jun 10 17:39:04.036802 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.036750 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tmp\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.044191 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.044159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tfwq\" (UniqueName: \"kubernetes.io/projected/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-kube-api-access-4tfwq\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.539166 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.539124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tls-certs\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.542060 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.542033 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cc4012c-e2eb-42b7-b556-d4597cb3ab82-tls-certs\") pod \"kube-auth-proxy-596f9fd7bd-42n7n\" (UID: \"1cc4012c-e2eb-42b7-b556-d4597cb3ab82\") " pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.662489 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.662453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" Jun 10 17:39:04.799457 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.799293 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n"] Jun 10 17:39:04.801863 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:39:04.801821 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc4012c_e2eb_42b7_b556_d4597cb3ab82.slice/crio-5fe84d8c965000aa258a78f006c8ffdfcd33b7511c70ed8c922d8cf39a6450c2 WatchSource:0}: Error finding container 5fe84d8c965000aa258a78f006c8ffdfcd33b7511c70ed8c922d8cf39a6450c2: Status 404 returned error can't find the container with id 5fe84d8c965000aa258a78f006c8ffdfcd33b7511c70ed8c922d8cf39a6450c2 Jun 10 17:39:04.924728 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.924687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" event={"ID":"f8533dbf-f233-4860-a56c-1fe97a98d659","Type":"ContainerStarted","Data":"35ea2082695306216176dc18c2712cec3df239a7daba4af13f95b4ebec8baad6"} Jun 10 17:39:04.924928 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.924769 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:39:04.926264 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.926243 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" event={"ID":"1cc4012c-e2eb-42b7-b556-d4597cb3ab82","Type":"ContainerStarted","Data":"5fe84d8c965000aa258a78f006c8ffdfcd33b7511c70ed8c922d8cf39a6450c2"} Jun 10 17:39:04.940110 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:04.940061 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" podStartSLOduration=1.326849942 podStartE2EDuration="3.940045241s" totalImagesPullingTime="2.613195299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:39:04.939404774 +0000 UTC m=+469.261572925" watchObservedRunningTime="2026-06-10 17:39:04.940045241 +0000 UTC m=+469.262213358" Jun 10 17:39:07.943465 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:07.943431 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" event={"ID":"1cc4012c-e2eb-42b7-b556-d4597cb3ab82","Type":"ContainerStarted","Data":"ff3b64bfdf8bce4af5473b5aabc781d913cc8f160547f925af0e0de89c173dad"} Jun 10 17:39:07.967621 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:07.967570 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-596f9fd7bd-42n7n" podStartSLOduration=1.946034868 podStartE2EDuration="4.967553927s" totalImagesPullingTime="3.021519059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:39:07.965862139 +0000 UTC m=+472.288030257" watchObservedRunningTime="2026-06-10 17:39:07.967553927 +0000 UTC m=+472.289722044" Jun 10 17:39:15.935299 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:39:15.935262 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6648fffc94-7s9nd" Jun 10 17:40:44.594896 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.594859 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-52nbh"] Jun 10 17:40:44.597043 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.597026 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:40:44.599824 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.599803 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 17:40:44.600218 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.600198 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 17:40:44.601258 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.601240 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-spwbp\"" Jun 10 17:40:44.606852 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.606821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-52nbh"] Jun 10 17:40:44.633376 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.633349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbdf2\" (UniqueName: \"kubernetes.io/projected/04434e34-b516-4019-9bd3-5d9f6b8a708d-kube-api-access-rbdf2\") pod \"authorino-operator-75cc8d5cb7-52nbh\" (UID: \"04434e34-b516-4019-9bd3-5d9f6b8a708d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:40:44.734365 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.734335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbdf2\" (UniqueName: \"kubernetes.io/projected/04434e34-b516-4019-9bd3-5d9f6b8a708d-kube-api-access-rbdf2\") pod \"authorino-operator-75cc8d5cb7-52nbh\" (UID: \"04434e34-b516-4019-9bd3-5d9f6b8a708d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:40:44.743964 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.743934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbdf2\" (UniqueName: \"kubernetes.io/projected/04434e34-b516-4019-9bd3-5d9f6b8a708d-kube-api-access-rbdf2\") pod \"authorino-operator-75cc8d5cb7-52nbh\" (UID: \"04434e34-b516-4019-9bd3-5d9f6b8a708d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:40:44.907590 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:44.907495 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:40:45.053992 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:45.053965 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-52nbh"] Jun 10 17:40:45.057008 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:40:45.056978 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04434e34_b516_4019_9bd3_5d9f6b8a708d.slice/crio-100167cfc9448761e8e7339077d8e0f273686c5bf88ad8d23348eae2936763b1 WatchSource:0}: Error finding container 100167cfc9448761e8e7339077d8e0f273686c5bf88ad8d23348eae2936763b1: Status 404 returned error can't find the container with id 100167cfc9448761e8e7339077d8e0f273686c5bf88ad8d23348eae2936763b1 Jun 10 17:40:45.375220 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:45.375182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" event={"ID":"04434e34-b516-4019-9bd3-5d9f6b8a708d","Type":"ContainerStarted","Data":"100167cfc9448761e8e7339077d8e0f273686c5bf88ad8d23348eae2936763b1"} Jun 10 17:40:47.386778 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:47.386736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" event={"ID":"04434e34-b516-4019-9bd3-5d9f6b8a708d","Type":"ContainerStarted","Data":"99b20a4b6e7ae5b3c9c4a8d63d33d45070f09f8dc9bf0640c9df7fe7871bab4a"} Jun 10 17:40:47.387220 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:47.386827 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:40:47.407631 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:47.407577 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" podStartSLOduration=1.2484906630000001 podStartE2EDuration="3.407557358s" totalImagesPullingTime="2.159066695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:40:47.407413839 +0000 UTC m=+571.729581981" watchObservedRunningTime="2026-06-10 17:40:47.407557358 +0000 UTC m=+571.729725479" Jun 10 17:40:58.394397 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:40:58.394364 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-52nbh" Jun 10 17:41:00.810149 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.810115 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s"] Jun 10 17:41:00.817276 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.817260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:00.820154 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.820132 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-npmch\"" Jun 10 17:41:00.826587 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.826557 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s"] Jun 10 17:41:00.877126 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.877096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pdtm\" (UniqueName: \"kubernetes.io/projected/3665c66d-5a11-4c8f-afdd-dd52624da95c-kube-api-access-9pdtm\") pod \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:00.877282 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.877207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3665c66d-5a11-4c8f-afdd-dd52624da95c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:00.977805 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.977764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3665c66d-5a11-4c8f-afdd-dd52624da95c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:00.977975 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.977821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pdtm\" (UniqueName: \"kubernetes.io/projected/3665c66d-5a11-4c8f-afdd-dd52624da95c-kube-api-access-9pdtm\") pod \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:00.978232 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.978211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3665c66d-5a11-4c8f-afdd-dd52624da95c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:00.988899 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:00.988866 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pdtm\" (UniqueName: \"kubernetes.io/projected/3665c66d-5a11-4c8f-afdd-dd52624da95c-kube-api-access-9pdtm\") pod \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.128286 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.128201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.259369 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.259339 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s"] Jun 10 17:41:01.267539 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.267510 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s"] Jun 10 17:41:01.281870 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.281843 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr"] Jun 10 17:41:01.287154 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.287129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.297240 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.296767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr"] Jun 10 17:41:01.381267 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.381182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6459bf7d-cbe2-4703-a796-0674ba01eb01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5ggnr\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.381267 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.381250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzvv\" (UniqueName: \"kubernetes.io/projected/6459bf7d-cbe2-4703-a796-0674ba01eb01-kube-api-access-zwzvv\") pod \"kuadrant-operator-controller-manager-55467d9f7-5ggnr\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.392658 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:41:01.392609 2580 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 10 17:41:01.392658 ip-10-0-133-83 kubenswrapper[2580]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-q9s5s_kuadrant-system_3665c66d-5a11-4c8f-afdd-dd52624da95c_0(aef5478c5ba037b97dfa49cf15911a29c34cfd6f82bc66ad4d26e395a07fbcc7): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-q9s5s to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aef5478c5ba037b97dfa49cf15911a29c34cfd6f82bc66ad4d26e395a07fbcc7" Netns:"/var/run/netns/3932e8ed-6022-4a0f-a45d-a6f9b5a42801" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-q9s5s;K8S_POD_INFRA_CONTAINER_ID=aef5478c5ba037b97dfa49cf15911a29c34cfd6f82bc66ad4d26e395a07fbcc7;K8S_POD_UID=3665c66d-5a11-4c8f-afdd-dd52624da95c" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s/3665c66d-5a11-4c8f-afdd-dd52624da95c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-q9s5s in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-q9s5s in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s: pods "kuadrant-operator-controller-manager-55467d9f7-q9s5s" not found Jun 10 17:41:01.392658 ip-10-0-133-83 kubenswrapper[2580]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 10 17:41:01.392658 ip-10-0-133-83 kubenswrapper[2580]: > Jun 10 17:41:01.392833 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:41:01.392687 2580 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 10 17:41:01.392833 ip-10-0-133-83 kubenswrapper[2580]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-q9s5s_kuadrant-system_3665c66d-5a11-4c8f-afdd-dd52624da95c_0(aef5478c5ba037b97dfa49cf15911a29c34cfd6f82bc66ad4d26e395a07fbcc7): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-q9s5s to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aef5478c5ba037b97dfa49cf15911a29c34cfd6f82bc66ad4d26e395a07fbcc7" Netns:"/var/run/netns/3932e8ed-6022-4a0f-a45d-a6f9b5a42801" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-q9s5s;K8S_POD_INFRA_CONTAINER_ID=aef5478c5ba037b97dfa49cf15911a29c34cfd6f82bc66ad4d26e395a07fbcc7;K8S_POD_UID=3665c66d-5a11-4c8f-afdd-dd52624da95c" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s/3665c66d-5a11-4c8f-afdd-dd52624da95c]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-q9s5s in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-q9s5s in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s: pods "kuadrant-operator-controller-manager-55467d9f7-q9s5s" not found Jun 10 17:41:01.392833 ip-10-0-133-83 kubenswrapper[2580]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 10 17:41:01.392833 ip-10-0-133-83 kubenswrapper[2580]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.451862 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.451836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.454615 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:41:01.454586 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" podUID="3665c66d-5a11-4c8f-afdd-dd52624da95c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.460073 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.460055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.462377 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:41:01.462350 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" podUID="3665c66d-5a11-4c8f-afdd-dd52624da95c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:01.481971 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.481944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6459bf7d-cbe2-4703-a796-0674ba01eb01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5ggnr\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.482074 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.481992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzvv\" (UniqueName: \"kubernetes.io/projected/6459bf7d-cbe2-4703-a796-0674ba01eb01-kube-api-access-zwzvv\") pod \"kuadrant-operator-controller-manager-55467d9f7-5ggnr\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.482298 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.482280 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6459bf7d-cbe2-4703-a796-0674ba01eb01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-5ggnr\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.493075 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.493054 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzvv\" (UniqueName: \"kubernetes.io/projected/6459bf7d-cbe2-4703-a796-0674ba01eb01-kube-api-access-zwzvv\") pod \"kuadrant-operator-controller-manager-55467d9f7-5ggnr\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.583004 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.582972 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3665c66d-5a11-4c8f-afdd-dd52624da95c-extensions-socket-volume\") pod \"3665c66d-5a11-4c8f-afdd-dd52624da95c\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " Jun 10 17:41:01.583180 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.583041 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pdtm\" (UniqueName: \"kubernetes.io/projected/3665c66d-5a11-4c8f-afdd-dd52624da95c-kube-api-access-9pdtm\") pod \"3665c66d-5a11-4c8f-afdd-dd52624da95c\" (UID: \"3665c66d-5a11-4c8f-afdd-dd52624da95c\") " Jun 10 17:41:01.583308 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.583284 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3665c66d-5a11-4c8f-afdd-dd52624da95c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3665c66d-5a11-4c8f-afdd-dd52624da95c" (UID: "3665c66d-5a11-4c8f-afdd-dd52624da95c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:41:01.585195 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.585173 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3665c66d-5a11-4c8f-afdd-dd52624da95c-kube-api-access-9pdtm" (OuterVolumeSpecName: "kube-api-access-9pdtm") pod "3665c66d-5a11-4c8f-afdd-dd52624da95c" (UID: "3665c66d-5a11-4c8f-afdd-dd52624da95c"). InnerVolumeSpecName "kube-api-access-9pdtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:41:01.601409 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.601382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:01.683896 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.683865 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3665c66d-5a11-4c8f-afdd-dd52624da95c-extensions-socket-volume\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:41:01.683896 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.683899 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pdtm\" (UniqueName: \"kubernetes.io/projected/3665c66d-5a11-4c8f-afdd-dd52624da95c-kube-api-access-9pdtm\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:41:01.748531 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:01.748501 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr"] Jun 10 17:41:01.751724 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:41:01.751697 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6459bf7d_cbe2_4703_a796_0674ba01eb01.slice/crio-a2348c0a527246f45f7896b4e9725c8f47d623ab73468237b6f6e87ec822dcc1 WatchSource:0}: Error finding container a2348c0a527246f45f7896b4e9725c8f47d623ab73468237b6f6e87ec822dcc1: Status 404 returned error can't find the container with id a2348c0a527246f45f7896b4e9725c8f47d623ab73468237b6f6e87ec822dcc1 Jun 10 17:41:02.088579 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:02.084353 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3665c66d-5a11-4c8f-afdd-dd52624da95c" path="/var/lib/kubelet/pods/3665c66d-5a11-4c8f-afdd-dd52624da95c/volumes" Jun 10 17:41:02.457566 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:02.457488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:02.457566 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:02.457501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" event={"ID":"6459bf7d-cbe2-4703-a796-0674ba01eb01","Type":"ContainerStarted","Data":"a2348c0a527246f45f7896b4e9725c8f47d623ab73468237b6f6e87ec822dcc1"} Jun 10 17:41:02.462098 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:41:02.462071 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-q9s5s\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" podUID="3665c66d-5a11-4c8f-afdd-dd52624da95c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-q9s5s" Jun 10 17:41:06.478225 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:06.478193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" event={"ID":"6459bf7d-cbe2-4703-a796-0674ba01eb01","Type":"ContainerStarted","Data":"77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b"} Jun 10 17:41:06.478547 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:06.478357 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:06.498241 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:06.498193 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" podStartSLOduration=0.858589739 podStartE2EDuration="5.498178316s" totalImagesPullingTime="4.639588577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:41:06.496669348 +0000 UTC m=+590.818837459" watchObservedRunningTime="2026-06-10 17:41:06.498178316 +0000 UTC m=+590.820346434" Jun 10 17:41:16.058080 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:16.058042 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:41:16.058681 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:16.058532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:41:17.485584 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:17.485550 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:29.830157 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:29.830114 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr"] Jun 10 17:41:29.832610 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:29.830371 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" podUID="6459bf7d-cbe2-4703-a796-0674ba01eb01" containerName="manager" containerID="cri-o://77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b" gracePeriod=10 Jun 10 17:41:30.086941 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.086878 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:30.125737 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.125707 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwzvv\" (UniqueName: \"kubernetes.io/projected/6459bf7d-cbe2-4703-a796-0674ba01eb01-kube-api-access-zwzvv\") pod \"6459bf7d-cbe2-4703-a796-0674ba01eb01\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " Jun 10 17:41:30.125892 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.125753 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6459bf7d-cbe2-4703-a796-0674ba01eb01-extensions-socket-volume\") pod \"6459bf7d-cbe2-4703-a796-0674ba01eb01\" (UID: \"6459bf7d-cbe2-4703-a796-0674ba01eb01\") " Jun 10 17:41:30.126233 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.126198 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6459bf7d-cbe2-4703-a796-0674ba01eb01-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6459bf7d-cbe2-4703-a796-0674ba01eb01" (UID: "6459bf7d-cbe2-4703-a796-0674ba01eb01"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 17:41:30.128040 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.128015 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6459bf7d-cbe2-4703-a796-0674ba01eb01-kube-api-access-zwzvv" (OuterVolumeSpecName: "kube-api-access-zwzvv") pod "6459bf7d-cbe2-4703-a796-0674ba01eb01" (UID: "6459bf7d-cbe2-4703-a796-0674ba01eb01"). InnerVolumeSpecName "kube-api-access-zwzvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:41:30.226307 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.226267 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwzvv\" (UniqueName: \"kubernetes.io/projected/6459bf7d-cbe2-4703-a796-0674ba01eb01-kube-api-access-zwzvv\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:41:30.226307 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.226302 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6459bf7d-cbe2-4703-a796-0674ba01eb01-extensions-socket-volume\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:41:30.595183 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.595145 2580 generic.go:356] "Generic (PLEG): container finished" podID="6459bf7d-cbe2-4703-a796-0674ba01eb01" containerID="77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b" exitCode=0 Jun 10 17:41:30.595418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.595196 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" Jun 10 17:41:30.595418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.595225 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" event={"ID":"6459bf7d-cbe2-4703-a796-0674ba01eb01","Type":"ContainerDied","Data":"77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b"} Jun 10 17:41:30.595418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.595280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr" event={"ID":"6459bf7d-cbe2-4703-a796-0674ba01eb01","Type":"ContainerDied","Data":"a2348c0a527246f45f7896b4e9725c8f47d623ab73468237b6f6e87ec822dcc1"} Jun 10 17:41:30.595418 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.595303 2580 scope.go:117] "RemoveContainer" containerID="77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b" Jun 10 17:41:30.604574 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.604555 2580 scope.go:117] "RemoveContainer" containerID="77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b" Jun 10 17:41:30.604900 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:41:30.604880 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b\": container with ID starting with 77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b not found: ID does not exist" containerID="77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b" Jun 10 17:41:30.604957 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.604909 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b"} err="failed to get container status \"77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b\": rpc error: code = NotFound desc = could not find container \"77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b\": container with ID starting with 77e8131597024d711fd87527caef985cf4ed5a5c061de77a977856631c1aa75b not found: ID does not exist" Jun 10 17:41:30.623621 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.623590 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr"] Jun 10 17:41:30.627854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:30.627828 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-5ggnr"] Jun 10 17:41:32.082991 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:32.082952 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6459bf7d-cbe2-4703-a796-0674ba01eb01" path="/var/lib/kubelet/pods/6459bf7d-cbe2-4703-a796-0674ba01eb01/volumes" Jun 10 17:41:48.908300 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.908265 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:41:48.908838 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.908674 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6459bf7d-cbe2-4703-a796-0674ba01eb01" containerName="manager" Jun 10 17:41:48.908838 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.908689 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6459bf7d-cbe2-4703-a796-0674ba01eb01" containerName="manager" Jun 10 17:41:48.908838 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.908751 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6459bf7d-cbe2-4703-a796-0674ba01eb01" containerName="manager" Jun 10 17:41:48.914852 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.914832 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:48.917383 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.917354 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d2rp2\"" Jun 10 17:41:48.917873 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.917852 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 17:41:48.919420 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.919384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:41:48.935784 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.935760 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:41:48.987746 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.987711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45d91420-dcaa-4788-bbca-4c17941de229-config-file\") pod \"limitador-limitador-54d6d988d5-k4nth\" (UID: \"45d91420-dcaa-4788-bbca-4c17941de229\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:48.987944 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:48.987784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xqp\" (UniqueName: \"kubernetes.io/projected/45d91420-dcaa-4788-bbca-4c17941de229-kube-api-access-j6xqp\") pod \"limitador-limitador-54d6d988d5-k4nth\" (UID: \"45d91420-dcaa-4788-bbca-4c17941de229\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:49.088695 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.088627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xqp\" (UniqueName: \"kubernetes.io/projected/45d91420-dcaa-4788-bbca-4c17941de229-kube-api-access-j6xqp\") pod \"limitador-limitador-54d6d988d5-k4nth\" (UID: \"45d91420-dcaa-4788-bbca-4c17941de229\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:49.088904 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.088774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45d91420-dcaa-4788-bbca-4c17941de229-config-file\") pod \"limitador-limitador-54d6d988d5-k4nth\" (UID: \"45d91420-dcaa-4788-bbca-4c17941de229\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:49.089409 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.089383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/45d91420-dcaa-4788-bbca-4c17941de229-config-file\") pod \"limitador-limitador-54d6d988d5-k4nth\" (UID: \"45d91420-dcaa-4788-bbca-4c17941de229\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:49.096892 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.096861 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xqp\" (UniqueName: \"kubernetes.io/projected/45d91420-dcaa-4788-bbca-4c17941de229-kube-api-access-j6xqp\") pod \"limitador-limitador-54d6d988d5-k4nth\" (UID: \"45d91420-dcaa-4788-bbca-4c17941de229\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:49.226866 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.226823 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:49.368184 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.368158 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:41:49.370534 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:41:49.370497 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d91420_dcaa_4788_bbca_4c17941de229.slice/crio-5546fe03ae28c267f7cb65ef282589acb94d8444c7416e4059ecf57e68ec8f37 WatchSource:0}: Error finding container 5546fe03ae28c267f7cb65ef282589acb94d8444c7416e4059ecf57e68ec8f37: Status 404 returned error can't find the container with id 5546fe03ae28c267f7cb65ef282589acb94d8444c7416e4059ecf57e68ec8f37 Jun 10 17:41:49.394404 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.394377 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4t2bv"] Jun 10 17:41:49.398849 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.398831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:41:49.401174 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.401153 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zkhq5\"" Jun 10 17:41:49.405249 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.405225 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4t2bv"] Jun 10 17:41:49.491537 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.491459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dqcq\" (UniqueName: \"kubernetes.io/projected/59f82064-a8fe-473b-a41d-6da55ea635a7-kube-api-access-4dqcq\") pod \"authorino-75d556bd77-4t2bv\" (UID: \"59f82064-a8fe-473b-a41d-6da55ea635a7\") " pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:41:49.591903 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.591866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dqcq\" (UniqueName: \"kubernetes.io/projected/59f82064-a8fe-473b-a41d-6da55ea635a7-kube-api-access-4dqcq\") pod \"authorino-75d556bd77-4t2bv\" (UID: \"59f82064-a8fe-473b-a41d-6da55ea635a7\") " pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:41:49.600364 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.600333 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dqcq\" (UniqueName: \"kubernetes.io/projected/59f82064-a8fe-473b-a41d-6da55ea635a7-kube-api-access-4dqcq\") pod \"authorino-75d556bd77-4t2bv\" (UID: \"59f82064-a8fe-473b-a41d-6da55ea635a7\") " pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:41:49.687240 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.687199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" event={"ID":"45d91420-dcaa-4788-bbca-4c17941de229","Type":"ContainerStarted","Data":"5546fe03ae28c267f7cb65ef282589acb94d8444c7416e4059ecf57e68ec8f37"} Jun 10 17:41:49.717619 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.717589 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:41:49.852610 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:49.852588 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4t2bv"] Jun 10 17:41:49.854731 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:41:49.854700 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59f82064_a8fe_473b_a41d_6da55ea635a7.slice/crio-465f526ebf9a5a72cb578cbf0c9d4bde4918b53c47735ba463773d33c7d3ee74 WatchSource:0}: Error finding container 465f526ebf9a5a72cb578cbf0c9d4bde4918b53c47735ba463773d33c7d3ee74: Status 404 returned error can't find the container with id 465f526ebf9a5a72cb578cbf0c9d4bde4918b53c47735ba463773d33c7d3ee74 Jun 10 17:41:50.696739 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:50.696671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4t2bv" event={"ID":"59f82064-a8fe-473b-a41d-6da55ea635a7","Type":"ContainerStarted","Data":"465f526ebf9a5a72cb578cbf0c9d4bde4918b53c47735ba463773d33c7d3ee74"} Jun 10 17:41:54.719740 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:54.719703 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4t2bv" event={"ID":"59f82064-a8fe-473b-a41d-6da55ea635a7","Type":"ContainerStarted","Data":"2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2"} Jun 10 17:41:54.721250 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:54.721225 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" event={"ID":"45d91420-dcaa-4788-bbca-4c17941de229","Type":"ContainerStarted","Data":"f84136561b4d926cea25d849ca9547a6e5ba8e2e51b3f16a236cb257b2e7ec74"} Jun 10 17:41:54.721369 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:54.721357 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:41:54.735223 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:54.735176 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4t2bv" podStartSLOduration=1.710913481 podStartE2EDuration="5.735160618s" totalImagesPullingTime="4.024247137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:41:54.73381758 +0000 UTC m=+639.055985699" watchObservedRunningTime="2026-06-10 17:41:54.735160618 +0000 UTC m=+639.057328735" Jun 10 17:41:54.749188 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:41:54.749133 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" podStartSLOduration=2.201573801 podStartE2EDuration="6.7491128s" totalImagesPullingTime="4.547538999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:41:54.747684718 +0000 UTC m=+639.069852839" watchObservedRunningTime="2026-06-10 17:41:54.7491128 +0000 UTC m=+639.071280919" Jun 10 17:42:05.726316 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:42:05.726285 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k4nth" Jun 10 17:43:20.429337 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:20.429258 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4t2bv"] Jun 10 17:43:20.429818 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:20.429422 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4t2bv" podUID="59f82064-a8fe-473b-a41d-6da55ea635a7" containerName="authorino" containerID="cri-o://2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2" gracePeriod=30 Jun 10 17:43:20.674411 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:20.674388 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:43:20.792495 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:20.792461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dqcq\" (UniqueName: \"kubernetes.io/projected/59f82064-a8fe-473b-a41d-6da55ea635a7-kube-api-access-4dqcq\") pod \"59f82064-a8fe-473b-a41d-6da55ea635a7\" (UID: \"59f82064-a8fe-473b-a41d-6da55ea635a7\") " Jun 10 17:43:20.794633 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:20.794607 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f82064-a8fe-473b-a41d-6da55ea635a7-kube-api-access-4dqcq" (OuterVolumeSpecName: "kube-api-access-4dqcq") pod "59f82064-a8fe-473b-a41d-6da55ea635a7" (UID: "59f82064-a8fe-473b-a41d-6da55ea635a7"). InnerVolumeSpecName "kube-api-access-4dqcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:43:20.893330 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:20.893293 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dqcq\" (UniqueName: \"kubernetes.io/projected/59f82064-a8fe-473b-a41d-6da55ea635a7-kube-api-access-4dqcq\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:43:21.114814 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.114725 2580 generic.go:356] "Generic (PLEG): container finished" podID="59f82064-a8fe-473b-a41d-6da55ea635a7" containerID="2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2" exitCode=0 Jun 10 17:43:21.114814 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.114768 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4t2bv" Jun 10 17:43:21.114993 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.114814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4t2bv" event={"ID":"59f82064-a8fe-473b-a41d-6da55ea635a7","Type":"ContainerDied","Data":"2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2"} Jun 10 17:43:21.114993 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.114857 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4t2bv" event={"ID":"59f82064-a8fe-473b-a41d-6da55ea635a7","Type":"ContainerDied","Data":"465f526ebf9a5a72cb578cbf0c9d4bde4918b53c47735ba463773d33c7d3ee74"} Jun 10 17:43:21.114993 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.114877 2580 scope.go:117] "RemoveContainer" containerID="2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2" Jun 10 17:43:21.123637 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.123622 2580 scope.go:117] "RemoveContainer" containerID="2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2" Jun 10 17:43:21.123932 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:43:21.123915 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2\": container with ID starting with 2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2 not found: ID does not exist" containerID="2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2" Jun 10 17:43:21.123985 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.123940 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2"} err="failed to get container status \"2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2\": rpc error: code = NotFound desc = could not find container \"2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2\": container with ID starting with 2d8e261adf20a1a48de8676f449ee60ad9b291ea3ae2cee5b38f6d63ee5992f2 not found: ID does not exist" Jun 10 17:43:21.134996 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.134973 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4t2bv"] Jun 10 17:43:21.139961 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:21.139942 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4t2bv"] Jun 10 17:43:22.082269 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:22.082235 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f82064-a8fe-473b-a41d-6da55ea635a7" path="/var/lib/kubelet/pods/59f82064-a8fe-473b-a41d-6da55ea635a7/volumes" Jun 10 17:43:58.218271 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.218229 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-v5dl8"] Jun 10 17:43:58.218730 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.218600 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f82064-a8fe-473b-a41d-6da55ea635a7" containerName="authorino" Jun 10 17:43:58.218730 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.218611 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f82064-a8fe-473b-a41d-6da55ea635a7" containerName="authorino" Jun 10 17:43:58.218730 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.218675 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f82064-a8fe-473b-a41d-6da55ea635a7" containerName="authorino" Jun 10 17:43:58.221566 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.221549 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:43:58.224195 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.224165 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bv9rd\"" Jun 10 17:43:58.224323 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.224215 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 17:43:58.231185 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.231156 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-v5dl8"] Jun 10 17:43:58.322191 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.322150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmvm\" (UniqueName: \"kubernetes.io/projected/31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288-kube-api-access-8wmvm\") pod \"payload-pre-processing-579785bc64-v5dl8\" (UID: \"31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288\") " pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:43:58.373679 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.373625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:43:58.422988 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.422944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmvm\" (UniqueName: \"kubernetes.io/projected/31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288-kube-api-access-8wmvm\") pod \"payload-pre-processing-579785bc64-v5dl8\" (UID: \"31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288\") " pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:43:58.433381 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.433348 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmvm\" (UniqueName: \"kubernetes.io/projected/31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288-kube-api-access-8wmvm\") pod \"payload-pre-processing-579785bc64-v5dl8\" (UID: \"31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288\") " pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:43:58.532283 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.532188 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:43:58.665064 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.665039 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-v5dl8"] Jun 10 17:43:58.667382 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:43:58.667355 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fe2cdf_4ea9_4124_bcdb_1bc3e30a0288.slice/crio-d93d5eea58cbb6335d199946e7d52bc9ebcbaa3a0dc1e184b1c38f00a68fb95f WatchSource:0}: Error finding container d93d5eea58cbb6335d199946e7d52bc9ebcbaa3a0dc1e184b1c38f00a68fb95f: Status 404 returned error can't find the container with id d93d5eea58cbb6335d199946e7d52bc9ebcbaa3a0dc1e184b1c38f00a68fb95f Jun 10 17:43:58.669280 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:58.669264 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 17:43:59.286564 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:43:59.286516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" event={"ID":"31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288","Type":"ContainerStarted","Data":"d93d5eea58cbb6335d199946e7d52bc9ebcbaa3a0dc1e184b1c38f00a68fb95f"} Jun 10 17:44:01.301155 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:01.301120 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" event={"ID":"31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288","Type":"ContainerStarted","Data":"d9851d5363c30730cda0cc3b4cd2cbbfd98ab142912b9e02ccd06c9f9b33a079"} Jun 10 17:44:01.301612 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:01.301253 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:44:01.316376 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:01.316332 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" podStartSLOduration=1.143459502 podStartE2EDuration="3.316317313s" totalImagesPullingTime="2.172857811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:44:01.316003681 +0000 UTC m=+765.638171799" watchObservedRunningTime="2026-06-10 17:44:01.316317313 +0000 UTC m=+765.638485430" Jun 10 17:44:12.308148 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:12.308118 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-v5dl8" Jun 10 17:44:47.781438 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.781401 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d44c695b8-r8vmf"] Jun 10 17:44:47.785047 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.785027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.788519 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.788496 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 17:44:47.788639 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.788501 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zkhq5\"" Jun 10 17:44:47.788639 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.788501 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 17:44:47.792002 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.791877 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d44c695b8-r8vmf"] Jun 10 17:44:47.852753 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.852715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b37868f-ec70-4339-a78f-a89708cfd831-oidc-ca\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.852753 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.852754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b37868f-ec70-4339-a78f-a89708cfd831-tls-cert\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.852948 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.852880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqn7\" (UniqueName: \"kubernetes.io/projected/9b37868f-ec70-4339-a78f-a89708cfd831-kube-api-access-scqn7\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.954246 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.954209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b37868f-ec70-4339-a78f-a89708cfd831-oidc-ca\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.954440 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.954252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b37868f-ec70-4339-a78f-a89708cfd831-tls-cert\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.954440 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.954326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scqn7\" (UniqueName: \"kubernetes.io/projected/9b37868f-ec70-4339-a78f-a89708cfd831-kube-api-access-scqn7\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.954991 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.954968 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b37868f-ec70-4339-a78f-a89708cfd831-oidc-ca\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.956951 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.956929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b37868f-ec70-4339-a78f-a89708cfd831-tls-cert\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:47.961462 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:47.961444 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqn7\" (UniqueName: \"kubernetes.io/projected/9b37868f-ec70-4339-a78f-a89708cfd831-kube-api-access-scqn7\") pod \"authorino-d44c695b8-r8vmf\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:48.103081 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:48.102995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:44:48.236699 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:48.236674 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d44c695b8-r8vmf"] Jun 10 17:44:48.239001 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:44:48.238962 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b37868f_ec70_4339_a78f_a89708cfd831.slice/crio-52c08d2b338842bf88c2f3cf71fd14f47c2c6b767780037624676adb9c2f4152 WatchSource:0}: Error finding container 52c08d2b338842bf88c2f3cf71fd14f47c2c6b767780037624676adb9c2f4152: Status 404 returned error can't find the container with id 52c08d2b338842bf88c2f3cf71fd14f47c2c6b767780037624676adb9c2f4152 Jun 10 17:44:48.507900 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:48.507860 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d44c695b8-r8vmf" event={"ID":"9b37868f-ec70-4339-a78f-a89708cfd831","Type":"ContainerStarted","Data":"52c08d2b338842bf88c2f3cf71fd14f47c2c6b767780037624676adb9c2f4152"} Jun 10 17:44:49.514720 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:49.514682 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d44c695b8-r8vmf" event={"ID":"9b37868f-ec70-4339-a78f-a89708cfd831","Type":"ContainerStarted","Data":"ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a"} Jun 10 17:44:49.528224 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:44:49.528173 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d44c695b8-r8vmf" podStartSLOduration=2.132520184 podStartE2EDuration="2.528159753s" totalImagesPullingTime="395.639569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:44:49.527639742 +0000 UTC m=+813.849807884" watchObservedRunningTime="2026-06-10 17:44:49.528159753 +0000 UTC m=+813.850327870" Jun 10 17:45:02.084130 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:45:02.084101 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:45:04.682003 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:45:04.681966 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:45:13.678591 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:45:13.678549 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:45:29.384303 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:45:29.384266 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:45:33.588104 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:45:33.588068 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:45:56.384688 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:45:56.384640 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:46:16.096919 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:46:16.096840 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:46:16.097445 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:46:16.096960 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:48:25.408762 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.408728 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64847467df-97lqw"] Jun 10 17:48:25.411427 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.411410 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.418854 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.418830 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64847467df-97lqw"] Jun 10 17:48:25.490162 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.490126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f74f1d5-add0-475e-af3c-f7f2c483d23b-oidc-ca\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.490162 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.490163 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrgng\" (UniqueName: \"kubernetes.io/projected/5f74f1d5-add0-475e-af3c-f7f2c483d23b-kube-api-access-wrgng\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.490371 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.490230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f74f1d5-add0-475e-af3c-f7f2c483d23b-tls-cert\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.591059 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.591025 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f74f1d5-add0-475e-af3c-f7f2c483d23b-oidc-ca\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.591059 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.591060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrgng\" (UniqueName: \"kubernetes.io/projected/5f74f1d5-add0-475e-af3c-f7f2c483d23b-kube-api-access-wrgng\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.591268 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.591119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f74f1d5-add0-475e-af3c-f7f2c483d23b-tls-cert\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.591639 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.591621 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5f74f1d5-add0-475e-af3c-f7f2c483d23b-oidc-ca\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.593612 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.593592 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5f74f1d5-add0-475e-af3c-f7f2c483d23b-tls-cert\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.599166 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.599142 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrgng\" (UniqueName: \"kubernetes.io/projected/5f74f1d5-add0-475e-af3c-f7f2c483d23b-kube-api-access-wrgng\") pod \"authorino-64847467df-97lqw\" (UID: \"5f74f1d5-add0-475e-af3c-f7f2c483d23b\") " pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.722024 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.721990 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64847467df-97lqw" Jun 10 17:48:25.852659 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:25.852623 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64847467df-97lqw"] Jun 10 17:48:25.855173 ip-10-0-133-83 kubenswrapper[2580]: W0610 17:48:25.855144 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f74f1d5_add0_475e_af3c_f7f2c483d23b.slice/crio-be5185051bbf897616c934f65ce1536b288cc4202104e85eb17a891b12ca74f3 WatchSource:0}: Error finding container be5185051bbf897616c934f65ce1536b288cc4202104e85eb17a891b12ca74f3: Status 404 returned error can't find the container with id be5185051bbf897616c934f65ce1536b288cc4202104e85eb17a891b12ca74f3 Jun 10 17:48:26.464096 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.464062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64847467df-97lqw" event={"ID":"5f74f1d5-add0-475e-af3c-f7f2c483d23b","Type":"ContainerStarted","Data":"fbe2d600da350b17d1d7ade853375f6f0bcaf9ba6962e529eed52e087378b8ae"} Jun 10 17:48:26.464582 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.464107 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64847467df-97lqw" event={"ID":"5f74f1d5-add0-475e-af3c-f7f2c483d23b","Type":"ContainerStarted","Data":"be5185051bbf897616c934f65ce1536b288cc4202104e85eb17a891b12ca74f3"} Jun 10 17:48:26.481251 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.481189 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64847467df-97lqw" podStartSLOduration=1.00846689 podStartE2EDuration="1.48116804s" totalImagesPullingTime="472.70115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 17:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:48:26.478927394 +0000 UTC m=+1030.801095512" watchObservedRunningTime="2026-06-10 17:48:26.48116804 +0000 UTC m=+1030.803336156" Jun 10 17:48:26.503197 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.503164 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d44c695b8-r8vmf"] Jun 10 17:48:26.503386 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.503342 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-d44c695b8-r8vmf" podUID="9b37868f-ec70-4339-a78f-a89708cfd831" containerName="authorino" containerID="cri-o://ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a" gracePeriod=30 Jun 10 17:48:26.773338 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.773311 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:48:26.902124 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.902043 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b37868f-ec70-4339-a78f-a89708cfd831-oidc-ca\") pod \"9b37868f-ec70-4339-a78f-a89708cfd831\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " Jun 10 17:48:26.902124 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.902120 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scqn7\" (UniqueName: \"kubernetes.io/projected/9b37868f-ec70-4339-a78f-a89708cfd831-kube-api-access-scqn7\") pod \"9b37868f-ec70-4339-a78f-a89708cfd831\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " Jun 10 17:48:26.902376 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.902142 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b37868f-ec70-4339-a78f-a89708cfd831-tls-cert\") pod \"9b37868f-ec70-4339-a78f-a89708cfd831\" (UID: \"9b37868f-ec70-4339-a78f-a89708cfd831\") " Jun 10 17:48:26.904324 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.904281 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b37868f-ec70-4339-a78f-a89708cfd831-kube-api-access-scqn7" (OuterVolumeSpecName: "kube-api-access-scqn7") pod "9b37868f-ec70-4339-a78f-a89708cfd831" (UID: "9b37868f-ec70-4339-a78f-a89708cfd831"). InnerVolumeSpecName "kube-api-access-scqn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 17:48:26.906933 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.906912 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b37868f-ec70-4339-a78f-a89708cfd831-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "9b37868f-ec70-4339-a78f-a89708cfd831" (UID: "9b37868f-ec70-4339-a78f-a89708cfd831"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 17:48:26.912010 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:26.911990 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b37868f-ec70-4339-a78f-a89708cfd831-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9b37868f-ec70-4339-a78f-a89708cfd831" (UID: "9b37868f-ec70-4339-a78f-a89708cfd831"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 17:48:27.002974 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.002940 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scqn7\" (UniqueName: \"kubernetes.io/projected/9b37868f-ec70-4339-a78f-a89708cfd831-kube-api-access-scqn7\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:48:27.002974 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.002969 2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b37868f-ec70-4339-a78f-a89708cfd831-tls-cert\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:48:27.002974 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.002980 2580 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b37868f-ec70-4339-a78f-a89708cfd831-oidc-ca\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 17:48:27.470423 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.470391 2580 generic.go:356] "Generic (PLEG): container finished" podID="9b37868f-ec70-4339-a78f-a89708cfd831" containerID="ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a" exitCode=0 Jun 10 17:48:27.470860 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.470429 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d44c695b8-r8vmf" Jun 10 17:48:27.470860 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.470483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d44c695b8-r8vmf" event={"ID":"9b37868f-ec70-4339-a78f-a89708cfd831","Type":"ContainerDied","Data":"ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a"} Jun 10 17:48:27.470860 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.470530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d44c695b8-r8vmf" event={"ID":"9b37868f-ec70-4339-a78f-a89708cfd831","Type":"ContainerDied","Data":"52c08d2b338842bf88c2f3cf71fd14f47c2c6b767780037624676adb9c2f4152"} Jun 10 17:48:27.470860 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.470553 2580 scope.go:117] "RemoveContainer" containerID="ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a" Jun 10 17:48:27.479709 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.479690 2580 scope.go:117] "RemoveContainer" containerID="ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a" Jun 10 17:48:27.479975 ip-10-0-133-83 kubenswrapper[2580]: E0610 17:48:27.479958 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a\": container with ID starting with ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a not found: ID does not exist" containerID="ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a" Jun 10 17:48:27.480046 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.479983 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a"} err="failed to get container status \"ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a\": rpc error: code = NotFound desc = could not find container \"ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a\": container with ID starting with ab503b665874c874c81f9e7e8e70963bca767ec67c1359dacded4fa153281b3a not found: ID does not exist" Jun 10 17:48:27.490283 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.490254 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d44c695b8-r8vmf"] Jun 10 17:48:27.495522 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:27.495503 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d44c695b8-r8vmf"] Jun 10 17:48:28.082472 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:28.082439 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b37868f-ec70-4339-a78f-a89708cfd831" path="/var/lib/kubelet/pods/9b37868f-ec70-4339-a78f-a89708cfd831/volumes" Jun 10 17:48:56.979734 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:48:56.979698 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:49:06.926582 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:49:06.926504 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:49:16.087387 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:49:16.087351 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:49:26.385690 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:49:26.385636 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:49:35.282676 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:49:35.282625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:49:45.588615 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:49:45.588576 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:50:20.481848 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:50:20.481810 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:50:23.689226 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:50:23.689182 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:50:29.181120 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:50:29.181082 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:50:31.595017 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:50:31.594979 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:51:00.086078 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:51:00.086048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:51:16.124809 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:51:16.124783 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:51:16.125730 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:51:16.125708 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:51:16.384207 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:51:16.384130 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:51:54.486774 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:51:54.486736 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:52:11.085270 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:52:11.085179 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:52:14.482223 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:52:14.482189 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:52:25.384404 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:52:25.384360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:52:41.381406 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:52:41.381369 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:52:44.279762 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:52:44.279725 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:53:19.984773 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:53:19.984733 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:53:23.178789 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:53:23.178751 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:53:45.183863 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:53:45.183824 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:53:54.482516 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:53:54.482477 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:54:10.890296 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:54:10.890260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:54:19.788084 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:54:19.788044 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:54:36.585505 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:54:36.585466 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:54:45.487909 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:54:45.487872 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:55:17.679038 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:55:17.678942 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:55:26.590626 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:55:26.590585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:55:34.385275 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:55:34.385237 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:55:42.883615 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:55:42.883578 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:55:51.286440 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:55:51.286408 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:55:59.791667 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:55:59.791620 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:56:02.887081 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:02.887043 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:56:08.482717 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:08.482685 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:56:16.157484 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:16.157453 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:56:16.159967 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:16.159942 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 17:56:19.810978 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:19.810943 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:56:57.487472 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:57.487433 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:56:59.792843 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:56:59.792812 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:07.885587 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:07.885550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:11.290077 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:11.290038 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:19.392307 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:19.392275 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:26.984756 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:26.984720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:37.080358 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:37.080326 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:45.882289 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:45.882251 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:53.685376 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:53.685342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:57:57.480251 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:57:57.480212 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:02.481511 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:02.481467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:12.187310 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:12.187230 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:20.591172 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:20.591128 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:30.087048 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:30.087012 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:37.886377 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:37.886338 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:47.183134 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:47.183093 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:58:55.289859 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:58:55.289819 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:59:04.383085 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:59:04.383048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:59:12.088870 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:59:12.088832 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:59:21.893671 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:59:21.893615 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 17:59:30.791058 ip-10-0-133-83 kubenswrapper[2580]: I0610 17:59:30.791027 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:00:00.175275 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.175241 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29685240-2qsj5"] Jun 10 18:00:00.175712 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.175633 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b37868f-ec70-4339-a78f-a89708cfd831" containerName="authorino" Jun 10 18:00:00.175712 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.175661 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b37868f-ec70-4339-a78f-a89708cfd831" containerName="authorino" Jun 10 18:00:00.175794 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.175726 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b37868f-ec70-4339-a78f-a89708cfd831" containerName="authorino" Jun 10 18:00:00.178772 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.178751 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:00.182731 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.182710 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tmk6b\"" Jun 10 18:00:00.236833 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.236789 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685240-2qsj5"] Jun 10 18:00:00.269456 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.269421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kh6s\" (UniqueName: \"kubernetes.io/projected/18b5b0a0-0899-428e-8eeb-8219edc9061f-kube-api-access-8kh6s\") pod \"maas-api-key-cleanup-29685240-2qsj5\" (UID: \"18b5b0a0-0899-428e-8eeb-8219edc9061f\") " pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:00.370739 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.370702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kh6s\" (UniqueName: \"kubernetes.io/projected/18b5b0a0-0899-428e-8eeb-8219edc9061f-kube-api-access-8kh6s\") pod \"maas-api-key-cleanup-29685240-2qsj5\" (UID: \"18b5b0a0-0899-428e-8eeb-8219edc9061f\") " pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:00.381169 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.381132 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kh6s\" (UniqueName: \"kubernetes.io/projected/18b5b0a0-0899-428e-8eeb-8219edc9061f-kube-api-access-8kh6s\") pod \"maas-api-key-cleanup-29685240-2qsj5\" (UID: \"18b5b0a0-0899-428e-8eeb-8219edc9061f\") " pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:00.489262 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.489215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:00.649149 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.649095 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685240-2qsj5"] Jun 10 18:00:00.651962 ip-10-0-133-83 kubenswrapper[2580]: W0610 18:00:00.651935 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b5b0a0_0899_428e_8eeb_8219edc9061f.slice/crio-4af5e9f2eff43d70cc61dce75a2977a9343265c18808ab45ac4ad8bee29888b4 WatchSource:0}: Error finding container 4af5e9f2eff43d70cc61dce75a2977a9343265c18808ab45ac4ad8bee29888b4: Status 404 returned error can't find the container with id 4af5e9f2eff43d70cc61dce75a2977a9343265c18808ab45ac4ad8bee29888b4 Jun 10 18:00:00.653823 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:00.653806 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 18:00:01.627380 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:01.627347 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" event={"ID":"18b5b0a0-0899-428e-8eeb-8219edc9061f","Type":"ContainerStarted","Data":"4af5e9f2eff43d70cc61dce75a2977a9343265c18808ab45ac4ad8bee29888b4"} Jun 10 18:00:05.651046 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:05.650956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" event={"ID":"18b5b0a0-0899-428e-8eeb-8219edc9061f","Type":"ContainerStarted","Data":"9474b6f78caf226e4af4bed56f423e0cd805c8b7057a9db40a1b2d78259032e4"} Jun 10 18:00:05.676609 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:05.676558 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" podStartSLOduration=1.323555368 podStartE2EDuration="5.676545644s" totalImagesPullingTime="4.352990276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:00:05.674756852 +0000 UTC m=+1729.996924973" watchObservedRunningTime="2026-06-10 18:00:05.676545644 +0000 UTC m=+1729.998713763" Jun 10 18:00:06.656743 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:06.656708 2580 generic.go:356] "Generic (PLEG): container finished" podID="18b5b0a0-0899-428e-8eeb-8219edc9061f" containerID="9474b6f78caf226e4af4bed56f423e0cd805c8b7057a9db40a1b2d78259032e4" exitCode=0 Jun 10 18:00:06.657125 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:06.656781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" event={"ID":"18b5b0a0-0899-428e-8eeb-8219edc9061f","Type":"ContainerDied","Data":"9474b6f78caf226e4af4bed56f423e0cd805c8b7057a9db40a1b2d78259032e4"} Jun 10 18:00:07.792786 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:07.792763 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:07.939322 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:07.939251 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kh6s\" (UniqueName: \"kubernetes.io/projected/18b5b0a0-0899-428e-8eeb-8219edc9061f-kube-api-access-8kh6s\") pod \"18b5b0a0-0899-428e-8eeb-8219edc9061f\" (UID: \"18b5b0a0-0899-428e-8eeb-8219edc9061f\") " Jun 10 18:00:07.941463 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:07.941441 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b5b0a0-0899-428e-8eeb-8219edc9061f-kube-api-access-8kh6s" (OuterVolumeSpecName: "kube-api-access-8kh6s") pod "18b5b0a0-0899-428e-8eeb-8219edc9061f" (UID: "18b5b0a0-0899-428e-8eeb-8219edc9061f"). InnerVolumeSpecName "kube-api-access-8kh6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 18:00:08.039823 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:08.039800 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kh6s\" (UniqueName: \"kubernetes.io/projected/18b5b0a0-0899-428e-8eeb-8219edc9061f-kube-api-access-8kh6s\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jun 10 18:00:08.667248 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:08.667217 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" Jun 10 18:00:08.667248 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:08.667235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685240-2qsj5" event={"ID":"18b5b0a0-0899-428e-8eeb-8219edc9061f","Type":"ContainerDied","Data":"4af5e9f2eff43d70cc61dce75a2977a9343265c18808ab45ac4ad8bee29888b4"} Jun 10 18:00:08.667465 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:00:08.667304 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4af5e9f2eff43d70cc61dce75a2977a9343265c18808ab45ac4ad8bee29888b4" Jun 10 18:01:16.187167 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:16.187138 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:01:16.192631 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:16.192589 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:01:30.407388 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.407350 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc"] Jun 10 18:01:30.408249 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.408215 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b5b0a0-0899-428e-8eeb-8219edc9061f" containerName="cleanup" Jun 10 18:01:30.408436 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.408414 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b5b0a0-0899-428e-8eeb-8219edc9061f" containerName="cleanup" Jun 10 18:01:30.408779 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.408763 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b5b0a0-0899-428e-8eeb-8219edc9061f" containerName="cleanup" Jun 10 18:01:30.411927 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.411905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.415231 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.415210 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-npmch\"" Jun 10 18:01:30.426844 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.426822 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc"] Jun 10 18:01:30.516700 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.516666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnrw\" (UniqueName: \"kubernetes.io/projected/68627459-8835-4cc9-9245-bbb2491fe7f6-kube-api-access-5vnrw\") pod \"kuadrant-operator-controller-manager-86878c769f-qzlgc\" (UID: \"68627459-8835-4cc9-9245-bbb2491fe7f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.516871 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.516710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68627459-8835-4cc9-9245-bbb2491fe7f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qzlgc\" (UID: \"68627459-8835-4cc9-9245-bbb2491fe7f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.618017 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.617984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnrw\" (UniqueName: \"kubernetes.io/projected/68627459-8835-4cc9-9245-bbb2491fe7f6-kube-api-access-5vnrw\") pod \"kuadrant-operator-controller-manager-86878c769f-qzlgc\" (UID: \"68627459-8835-4cc9-9245-bbb2491fe7f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.618180 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.618028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68627459-8835-4cc9-9245-bbb2491fe7f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qzlgc\" (UID: \"68627459-8835-4cc9-9245-bbb2491fe7f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.618360 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.618344 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68627459-8835-4cc9-9245-bbb2491fe7f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qzlgc\" (UID: \"68627459-8835-4cc9-9245-bbb2491fe7f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.634100 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.634072 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnrw\" (UniqueName: \"kubernetes.io/projected/68627459-8835-4cc9-9245-bbb2491fe7f6-kube-api-access-5vnrw\") pod \"kuadrant-operator-controller-manager-86878c769f-qzlgc\" (UID: \"68627459-8835-4cc9-9245-bbb2491fe7f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.723284 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.723249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:30.868330 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:30.868303 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc"] Jun 10 18:01:30.870528 ip-10-0-133-83 kubenswrapper[2580]: W0610 18:01:30.870503 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68627459_8835_4cc9_9245_bbb2491fe7f6.slice/crio-ec8ca4f6486fae277147adc4e9b68256c8feb4e44103235ecf7c8e404c1daca9 WatchSource:0}: Error finding container ec8ca4f6486fae277147adc4e9b68256c8feb4e44103235ecf7c8e404c1daca9: Status 404 returned error can't find the container with id ec8ca4f6486fae277147adc4e9b68256c8feb4e44103235ecf7c8e404c1daca9 Jun 10 18:01:31.061246 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:31.061166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" event={"ID":"68627459-8835-4cc9-9245-bbb2491fe7f6","Type":"ContainerStarted","Data":"8ce7e5dab141fcc1900771114543f1a253de6d6058f020613f23cc4245ff9970"} Jun 10 18:01:31.061246 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:31.061216 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" event={"ID":"68627459-8835-4cc9-9245-bbb2491fe7f6","Type":"ContainerStarted","Data":"ec8ca4f6486fae277147adc4e9b68256c8feb4e44103235ecf7c8e404c1daca9"} Jun 10 18:01:31.061421 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:31.061290 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:31.083989 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:31.083944 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" podStartSLOduration=1.083931663 podStartE2EDuration="1.083931663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:01:31.081992261 +0000 UTC m=+1815.404160373" watchObservedRunningTime="2026-06-10 18:01:31.083931663 +0000 UTC m=+1815.406099780" Jun 10 18:01:42.068216 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:42.068182 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzlgc" Jun 10 18:01:52.359681 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:52.359617 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:01:57.358696 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:01:57.358625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:02:22.061550 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:02:22.061510 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:02:26.760759 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:02:26.760718 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:02:36.061671 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:02:36.061574 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:02:47.260021 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:02:47.259983 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:02:55.457180 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:02:55.457137 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:06.654752 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:06.654715 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:15.058911 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:15.058872 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:25.664311 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:25.664273 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:34.353964 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:34.353929 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:44.261325 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:44.261287 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:54.265275 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:54.265237 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:03:58.362555 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:03:58.362516 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:04:26.863177 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:04:26.863086 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:05:09.869789 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:05:09.869748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:05:17.954884 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:05:17.954846 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:05:26.966829 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:05:26.966790 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:05:35.960480 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:05:35.960385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:05:45.264596 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:05:45.264564 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:05:55.057238 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:05:55.057202 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:06:03.665083 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:03.665047 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:06:11.554392 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:11.554353 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:06:16.219781 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:16.219754 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:06:16.224607 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:16.224585 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:06:20.951316 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:20.951278 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:06:29.163765 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:29.163726 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:06:36.875324 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:36.875278 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:06:47.361341 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:06:47.361300 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:07:06.063362 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:07:06.063276 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:07:13.061564 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:07:13.061517 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:07:22.467529 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:07:22.467489 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:07:30.364554 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:07:30.364508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:07:47.863252 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:07:47.863204 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:07:56.164948 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:07:56.164899 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:08:05.165033 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:08:05.164987 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:08:13.364825 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:08:13.364791 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:08:22.366502 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:08:22.366459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:08:31.560888 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:08:31.560845 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:08:41.467552 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:08:41.467508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:08:53.359367 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:08:53.359322 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:02.457793 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:02.457748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:12.665111 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:12.665067 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:15.861490 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:15.861456 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:22.462347 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:22.462302 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:29.956092 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:29.956055 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:38.988585 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:38.988550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:45.956670 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:45.955031 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:09:49.161725 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:09:49.161686 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:10:03.366171 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:10:03.366136 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:10:11.965463 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:10:11.965425 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:10:21.161287 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:10:21.161247 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:10:28.157010 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:10:28.156976 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:10:52.658408 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:10:52.658372 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:11:05.164897 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:05.164859 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k4nth"] Jun 10 18:11:16.256924 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:16.256897 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:11:16.261251 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:16.261227 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:11:38.631374 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:38.631294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64847467df-97lqw_5f74f1d5-add0-475e-af3c-f7f2c483d23b/authorino/0.log" Jun 10 18:11:43.803934 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:43.803902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685240-2qsj5_18b5b0a0-0899-428e-8eeb-8219edc9061f/cleanup/0.log" Jun 10 18:11:44.257682 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:44.257629 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55bf9956cc-79p2r_c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0/copy-manifests/0.log" Jun 10 18:11:44.276632 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:44.276597 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55bf9956cc-79p2r_c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0/manager/0.log" Jun 10 18:11:45.893010 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:45.892980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64847467df-97lqw_5f74f1d5-add0-475e-af3c-f7f2c483d23b/authorino/0.log" Jun 10 18:11:46.015383 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:46.015355 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-52nbh_04434e34-b516-4019-9bd3-5d9f6b8a708d/manager/0.log" Jun 10 18:11:46.486458 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:46.486426 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qzlgc_68627459-8835-4cc9-9245-bbb2491fe7f6/manager/0.log" Jun 10 18:11:46.600920 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:46.600888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k4nth_45d91420-dcaa-4788-bbca-4c17941de229/limitador/0.log" Jun 10 18:11:47.295013 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:47.294929 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596f9fd7bd-42n7n_1cc4012c-e2eb-42b7-b556-d4597cb3ab82/kube-auth-proxy/0.log" Jun 10 18:11:47.634424 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:47.634337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-v5dl8_31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288/payload-pre-processing/0.log" Jun 10 18:11:47.861864 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:47.861829 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6484d6f5fc-q6mtj_59e73a71-13de-44ec-8d7f-46785d02cf33/router/0.log" Jun 10 18:11:52.881121 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.881080 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58lq9/must-gather-ftxbj"] Jun 10 18:11:52.884707 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.884684 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:52.887570 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.887524 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58lq9\"/\"openshift-service-ca.crt\"" Jun 10 18:11:52.887717 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.887637 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-58lq9\"/\"kube-root-ca.crt\"" Jun 10 18:11:52.888834 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.888815 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-58lq9\"/\"default-dockercfg-fz7rm\"" Jun 10 18:11:52.894128 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.894107 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58lq9/must-gather-ftxbj"] Jun 10 18:11:52.994888 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.994846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6adbe418-7a55-4972-ba5d-41e221e88402-must-gather-output\") pod \"must-gather-ftxbj\" (UID: \"6adbe418-7a55-4972-ba5d-41e221e88402\") " pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:52.994888 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:52.994895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czbm9\" (UniqueName: \"kubernetes.io/projected/6adbe418-7a55-4972-ba5d-41e221e88402-kube-api-access-czbm9\") pod \"must-gather-ftxbj\" (UID: \"6adbe418-7a55-4972-ba5d-41e221e88402\") " pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:53.096191 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.096152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6adbe418-7a55-4972-ba5d-41e221e88402-must-gather-output\") pod \"must-gather-ftxbj\" (UID: \"6adbe418-7a55-4972-ba5d-41e221e88402\") " pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:53.096191 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.096189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czbm9\" (UniqueName: \"kubernetes.io/projected/6adbe418-7a55-4972-ba5d-41e221e88402-kube-api-access-czbm9\") pod \"must-gather-ftxbj\" (UID: \"6adbe418-7a55-4972-ba5d-41e221e88402\") " pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:53.096576 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.096552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6adbe418-7a55-4972-ba5d-41e221e88402-must-gather-output\") pod \"must-gather-ftxbj\" (UID: \"6adbe418-7a55-4972-ba5d-41e221e88402\") " pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:53.104927 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.104905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czbm9\" (UniqueName: \"kubernetes.io/projected/6adbe418-7a55-4972-ba5d-41e221e88402-kube-api-access-czbm9\") pod \"must-gather-ftxbj\" (UID: \"6adbe418-7a55-4972-ba5d-41e221e88402\") " pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:53.194824 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.194732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58lq9/must-gather-ftxbj" Jun 10 18:11:53.336049 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.335980 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58lq9/must-gather-ftxbj"] Jun 10 18:11:53.338294 ip-10-0-133-83 kubenswrapper[2580]: W0610 18:11:53.338268 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6adbe418_7a55_4972_ba5d_41e221e88402.slice/crio-d8e79181e9e0029bb9b5b8702823d3d15511415fe55bc8c974f7b6f7e8985dfb WatchSource:0}: Error finding container d8e79181e9e0029bb9b5b8702823d3d15511415fe55bc8c974f7b6f7e8985dfb: Status 404 returned error can't find the container with id d8e79181e9e0029bb9b5b8702823d3d15511415fe55bc8c974f7b6f7e8985dfb Jun 10 18:11:53.340118 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:53.340100 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 18:11:54.034300 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:54.034266 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58lq9/must-gather-ftxbj" event={"ID":"6adbe418-7a55-4972-ba5d-41e221e88402","Type":"ContainerStarted","Data":"d8e79181e9e0029bb9b5b8702823d3d15511415fe55bc8c974f7b6f7e8985dfb"} Jun 10 18:11:55.043886 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:55.043836 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58lq9/must-gather-ftxbj" event={"ID":"6adbe418-7a55-4972-ba5d-41e221e88402","Type":"ContainerStarted","Data":"7dde7a62c5fa55b34226d2174c9ffb82e3e444f4628f87afb61bacd36efcf211"} Jun 10 18:11:55.043886 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:55.043888 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58lq9/must-gather-ftxbj" event={"ID":"6adbe418-7a55-4972-ba5d-41e221e88402","Type":"ContainerStarted","Data":"b38fd8f0b1abd7bb45b641cd215dd7c3738d13538dd40bce0ca3c847b2dcfeec"} Jun 10 18:11:55.072117 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:55.072039 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58lq9/must-gather-ftxbj" podStartSLOduration=2.121626691 podStartE2EDuration="3.072016816s" totalImagesPullingTime="950.390125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:11:55.06148054 +0000 UTC m=+2439.383648657" watchObservedRunningTime="2026-06-10 18:11:55.072016816 +0000 UTC m=+2439.394184931" Jun 10 18:11:56.138822 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:56.138789 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dfwx4_6b4e1a2a-9967-43f0-8cdd-59edeb208fc1/global-pull-secret-syncer/0.log" Jun 10 18:11:56.283723 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:56.283683 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w6dtw_5783f82c-a430-409f-92c2-eb5116041413/konnectivity-agent/0.log" Jun 10 18:11:56.310928 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:11:56.310902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-83.ec2.internal_86ea6e526d0e13d9297ab97bb88e6cf7/haproxy/0.log" Jun 10 18:12:01.407969 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:01.407630 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64847467df-97lqw_5f74f1d5-add0-475e-af3c-f7f2c483d23b/authorino/0.log" Jun 10 18:12:01.439510 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:01.437155 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-52nbh_04434e34-b516-4019-9bd3-5d9f6b8a708d/manager/0.log" Jun 10 18:12:01.642671 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:01.641772 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qzlgc_68627459-8835-4cc9-9245-bbb2491fe7f6/manager/0.log" Jun 10 18:12:01.666143 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:01.666061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k4nth_45d91420-dcaa-4788-bbca-4c17941de229/limitador/0.log" Jun 10 18:12:03.563971 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:03.563927 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-5kk5d_ed144d4c-1d23-4dd5-a4df-6279a77e8691/cluster-monitoring-operator/0.log" Jun 10 18:12:03.800956 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:03.800867 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9w2j9_54594941-10bc-49d6-8586-b66ae115e8a6/node-exporter/0.log" Jun 10 18:12:03.830725 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:03.830696 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9w2j9_54594941-10bc-49d6-8586-b66ae115e8a6/kube-rbac-proxy/0.log" Jun 10 18:12:03.854273 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:03.854250 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9w2j9_54594941-10bc-49d6-8586-b66ae115e8a6/init-textfile/0.log" Jun 10 18:12:03.966439 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:03.966411 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qhbsl_021dd10b-1941-48b0-b056-36715efaa51b/kube-rbac-proxy-main/0.log" Jun 10 18:12:03.991042 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:03.991016 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qhbsl_021dd10b-1941-48b0-b056-36715efaa51b/kube-rbac-proxy-self/0.log" Jun 10 18:12:04.017486 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.017459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-qhbsl_021dd10b-1941-48b0-b056-36715efaa51b/openshift-state-metrics/0.log" Jun 10 18:12:04.073551 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.073516 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/prometheus/0.log" Jun 10 18:12:04.103442 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.103368 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/config-reloader/0.log" Jun 10 18:12:04.128921 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.128896 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/thanos-sidecar/0.log" Jun 10 18:12:04.158936 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.158897 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/kube-rbac-proxy-web/0.log" Jun 10 18:12:04.179830 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.179798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/kube-rbac-proxy/0.log" Jun 10 18:12:04.199855 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.199811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/kube-rbac-proxy-thanos/0.log" Jun 10 18:12:04.220979 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.220941 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_359f275c-e2b7-41ca-b05d-672dbc59a65e/init-config-reloader/0.log" Jun 10 18:12:04.319683 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.319593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-cch4q_54382e37-796a-4480-97d0-edbcdd16aeb9/prometheus-operator-admission-webhook/0.log" Jun 10 18:12:04.436056 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.436021 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6964f77cb8-5tkqd_61a30fd4-a2e7-4817-84f7-532450a88cf5/thanos-query/0.log" Jun 10 18:12:04.461250 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.461220 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6964f77cb8-5tkqd_61a30fd4-a2e7-4817-84f7-532450a88cf5/kube-rbac-proxy-web/0.log" Jun 10 18:12:04.483522 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.483487 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6964f77cb8-5tkqd_61a30fd4-a2e7-4817-84f7-532450a88cf5/kube-rbac-proxy/0.log" Jun 10 18:12:04.504389 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.504356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6964f77cb8-5tkqd_61a30fd4-a2e7-4817-84f7-532450a88cf5/prom-label-proxy/0.log" Jun 10 18:12:04.544777 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.544740 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6964f77cb8-5tkqd_61a30fd4-a2e7-4817-84f7-532450a88cf5/kube-rbac-proxy-rules/0.log" Jun 10 18:12:04.582548 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:04.582463 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6964f77cb8-5tkqd_61a30fd4-a2e7-4817-84f7-532450a88cf5/kube-rbac-proxy-metrics/0.log" Jun 10 18:12:05.925366 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:05.925333 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qvnh6_3239c6f1-eea4-4758-ab8f-6bbf55d5d08d/networking-console-plugin/0.log" Jun 10 18:12:06.666513 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:06.666479 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/2.log" Jun 10 18:12:06.674790 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:06.674728 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-d9mm4_200f2e18-3f93-419d-96da-462c31e3c021/console-operator/3.log" Jun 10 18:12:07.943790 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:07.943762 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-5bjp4_1f2087c0-e5aa-4bfe-a98e-d358b3f2c242/volume-data-source-validator/0.log" Jun 10 18:12:08.147339 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.147303 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj"] Jun 10 18:12:08.156560 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.156529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.158737 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.158708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-sys\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.158863 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.158748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-lib-modules\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.158863 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.158806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvvr\" (UniqueName: \"kubernetes.io/projected/b3910e59-7841-46e0-b7b5-977907d73eb7-kube-api-access-dcvvr\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.158976 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.158875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-podres\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.159185 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.159166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-proc\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.159335 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.159200 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj"] Jun 10 18:12:08.259934 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.259895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvvr\" (UniqueName: \"kubernetes.io/projected/b3910e59-7841-46e0-b7b5-977907d73eb7-kube-api-access-dcvvr\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260127 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.259962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-podres\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260127 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260018 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-proc\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260127 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-sys\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260127 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-lib-modules\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260325 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260192 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-sys\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260325 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-lib-modules\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260325 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260240 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-proc\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.260325 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.260276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3910e59-7841-46e0-b7b5-977907d73eb7-podres\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.270487 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.270456 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvvr\" (UniqueName: \"kubernetes.io/projected/b3910e59-7841-46e0-b7b5-977907d73eb7-kube-api-access-dcvvr\") pod \"perf-node-gather-daemonset-x6spj\" (UID: \"b3910e59-7841-46e0-b7b5-977907d73eb7\") " pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.471277 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.471240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:08.663938 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:08.662772 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj"] Jun 10 18:12:09.144539 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.144446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" event={"ID":"b3910e59-7841-46e0-b7b5-977907d73eb7","Type":"ContainerStarted","Data":"471e6629e0b1a751bcbd2d5eb0956353a0f75a21c1b56bd5d594ca9fc70d9c67"} Jun 10 18:12:09.144539 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.144517 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" event={"ID":"b3910e59-7841-46e0-b7b5-977907d73eb7","Type":"ContainerStarted","Data":"b6444157a132767f4ac52b38b8d3749e0ff0cd6d34ce1457d6346128d7bb1b17"} Jun 10 18:12:09.145006 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.144553 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:09.162157 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.162098 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" podStartSLOduration=1.162081287 podStartE2EDuration="1.162081287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:12:09.160491861 +0000 UTC m=+2453.482659989" watchObservedRunningTime="2026-06-10 18:12:09.162081287 +0000 UTC m=+2453.484249404" Jun 10 18:12:09.267097 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.267069 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x27wn_2fedef23-1c8a-4e54-aea0-341b98460186/dns/0.log" Jun 10 18:12:09.287323 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.287293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x27wn_2fedef23-1c8a-4e54-aea0-341b98460186/kube-rbac-proxy/0.log" Jun 10 18:12:09.340267 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.340239 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4pf4_29f2f3b8-ef75-49fb-a219-2c596d3a32ba/dns-node-resolver/0.log" Jun 10 18:12:09.924540 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:09.924513 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bs69v_748a318c-0372-46ed-92b9-68da6ef49669/node-ca/0.log" Jun 10 18:12:11.027606 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:11.027572 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596f9fd7bd-42n7n_1cc4012c-e2eb-42b7-b556-d4597cb3ab82/kube-auth-proxy/0.log" Jun 10 18:12:11.160318 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:11.160281 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-v5dl8_31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288/payload-pre-processing/0.log" Jun 10 18:12:11.243926 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:11.243898 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6484d6f5fc-q6mtj_59e73a71-13de-44ec-8d7f-46785d02cf33/router/0.log" Jun 10 18:12:11.841797 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:11.841754 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dfbm_3bf03637-eac7-4dbf-bca7-1c8c73275d67/serve-healthcheck-canary/0.log" Jun 10 18:12:12.399157 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:12.399126 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-kztrg_9da83fbf-3933-4871-8c10-8461d9500ced/insights-operator/0.log" Jun 10 18:12:12.401621 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:12.401585 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-kztrg_9da83fbf-3933-4871-8c10-8461d9500ced/insights-operator/1.log" Jun 10 18:12:12.498366 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:12.498340 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6mw4_ff72039c-1496-4dc5-9700-304a54c66348/kube-rbac-proxy/0.log" Jun 10 18:12:12.517794 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:12.517760 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6mw4_ff72039c-1496-4dc5-9700-304a54c66348/exporter/0.log" Jun 10 18:12:12.540114 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:12.540088 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m6mw4_ff72039c-1496-4dc5-9700-304a54c66348/extractor/0.log" Jun 10 18:12:15.041622 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:15.041588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685240-2qsj5_18b5b0a0-0899-428e-8eeb-8219edc9061f/cleanup/0.log" Jun 10 18:12:15.162332 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:15.162289 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-58lq9/perf-node-gather-daemonset-x6spj" Jun 10 18:12:15.371601 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:15.371507 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55bf9956cc-79p2r_c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0/manager/0.log" Jun 10 18:12:15.387455 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:15.387431 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55bf9956cc-79p2r_c0a5fcdc-e3d0-4c04-a00a-66a60cd8ccc0/copy-manifests/0.log" Jun 10 18:12:17.112123 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:17.112030 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6648fffc94-7s9nd_f8533dbf-f233-4860-a56c-1fe97a98d659/manager/0.log" Jun 10 18:12:21.576503 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:21.576472 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596f9fd7bd-42n7n_1cc4012c-e2eb-42b7-b556-d4597cb3ab82/kube-auth-proxy/0.log" Jun 10 18:12:21.675782 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:21.675750 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-v5dl8_31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288/payload-pre-processing/0.log" Jun 10 18:12:21.743558 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:21.743525 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6484d6f5fc-q6mtj_59e73a71-13de-44ec-8d7f-46785d02cf33/router/0.log" Jun 10 18:12:22.657066 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:22.656955 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-gf4tn_00d3677b-33d1-40c2-9e26-82bbe553cb03/migrator/0.log" Jun 10 18:12:22.677221 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:22.677139 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-gf4tn_00d3677b-33d1-40c2-9e26-82bbe553cb03/graceful-termination/0.log" Jun 10 18:12:23.030018 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:23.029990 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596f9fd7bd-42n7n_1cc4012c-e2eb-42b7-b556-d4597cb3ab82/kube-auth-proxy/0.log" Jun 10 18:12:23.128081 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:23.128052 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-v5dl8_31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288/payload-pre-processing/0.log" Jun 10 18:12:23.198345 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:23.198313 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6484d6f5fc-q6mtj_59e73a71-13de-44ec-8d7f-46785d02cf33/router/0.log" Jun 10 18:12:24.249955 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.249926 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6b5jc_f10b4fd1-6df4-46ed-9e50-04be74267c91/kube-multus/0.log" Jun 10 18:12:24.433360 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.433329 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/kube-multus-additional-cni-plugins/0.log" Jun 10 18:12:24.455129 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.455100 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/egress-router-binary-copy/0.log" Jun 10 18:12:24.477175 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.477149 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/cni-plugins/0.log" Jun 10 18:12:24.497704 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.497679 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/bond-cni-plugin/0.log" Jun 10 18:12:24.519178 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.519098 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/routeoverride-cni/0.log" Jun 10 18:12:24.540257 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.540230 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/whereabouts-cni-bincopy/0.log" Jun 10 18:12:24.560343 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.560311 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwm55_18cbbda9-50f0-49a4-ab71-48ae7ce2f1c8/whereabouts-cni/0.log" Jun 10 18:12:24.805441 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.805363 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-22wk7_56b2c968-078f-451e-a1e6-9563048127cb/network-metrics-daemon/0.log" Jun 10 18:12:24.825991 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.825957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-22wk7_56b2c968-078f-451e-a1e6-9563048127cb/kube-rbac-proxy/0.log" Jun 10 18:12:24.874081 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.874047 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-596f9fd7bd-42n7n_1cc4012c-e2eb-42b7-b556-d4597cb3ab82/kube-auth-proxy/0.log" Jun 10 18:12:24.963541 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:24.963510 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-v5dl8_31fe2cdf-4ea9-4124-bcdb-1bc3e30a0288/payload-pre-processing/0.log" Jun 10 18:12:25.031183 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:25.031150 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6484d6f5fc-q6mtj_59e73a71-13de-44ec-8d7f-46785d02cf33/router/0.log" Jun 10 18:12:25.957591 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:25.957563 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/ovn-controller/0.log" Jun 10 18:12:25.981171 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:25.981139 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/ovn-acl-logging/0.log" Jun 10 18:12:26.015228 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:26.015199 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/kube-rbac-proxy-node/0.log" Jun 10 18:12:26.042709 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:26.042679 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 18:12:26.061446 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:26.061418 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/northd/0.log" Jun 10 18:12:26.083001 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:26.082973 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/nbdb/0.log" Jun 10 18:12:26.104508 ip-10-0-133-83 kubenswrapper[2580]: I0610 18:12:26.104477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5qlgr_bbb95776-0430-4c0f-99df-544ce8660d8b/sbdb/0.log"