Jun 09 06:55:47.957422 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 06:55:47.957433 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 06:55:47.957441 ip-10-0-134-45 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 06:55:47.957664 ip-10-0-134-45 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 06:55:57.666390 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 09 06:55:57.666404 ip-10-0-134-45 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 407b40aa8f1f4693b7c6586d165d040c -- Jun 09 06:58:21.520025 ip-10-0-134-45 systemd[1]: Starting Kubernetes Kubelet... Jun 09 06:58:21.888276 ip-10-0-134-45 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 06:58:21.888276 ip-10-0-134-45 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 06:58:21.888276 ip-10-0-134-45 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 06:58:21.888276 ip-10-0-134-45 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 06:58:21.888276 ip-10-0-134-45 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 06:58:21.891069 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.890989 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 06:58:21.895999 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.895982 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:21.895999 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.895999 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:21.896086 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896003 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:21.896086 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896007 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:21.896086 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896010 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:21.896086 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896055 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896091 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896096 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896101 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896107 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896112 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896118 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896122 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896126 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896129 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896132 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896135 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896137 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896140 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896147 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896150 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896153 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896156 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896159 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896161 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:21.896251 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896166 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:21.897067 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896170 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:21.897067 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896175 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:21.897067 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896179 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:21.897067 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896183 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:21.897388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.896188 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:21.897429 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897391 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:21.897540 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897530 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897541 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897547 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897552 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897556 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897561 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897565 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897570 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:21.897574 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897575 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897580 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897585 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897588 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897592 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897596 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897600 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897604 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897608 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897613 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897617 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897620 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897624 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897629 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897634 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897641 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897650 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897654 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897659 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897663 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:21.897811 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897667 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897671 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897675 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897680 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897685 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897689 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897693 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897697 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897702 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897707 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897710 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897713 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897734 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897737 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897741 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897744 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897746 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897749 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897751 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:21.898371 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897754 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897756 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897759 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897761 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897764 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897767 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897770 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897772 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897775 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897785 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897788 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897791 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897793 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897796 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897798 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897801 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897804 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897806 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897809 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.897811 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:21.898888 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898515 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898522 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898526 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898529 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898531 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898534 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898537 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898540 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898542 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898545 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898547 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898550 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898554 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898557 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898561 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898564 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898566 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898569 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898571 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898574 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:21.899401 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898577 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898580 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898583 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898586 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898589 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898591 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898594 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898596 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898599 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898601 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898604 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898606 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898609 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898611 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898614 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898616 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898618 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898621 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898634 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898637 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:21.899942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898640 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898642 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898645 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898647 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898650 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898652 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898656 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898659 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898661 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898664 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898667 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898669 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898672 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898674 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898677 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898681 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898683 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898688 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898691 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:21.900463 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898694 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898697 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898699 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898702 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898705 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898708 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898711 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898714 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898735 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898738 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898741 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898744 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898748 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898751 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898754 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898756 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898759 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898761 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898764 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898768 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:21.900973 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898770 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898773 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898776 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898778 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898781 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898783 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898786 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898788 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898791 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898795 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898797 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898800 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898803 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898808 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898811 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898814 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898816 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898819 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898822 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:21.901485 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.898824 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899884 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899891 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899894 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899899 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899901 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899904 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899908 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899911 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899913 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899916 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899918 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899921 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899923 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899926 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899929 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899933 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899936 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899939 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:21.901983 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899942 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899945 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899948 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899951 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899954 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899957 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899960 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899962 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899965 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899970 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899974 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899976 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899979 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899982 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899985 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899988 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899991 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899994 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899997 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.899999 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:21.902482 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900002 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900005 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900008 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900010 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900013 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900015 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900018 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900020 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900023 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900025 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900028 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900030 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900033 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900036 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900038 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900040 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900044 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900048 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900052 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900054 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:21.903043 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900057 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900060 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900062 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900065 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900067 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900070 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900072 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900075 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900077 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900079 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900082 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900084 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900087 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900090 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900092 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900095 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900097 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900100 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900102 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900105 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:21.903603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900107 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900109 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900112 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900114 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900117 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900119 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900122 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900124 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900127 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900130 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900132 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900135 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900137 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900140 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900142 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900145 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900148 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900150 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900152 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900155 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:21.904135 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900157 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900236 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900243 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900249 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900255 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900262 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900266 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900271 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900275 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900278 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900281 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900284 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900287 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900290 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900293 2563 flags.go:64] FLAG: --cgroup-root="" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900295 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900298 2563 flags.go:64] FLAG: --client-ca-file="" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900301 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900304 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900307 2563 flags.go:64] FLAG: --cluster-domain="" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900310 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900313 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900316 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900319 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 06:58:21.904647 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900323 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900327 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900330 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900333 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900336 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900339 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900341 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900345 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900347 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900352 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900355 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900357 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900360 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900363 2563 flags.go:64] FLAG: --enable-server="true" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900365 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900370 2563 flags.go:64] FLAG: --event-burst="100" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900373 2563 flags.go:64] FLAG: --event-qps="50" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900376 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900379 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900382 2563 flags.go:64] FLAG: --eviction-hard="" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900385 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900388 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900391 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900394 2563 flags.go:64] FLAG: --eviction-soft="" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900396 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 06:58:21.905266 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900399 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900402 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900405 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900408 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900410 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900413 2563 flags.go:64] FLAG: --feature-gates="" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900417 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900420 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900425 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900428 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900431 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900434 2563 flags.go:64] FLAG: --help="false" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900436 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-45.ec2.internal" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900439 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900442 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900445 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900448 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900452 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900455 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900458 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900460 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900463 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900466 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900470 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 06:58:21.905967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900473 2563 flags.go:64] FLAG: --kube-reserved="" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900476 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900478 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900481 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900484 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900487 2563 flags.go:64] FLAG: --lock-file="" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900489 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900492 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900495 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900500 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900503 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900506 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900508 2563 flags.go:64] FLAG: --logging-format="text" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900511 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900514 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900517 2563 flags.go:64] FLAG: --manifest-url="" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900521 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900526 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900529 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900533 2563 flags.go:64] FLAG: --max-pods="110" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900537 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900540 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900542 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900545 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900548 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 06:58:21.906700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900551 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900554 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900561 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900564 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900567 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900570 2563 flags.go:64] FLAG: --pod-cidr="" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900573 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900578 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900581 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900584 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900587 2563 flags.go:64] FLAG: --port="10250" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900589 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900592 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05143c24922a270ca" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900595 2563 flags.go:64] FLAG: --qos-reserved="" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900598 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900601 2563 flags.go:64] FLAG: --register-node="true" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900604 2563 flags.go:64] FLAG: --register-with-taints="" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900607 2563 flags.go:64] FLAG: --registry-burst="10" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900610 2563 flags.go:64] FLAG: --registry-qps="5" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900612 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900615 2563 flags.go:64] FLAG: --reserved-memory="" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900619 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900622 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900627 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900629 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 06:58:21.907390 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900632 2563 flags.go:64] FLAG: --runonce="false" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900635 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900638 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900641 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900644 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900646 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900653 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900655 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900658 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900661 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900663 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900666 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900669 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900672 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900675 2563 flags.go:64] FLAG: --system-cgroups="" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900678 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900683 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900685 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900688 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900692 2563 flags.go:64] FLAG: --tls-min-version="" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900694 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900697 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900700 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900702 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900705 2563 flags.go:64] FLAG: --v="2" Jun 09 06:58:21.908045 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900709 2563 flags.go:64] FLAG: --version="false" Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900712 2563 flags.go:64] FLAG: --vmodule="" Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900733 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.900737 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900851 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900857 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900863 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900866 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900870 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900873 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900877 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900879 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900882 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900886 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900889 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900891 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900894 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900896 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900899 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900901 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:21.908704 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900904 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900906 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900909 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900912 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900914 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900917 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900919 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900921 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900924 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900926 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900929 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900931 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900934 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900936 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900939 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900942 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900944 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900948 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900951 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900955 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:21.909241 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900958 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900961 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900964 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900966 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900968 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900972 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900975 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900978 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900980 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900983 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900986 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900988 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900991 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900994 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900996 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.900999 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901001 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901004 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901006 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901009 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:21.909784 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901011 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901014 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901016 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901019 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901021 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901024 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901026 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901042 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901046 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901051 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901055 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901058 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901061 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901064 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901067 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901070 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901072 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901077 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901080 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901082 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:21.910311 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901085 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901088 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901090 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901092 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901096 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901099 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901102 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901105 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901108 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901111 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901113 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901116 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901118 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901121 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901123 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901126 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901129 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901131 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901134 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:21.910902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901136 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901139 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901145 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.901148 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.901829 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909060 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909075 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909094 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909100 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909154 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909159 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909162 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909165 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909167 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:21.911388 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909172 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909176 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909179 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909182 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909185 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909188 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909192 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909195 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909198 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909200 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909203 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909205 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909208 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909211 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909213 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909215 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909218 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909220 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909223 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909226 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:21.911896 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909228 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909230 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909233 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909235 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909239 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909242 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909245 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909248 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909250 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909253 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909256 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909258 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909261 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909263 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909266 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909268 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909270 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909273 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909275 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909278 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:21.912406 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909280 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909283 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909285 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909288 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909290 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909293 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909295 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909298 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909300 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909302 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909305 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909309 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909312 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909315 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909317 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909320 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909324 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909328 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909331 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:21.912942 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909333 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909336 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909338 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909341 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909343 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909345 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909348 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909350 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909352 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909355 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909357 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909360 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909362 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909364 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909367 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909370 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909373 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909375 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909378 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909380 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:21.913436 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909383 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909386 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909388 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909390 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909393 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909396 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909398 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909401 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909404 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909407 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909410 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909414 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909417 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909420 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909422 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:21.913967 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909428 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909541 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909545 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909548 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909551 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909553 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909556 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909559 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909561 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909564 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909566 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909569 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909571 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909574 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909577 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909579 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909581 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909585 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909587 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909590 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 06:58:21.914357 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909592 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909595 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909597 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909599 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909602 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909605 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909607 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909610 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909612 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909615 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909617 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909620 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909622 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909625 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909628 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909630 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909633 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909635 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909638 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909640 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 06:58:21.914902 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909644 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909648 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909651 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909653 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909656 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909658 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909661 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909663 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909666 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909668 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909671 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909673 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909675 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909678 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909680 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909683 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909685 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909687 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909690 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 06:58:21.915411 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909692 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909694 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909697 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909700 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909702 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909705 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909707 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909710 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909712 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909731 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909736 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909739 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909741 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909743 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909746 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909748 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909751 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909754 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909757 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909759 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 06:58:21.915985 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909762 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909764 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909767 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909769 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909771 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909774 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909776 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909779 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909782 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909784 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909788 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909792 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909796 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909800 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909803 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909806 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909810 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909813 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909816 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 06:58:21.916524 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909818 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:21.909821 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909826 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.909929 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.913272 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.914928 2563 server.go:1019] "Starting client certificate rotation" Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.915032 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 06:58:21.917068 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.915081 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 06:58:21.918028 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.918007 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 06:58:21.922081 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.922066 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 06:58:21.940495 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.940473 2563 log.go:25] "Validated CRI v1 runtime API" Jun 09 06:58:21.943479 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.943459 2563 log.go:25] "Validated CRI v1 image API" Jun 09 06:58:21.945830 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.945813 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 06:58:21.947107 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.947090 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 06:58:21.948918 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.948897 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87e91970-082b-4424-bff8-94de6f23a19f:/dev/nvme0n1p3 bdf0f6c9-b8b4-4f6a-8175-469a0951bec4:/dev/nvme0n1p4] Jun 09 06:58:21.948991 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.948918 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 06:58:21.954520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.954417 2563 manager.go:216] Machine: {Timestamp:2026-06-09 06:58:21.953004013 +0000 UTC m=+0.337272962 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100270 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a054205b5893015ba26d57318366f SystemUUID:ec2a0542-05b5-8930-15ba-26d57318366f BootID:407b40aa-8f1f-4693-b7c6-586d165d040c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:33:fd:72:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:33:fd:72:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:b4:5a:02:6b:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 06:58:21.954520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.954518 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 06:58:21.954636 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.954593 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 06:58:21.958155 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.958128 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 06:58:21.958328 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.958158 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 06:58:21.959048 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.959036 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 06:58:21.959111 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.959053 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 06:58:21.959111 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.959063 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 06:58:21.959899 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.959887 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 06:58:21.961132 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.961120 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 06:58:21.965549 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965534 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 09 06:58:21.965688 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965677 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 06:58:21.965762 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965732 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 09 06:58:21.965762 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965747 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 06:58:21.965762 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965761 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 06:58:21.965888 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965774 2563 kubelet.go:398] "Adding apiserver pod source" Jun 09 06:58:21.965888 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.965787 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 06:58:21.966157 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.966143 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 06:58:21.966217 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.966167 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 06:58:21.968588 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.968573 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 06:58:21.970939 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.970922 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 06:58:21.971030 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.970961 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 06:58:21.972305 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972291 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972310 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972319 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972327 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972345 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972355 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972367 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 06:58:21.972374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972376 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 06:58:21.972598 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972385 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 06:58:21.972598 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972395 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 06:58:21.972598 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972410 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 06:58:21.972598 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.972418 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 06:58:21.973323 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.973312 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 06:58:21.973374 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.973327 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 06:58:21.976492 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.976477 2563 server.go:1268] "Started kubelet" Jun 09 06:58:21.976600 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.976573 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 06:58:21.976814 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.976750 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 06:58:21.976930 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.976917 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 06:58:21.977294 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.977242 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 06:58:21.977426 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.977317 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 06:58:21.977426 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.977321 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 06:58:21.977425 ip-10-0-134-45 systemd[1]: Started Kubernetes Kubelet. Jun 09 06:58:21.979053 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.979025 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 06:58:21.983283 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.983271 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 09 06:58:21.984607 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.984587 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 06:58:21.986311 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.985245 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-45.ec2.internal.18b7576cb06ebd25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-45.ec2.internal,UID:ip-10-0-134-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-45.ec2.internal,},FirstTimestamp:2026-06-09 06:58:21.976452389 +0000 UTC m=+0.360721338,LastTimestamp:2026-06-09 06:58:21.976452389 +0000 UTC m=+0.360721338,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-45.ec2.internal,}" Jun 09 06:58:21.986396 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.986320 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 06:58:21.986396 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.986337 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 06:58:21.986507 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.986394 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:21.987003 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.986987 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 06:58:21.987101 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987090 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 06:58:21.987182 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987153 2563 factory.go:55] Registering systemd factory Jun 09 06:58:21.987234 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987195 2563 factory.go:223] Registration of the systemd container factory successfully Jun 09 06:58:21.987279 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.986997 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 06:58:21.987577 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987561 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 09 06:58:21.987577 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987578 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 09 06:58:21.987884 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987862 2563 factory.go:153] Registering CRI-O factory Jun 09 06:58:21.987987 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.987977 2563 factory.go:223] Registration of the crio container factory successfully Jun 09 06:58:21.990661 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.988222 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 06:58:21.990661 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.988252 2563 factory.go:103] Registering Raw factory Jun 09 06:58:21.990661 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.988270 2563 manager.go:1196] Started watching for new ooms in manager Jun 09 06:58:21.990661 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.988797 2563 manager.go:349] Starting recovery of all containers Jun 09 06:58:21.990661 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.990268 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 06:58:21.990661 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:21.990355 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 06:58:21.991372 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:21.991347 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ch68r" Jun 09 06:58:22.000915 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.000115 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ch68r" Jun 09 06:58:22.001847 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.001829 2563 manager.go:354] Recovery completed Jun 09 06:58:22.006134 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.006120 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.008033 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008014 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.008078 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008051 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.008078 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008063 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.008582 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008569 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.008638 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008570 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 06:58:22.008638 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008626 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 06:58:22.008747 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.008645 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 09 06:58:22.009257 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.009244 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.009320 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.009275 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.009320 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.009289 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.010122 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.010051 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-45.ec2.internal.18b7576cb250a6db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-45.ec2.internal,UID:ip-10-0-134-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-45.ec2.internal,},FirstTimestamp:2026-06-09 06:58:22.008035035 +0000 UTC m=+0.392303985,LastTimestamp:2026-06-09 06:58:22.008035035 +0000 UTC m=+0.392303985,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-45.ec2.internal,}" Jun 09 06:58:22.010656 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.010644 2563 policy_none.go:49] "None policy: Start" Jun 09 06:58:22.010776 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.010660 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 06:58:22.010776 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.010671 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 06:58:22.012394 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.012383 2563 policy_none.go:47] "Start" Jun 09 06:58:22.057965 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.057949 2563 manager.go:337] "Starting Device Plugin manager" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.057997 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.058011 2563 server.go:87] "Starting device plugin registration server" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.058342 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.058355 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.058446 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.058529 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.058538 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.059029 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.059073 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.074299 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.075602 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.075635 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.075659 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.075698 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 06:58:22.080946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.078505 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:22.158604 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.158508 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.159680 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.159661 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.159805 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.159694 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.159805 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.159706 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.159805 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.159745 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.167332 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.167310 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.167332 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.167335 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-45.ec2.internal\": node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.176320 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.176297 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal"] Jun 09 06:58:22.176742 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.176730 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.177573 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.177556 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.177650 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.177585 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.177650 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.177600 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.180155 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180143 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.180274 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.180312 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180289 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.180947 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180927 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.181040 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180957 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.181040 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180968 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.181040 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.180936 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.181040 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.181026 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.181040 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.181036 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.183172 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.183156 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.183257 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.183189 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 06:58:22.183955 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.183935 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jun 09 06:58:22.184028 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.183975 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 06:58:22.184028 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.183993 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jun 09 06:58:22.188533 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.188512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8883f25242e089c09ba0f5743a85bd37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"8883f25242e089c09ba0f5743a85bd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.188595 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.188547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8883f25242e089c09ba0f5743a85bd37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"8883f25242e089c09ba0f5743a85bd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.188595 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.188574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00011cc3b51a86ab1006de7b79c39c2b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.ec2.internal\" (UID: \"00011cc3b51a86ab1006de7b79c39c2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.198332 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.198307 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-45.ec2.internal\" not found" node="ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.201828 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.201814 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.202235 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.202221 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-45.ec2.internal\" not found" node="ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.288700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.288663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00011cc3b51a86ab1006de7b79c39c2b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.ec2.internal\" (UID: \"00011cc3b51a86ab1006de7b79c39c2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.288700 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.288697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8883f25242e089c09ba0f5743a85bd37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"8883f25242e089c09ba0f5743a85bd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.288914 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.288712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8883f25242e089c09ba0f5743a85bd37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"8883f25242e089c09ba0f5743a85bd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.288914 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.288777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8883f25242e089c09ba0f5743a85bd37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"8883f25242e089c09ba0f5743a85bd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.288914 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.288794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00011cc3b51a86ab1006de7b79c39c2b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.ec2.internal\" (UID: \"00011cc3b51a86ab1006de7b79c39c2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.288914 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.288794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8883f25242e089c09ba0f5743a85bd37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"8883f25242e089c09ba0f5743a85bd37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.302316 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.302285 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.403059 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.403028 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.503801 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.503745 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.504838 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.504826 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.509421 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.509404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jun 09 06:58:22.604328 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.604284 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.704770 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.704742 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.805415 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.805340 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.830584 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.830561 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:22.906393 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:22.906363 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:22.914541 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.914514 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 06:58:22.914694 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.914676 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 06:58:22.914752 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:22.914689 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 06:58:23.003952 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.003913 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 06:53:21 +0000 UTC" deadline="2028-01-01 23:25:38.254693825 +0000 UTC" Jun 09 06:58:23.003952 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.003946 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13720h27m15.25075087s" Jun 09 06:58:23.007104 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.007083 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:23.041884 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.041856 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:23.101603 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:23.101573 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00011cc3b51a86ab1006de7b79c39c2b.slice/crio-0b47718e776b4d639d1d7b22b9dd716283b9cdb6b97e8a7024210cfaa197b11e WatchSource:0}: Error finding container 0b47718e776b4d639d1d7b22b9dd716283b9cdb6b97e8a7024210cfaa197b11e: Status 404 returned error can't find the container with id 0b47718e776b4d639d1d7b22b9dd716283b9cdb6b97e8a7024210cfaa197b11e Jun 09 06:58:23.101880 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:23.101852 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8883f25242e089c09ba0f5743a85bd37.slice/crio-0cfe25dfc48e4eb8f1af20eaa66713147869c162c474914bbc447ea83d5aecae WatchSource:0}: Error finding container 0cfe25dfc48e4eb8f1af20eaa66713147869c162c474914bbc447ea83d5aecae: Status 404 returned error can't find the container with id 0cfe25dfc48e4eb8f1af20eaa66713147869c162c474914bbc447ea83d5aecae Jun 09 06:58:23.106881 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.106863 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 06:58:23.107149 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.107127 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:23.208170 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.208126 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:23.308625 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.308592 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:23.409200 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.409124 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:23.510025 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.509989 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jun 09 06:58:23.532783 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.532745 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:23.586678 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.586645 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jun 09 06:58:23.596876 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.596836 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 06:58:23.598151 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.597922 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jun 09 06:58:23.609039 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.609014 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 06:58:23.967433 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.967398 2563 apiserver.go:52] "Watching apiserver" Jun 09 06:58:23.974042 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.974016 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 06:58:23.974809 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.974431 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8954n","openshift-ovn-kubernetes/ovnkube-node-4tb7h","kube-system/global-pull-secret-syncer-wxd7l","kube-system/konnectivity-agent-mwhnp","kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88","openshift-dns/node-resolver-v5p52","openshift-image-registry/node-ca-vzv49","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal","openshift-multus/multus-lncfj","openshift-cluster-node-tuning-operator/tuned-strxk","openshift-multus/multus-additional-cni-plugins-dckzw","openshift-multus/network-metrics-daemon-r4btx","openshift-network-diagnostics/network-check-target-hxkhj"] Jun 09 06:58:23.977345 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.977319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:23.979346 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.979321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.980271 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.979938 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 06:58:23.980271 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.979972 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nkt77\"" Jun 09 06:58:23.980271 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.979942 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 06:58:23.981344 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.981323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:23.981444 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.981418 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:23.981781 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.981763 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 06:58:23.981981 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.981968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 06:58:23.982031 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.981978 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7mcs2\"" Jun 09 06:58:23.983481 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.983444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:23.985385 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.985365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:23.985481 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.985431 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:23.985655 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.985537 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 06:58:23.985709 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.985660 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 06:58:23.987385 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.987367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-75dmz\"" Jun 09 06:58:23.987685 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.987668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:23.987791 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.987771 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 06:58:23.994033 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.994011 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pm765\"" Jun 09 06:58:23.994276 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.994261 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 06:58:23.994520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.994504 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 06:58:23.995012 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.994995 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 06:58:23.995839 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.995823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:23.996094 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.996079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:23.996164 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:23.996146 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:23.997254 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.996905 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:23.999516 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lncfj" Jun 09 06:58:23.999618 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-kubernetes\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999618 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysctl-d\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999618 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-tuned\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999618 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k28r\" (UniqueName: \"kubernetes.io/projected/ac5a6d87-660d-445c-b6fb-2b4726a959f4-kube-api-access-7k28r\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999618 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999663 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfwj\" (UniqueName: \"kubernetes.io/projected/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-kube-api-access-vcfwj\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-modprobe-d\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysconfig\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-run\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/362d65c3-ab95-4530-92d4-28fba22aef1c-kubelet-config\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999844 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-systemd\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-lib-modules\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:23.999898 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57ea668c-83f5-4ed4-9d0a-6120fc7e1e62-konnectivity-ca\") pod \"konnectivity-agent-mwhnp\" (UID: \"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62\") " pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-device-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e09c4a7b-65be-42fc-b5e1-0694b9348176-hosts-file\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:23.999983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-host\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/362d65c3-ab95-4530-92d4-28fba22aef1c-dbus\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kbqc\" (UniqueName: \"kubernetes.io/projected/e09c4a7b-65be-42fc-b5e1-0694b9348176-kube-api-access-8kbqc\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysctl-conf\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-var-lib-kubelet\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000194 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-sys\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09c4a7b-65be-42fc-b5e1-0694b9348176-tmp-dir\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac5a6d87-660d-445c-b6fb-2b4726a959f4-tmp\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.000520 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.000300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57ea668c-83f5-4ed4-9d0a-6120fc7e1e62-agent-certs\") pod \"konnectivity-agent-mwhnp\" (UID: \"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62\") " pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.001246 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001154 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 06:58:24.001246 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001183 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 06:58:24.001403 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001384 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2x7k\"" Jun 09 06:58:24.001464 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001404 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 06:58:24.001566 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001546 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 06:58:24.001638 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001619 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 06:58:24.001767 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001752 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 06:58:24.001860 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001841 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 06:58:24.001914 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.001899 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 06:58:24.002073 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.002046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.002228 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.002189 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 06:58:24.002339 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.002156 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 06:58:24.002533 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.002073 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-997dr\"" Jun 09 06:58:24.003086 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.003055 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 06:58:24.003277 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.003258 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 06:58:24.003356 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.003332 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 06:58:24.003644 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.003624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zxgzj\"" Jun 09 06:58:24.004874 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.003852 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 06:58:24.004874 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.003933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.004874 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.004571 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 06:58:24.004874 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.004657 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 06:58:24.004874 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.004751 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 06:58:24.004874 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.004791 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nzcxb\"" Jun 09 06:58:24.006017 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.005998 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wx6gg\"" Jun 09 06:58:24.006102 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.006043 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 06:58:24.006522 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.006293 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 06:58:24.018018 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.017999 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfw8j" Jun 09 06:58:24.024125 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.024099 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfw8j" Jun 09 06:58:24.080218 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.080169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"8883f25242e089c09ba0f5743a85bd37","Type":"ContainerStarted","Data":"0cfe25dfc48e4eb8f1af20eaa66713147869c162c474914bbc447ea83d5aecae"} Jun 09 06:58:24.081252 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.081229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" event={"ID":"00011cc3b51a86ab1006de7b79c39c2b","Type":"ContainerStarted","Data":"0b47718e776b4d639d1d7b22b9dd716283b9cdb6b97e8a7024210cfaa197b11e"} Jun 09 06:58:24.087966 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.087949 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 06:58:24.101088 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-systemd\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.101201 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101101 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-device-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.101201 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/033444c8-65cb-4554-bfe9-a63c1f798ae4-host-slash\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.101201 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-kubelet\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.101201 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-system-cni-dir\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwb55\" (UniqueName: \"kubernetes.io/projected/c9303e23-a282-45e9-b9a9-b1a5192d9077-kube-api-access-lwb55\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-device-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-systemd\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-cni-bin\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/362d65c3-ab95-4530-92d4-28fba22aef1c-dbus\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-k8s-cni-cncf-io\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-var-lib-kubelet\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04941328-3a49-46ee-9ef6-d0845e2e2e2b-serviceca\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4w7b\" (UniqueName: \"kubernetes.io/projected/a7b5b010-2f48-4d7f-8975-6812c6a01527-kube-api-access-x4w7b\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2rtq\" (UniqueName: \"kubernetes.io/projected/8d709ef3-34af-4568-98d4-6d3c78c54a80-kube-api-access-d2rtq\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.101407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-sys\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09c4a7b-65be-42fc-b5e1-0694b9348176-tmp-dir\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/362d65c3-ab95-4530-92d4-28fba22aef1c-dbus\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-run-netns\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-cni-multus\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-multus-certs\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-etc-kubernetes\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101490 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-var-lib-kubelet\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac5a6d87-660d-445c-b6fb-2b4726a959f4-tmp\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-system-cni-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-socket-dir-parent\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-kubernetes\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101592 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-sys\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101597 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k28r\" (UniqueName: \"kubernetes.io/projected/ac5a6d87-660d-445c-b6fb-2b4726a959f4-kube-api-access-7k28r\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-os-release\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.102082 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovnkube-config\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-cnibin\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-conf-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-slash\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-modprobe-d\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysconfig\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/362d65c3-ab95-4530-92d4-28fba22aef1c-kubelet-config\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-hostroot\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101813 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04941328-3a49-46ee-9ef6-d0845e2e2e2b-host\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rzp\" (UniqueName: \"kubernetes.io/projected/04941328-3a49-46ee-9ef6-d0845e2e2e2b-kube-api-access-j9rzp\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09c4a7b-65be-42fc-b5e1-0694b9348176-tmp-dir\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-lib-modules\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57ea668c-83f5-4ed4-9d0a-6120fc7e1e62-konnectivity-ca\") pod \"konnectivity-agent-mwhnp\" (UID: \"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62\") " pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.101944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.103084 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e09c4a7b-65be-42fc-b5e1-0694b9348176-hosts-file\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-cnibin\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-cni-binary-copy\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-systemd\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-ovn\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-cni-bin\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102220 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-cni-netd\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovnkube-script-lib\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-host\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kbqc\" (UniqueName: \"kubernetes.io/projected/e09c4a7b-65be-42fc-b5e1-0694b9348176-kube-api-access-8kbqc\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d709ef3-34af-4568-98d4-6d3c78c54a80-cni-binary-copy\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysctl-conf\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-kubelet\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.103923 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-kubernetes\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-run-ovn-kubernetes\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-cni-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.102639 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.102713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:24.60268198 +0000 UTC m=+2.986950916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-daemon-config\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102766 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-modprobe-d\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5g46\" (UniqueName: \"kubernetes.io/projected/a7882294-ab8a-44f8-9275-e2b7a5204700-kube-api-access-m5g46\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysconfig\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-log-socket\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/362d65c3-ab95-4530-92d4-28fba22aef1c-kubelet-config\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovn-node-metrics-cert\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-os-release\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57ea668c-83f5-4ed4-9d0a-6120fc7e1e62-agent-certs\") pod \"konnectivity-agent-mwhnp\" (UID: \"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62\") " pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-node-log\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysctl-d\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.104641 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-tuned\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.102970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfwj\" (UniqueName: \"kubernetes.io/projected/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-kube-api-access-vcfwj\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-systemd-units\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-var-lib-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-run\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/033444c8-65cb-4554-bfe9-a63c1f798ae4-iptables-alerter-script\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rf8l\" (UniqueName: \"kubernetes.io/projected/033444c8-65cb-4554-bfe9-a63c1f798ae4-kube-api-access-5rf8l\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-env-overrides\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-netns\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-etc-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103356 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e09c4a7b-65be-42fc-b5e1-0694b9348176-hosts-file\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.105407 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-host\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.103529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-lib-modules\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.104069 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysctl-conf\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.104122 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-run\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.104217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/57ea668c-83f5-4ed4-9d0a-6120fc7e1e62-konnectivity-ca\") pod \"konnectivity-agent-mwhnp\" (UID: \"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62\") " pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.104345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-sysctl-d\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.106144 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.106028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac5a6d87-660d-445c-b6fb-2b4726a959f4-tmp\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.106851 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.106829 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/57ea668c-83f5-4ed4-9d0a-6120fc7e1e62-agent-certs\") pod \"konnectivity-agent-mwhnp\" (UID: \"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62\") " pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.107977 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.107955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac5a6d87-660d-445c-b6fb-2b4726a959f4-etc-tuned\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.114517 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.114474 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:24.114517 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.114494 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:24.114517 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.114505 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:24.114745 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.114583 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:24.61455897 +0000 UTC m=+2.998827905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:24.116805 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.116781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k28r\" (UniqueName: \"kubernetes.io/projected/ac5a6d87-660d-445c-b6fb-2b4726a959f4-kube-api-access-7k28r\") pod \"tuned-strxk\" (UID: \"ac5a6d87-660d-445c-b6fb-2b4726a959f4\") " pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.117232 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.117204 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kbqc\" (UniqueName: \"kubernetes.io/projected/e09c4a7b-65be-42fc-b5e1-0694b9348176-kube-api-access-8kbqc\") pod \"node-resolver-v5p52\" (UID: \"e09c4a7b-65be-42fc-b5e1-0694b9348176\") " pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.117679 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.117654 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfwj\" (UniqueName: \"kubernetes.io/projected/1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7-kube-api-access-vcfwj\") pod \"aws-ebs-csi-driver-node-nqv88\" (UID: \"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.203820 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.203743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04941328-3a49-46ee-9ef6-d0845e2e2e2b-serviceca\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.203820 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.203780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4w7b\" (UniqueName: \"kubernetes.io/projected/a7b5b010-2f48-4d7f-8975-6812c6a01527-kube-api-access-x4w7b\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.203820 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.203798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2rtq\" (UniqueName: \"kubernetes.io/projected/8d709ef3-34af-4568-98d4-6d3c78c54a80-kube-api-access-d2rtq\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.203913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-run-netns\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.203955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-cni-multus\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.203978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-multus-certs\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-etc-kubernetes\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-system-cni-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-cni-multus\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204077 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-socket-dir-parent\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-etc-kubernetes\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-os-release\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-socket-dir-parent\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204001 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-run-netns\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-multus-certs\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovnkube-config\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-cnibin\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-system-cni-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-os-release\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-conf-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-slash\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-cnibin\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-hostroot\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-conf-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04941328-3a49-46ee-9ef6-d0845e2e2e2b-host\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04941328-3a49-46ee-9ef6-d0845e2e2e2b-serviceca\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rzp\" (UniqueName: \"kubernetes.io/projected/04941328-3a49-46ee-9ef6-d0845e2e2e2b-kube-api-access-j9rzp\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.204337 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04941328-3a49-46ee-9ef6-d0845e2e2e2b-host\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-hostroot\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-slash\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-cnibin\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-cni-binary-copy\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-systemd\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-ovn\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-cni-bin\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-cni-netd\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-systemd\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovnkube-script-lib\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-cnibin\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.205057 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d709ef3-34af-4568-98d4-6d3c78c54a80-cni-binary-copy\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-kubelet\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-cni-netd\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-run-ovn-kubernetes\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204632 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-run-ovn\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-run-ovn-kubernetes\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-cni-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovnkube-config\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-daemon-config\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5g46\" (UniqueName: \"kubernetes.io/projected/a7882294-ab8a-44f8-9275-e2b7a5204700-kube-api-access-m5g46\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204774 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-log-socket\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovn-node-metrics-cert\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-os-release\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-node-log\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-systemd-units\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.205790 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-var-lib-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204950 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-cni-binary-copy\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/033444c8-65cb-4554-bfe9-a63c1f798ae4-iptables-alerter-script\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.204984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rf8l\" (UniqueName: \"kubernetes.io/projected/033444c8-65cb-4554-bfe9-a63c1f798ae4-kube-api-access-5rf8l\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-env-overrides\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-netns\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-etc-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/033444c8-65cb-4554-bfe9-a63c1f798ae4-host-slash\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-kubelet\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-system-cni-dir\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwb55\" (UniqueName: \"kubernetes.io/projected/c9303e23-a282-45e9-b9a9-b1a5192d9077-kube-api-access-lwb55\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-cni-bin\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-k8s-cni-cncf-io\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-daemon-config\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-k8s-cni-cncf-io\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.206483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205218 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovnkube-script-lib\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-cni-bin\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205277 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-multus-cni-dir\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205303 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/033444c8-65cb-4554-bfe9-a63c1f798ae4-host-slash\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-kubelet\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9303e23-a282-45e9-b9a9-b1a5192d9077-system-cni-dir\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/033444c8-65cb-4554-bfe9-a63c1f798ae4-iptables-alerter-script\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-var-lib-cni-bin\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205640 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-log-socket\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7b5b010-2f48-4d7f-8975-6812c6a01527-env-overrides\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-host-run-netns\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d709ef3-34af-4568-98d4-6d3c78c54a80-cni-binary-copy\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-host-kubelet\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205770 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-etc-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-systemd-units\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-var-lib-openvswitch\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d709ef3-34af-4568-98d4-6d3c78c54a80-os-release\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.207110 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.205915 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:24.207766 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.205957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9303e23-a282-45e9-b9a9-b1a5192d9077-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.207766 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.205981 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:24.705960968 +0000 UTC m=+3.090229922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:24.207766 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.206052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7b5b010-2f48-4d7f-8975-6812c6a01527-node-log\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.209169 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.209134 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7b5b010-2f48-4d7f-8975-6812c6a01527-ovn-node-metrics-cert\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.214468 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.214424 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2rtq\" (UniqueName: \"kubernetes.io/projected/8d709ef3-34af-4568-98d4-6d3c78c54a80-kube-api-access-d2rtq\") pod \"multus-lncfj\" (UID: \"8d709ef3-34af-4568-98d4-6d3c78c54a80\") " pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.214977 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.214950 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwb55\" (UniqueName: \"kubernetes.io/projected/c9303e23-a282-45e9-b9a9-b1a5192d9077-kube-api-access-lwb55\") pod \"multus-additional-cni-plugins-dckzw\" (UID: \"c9303e23-a282-45e9-b9a9-b1a5192d9077\") " pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.215063 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.214958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4w7b\" (UniqueName: \"kubernetes.io/projected/a7b5b010-2f48-4d7f-8975-6812c6a01527-kube-api-access-x4w7b\") pod \"ovnkube-node-4tb7h\" (UID: \"a7b5b010-2f48-4d7f-8975-6812c6a01527\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.215377 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.215345 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rf8l\" (UniqueName: \"kubernetes.io/projected/033444c8-65cb-4554-bfe9-a63c1f798ae4-kube-api-access-5rf8l\") pod \"iptables-alerter-8954n\" (UID: \"033444c8-65cb-4554-bfe9-a63c1f798ae4\") " pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.215755 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.215714 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5g46\" (UniqueName: \"kubernetes.io/projected/a7882294-ab8a-44f8-9275-e2b7a5204700-kube-api-access-m5g46\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:24.216900 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.216882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rzp\" (UniqueName: \"kubernetes.io/projected/04941328-3a49-46ee-9ef6-d0845e2e2e2b-kube-api-access-j9rzp\") pod \"node-ca-vzv49\" (UID: \"04941328-3a49-46ee-9ef6-d0845e2e2e2b\") " pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.290303 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.290265 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5p52" Jun 09 06:58:24.305006 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.304983 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-strxk" Jun 09 06:58:24.313823 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.313802 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:24.320480 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.320458 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" Jun 09 06:58:24.327451 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.327432 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vzv49" Jun 09 06:58:24.335036 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.335013 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:24.342583 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.342559 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lncfj" Jun 09 06:58:24.349168 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.349148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8954n" Jun 09 06:58:24.354638 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.354619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dckzw" Jun 09 06:58:24.382420 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.382384 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:24.607618 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.607547 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:24.607768 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.607695 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:24.607811 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.607784 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:25.607765135 +0000 UTC m=+3.992034085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:24.708490 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.708455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:24.708490 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:24.708494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:24.708764 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.708606 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:24.708764 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.708628 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:24.708764 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.708648 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:24.708764 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.708658 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:24.708764 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.708660 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:25.708646282 +0000 UTC m=+4.092915222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:24.708764 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:24.708701 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:25.708689096 +0000 UTC m=+4.092958032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:24.972832 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:24.972801 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033444c8_65cb_4554_bfe9_a63c1f798ae4.slice/crio-eae8f1e87bc0c31aea012f6b0393b041e60d94d229146c851aab86045cf49215 WatchSource:0}: Error finding container eae8f1e87bc0c31aea012f6b0393b041e60d94d229146c851aab86045cf49215: Status 404 returned error can't find the container with id eae8f1e87bc0c31aea012f6b0393b041e60d94d229146c851aab86045cf49215 Jun 09 06:58:24.974956 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:24.974798 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af25c78_8afd_4a19_9fba_1a4f7e0c3ba7.slice/crio-c86d4914c43696ca870eae784e1a2dcd17937ccad52959882430f962c57cf85e WatchSource:0}: Error finding container c86d4914c43696ca870eae784e1a2dcd17937ccad52959882430f962c57cf85e: Status 404 returned error can't find the container with id c86d4914c43696ca870eae784e1a2dcd17937ccad52959882430f962c57cf85e Jun 09 06:58:24.975635 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:24.975571 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b5b010_2f48_4d7f_8975_6812c6a01527.slice/crio-cdde546825147d6e3371ed8f4c198cf9c5a1a53f7bba43c34d92314da7a083ab WatchSource:0}: Error finding container cdde546825147d6e3371ed8f4c198cf9c5a1a53f7bba43c34d92314da7a083ab: Status 404 returned error can't find the container with id cdde546825147d6e3371ed8f4c198cf9c5a1a53f7bba43c34d92314da7a083ab Jun 09 06:58:24.979448 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:24.979426 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ea668c_83f5_4ed4_9d0a_6120fc7e1e62.slice/crio-2113f1db5756c194f3ebb43e895932d432aa4f54749ea323ad03f16d93afb7fc WatchSource:0}: Error finding container 2113f1db5756c194f3ebb43e895932d432aa4f54749ea323ad03f16d93afb7fc: Status 404 returned error can't find the container with id 2113f1db5756c194f3ebb43e895932d432aa4f54749ea323ad03f16d93afb7fc Jun 09 06:58:24.980337 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:24.980316 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09c4a7b_65be_42fc_b5e1_0694b9348176.slice/crio-77190cfb39a9d7eb616b928dfc4af71f26d0b9adc4a02ebb4553815bccd74e9f WatchSource:0}: Error finding container 77190cfb39a9d7eb616b928dfc4af71f26d0b9adc4a02ebb4553815bccd74e9f: Status 404 returned error can't find the container with id 77190cfb39a9d7eb616b928dfc4af71f26d0b9adc4a02ebb4553815bccd74e9f Jun 09 06:58:24.982870 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:24.982848 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9303e23_a282_45e9_b9a9_b1a5192d9077.slice/crio-cb8225ac1f6c37bfd58d3277a1076e519f29aa8f7d34b2726ca8f8e2bba76cf1 WatchSource:0}: Error finding container cb8225ac1f6c37bfd58d3277a1076e519f29aa8f7d34b2726ca8f8e2bba76cf1: Status 404 returned error can't find the container with id cb8225ac1f6c37bfd58d3277a1076e519f29aa8f7d34b2726ca8f8e2bba76cf1 Jun 09 06:58:25.004914 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:25.004889 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04941328_3a49_46ee_9ef6_d0845e2e2e2b.slice/crio-c7997e98277fb7817751784765f271cac22070761f6d96c646ff81aa79896a47 WatchSource:0}: Error finding container c7997e98277fb7817751784765f271cac22070761f6d96c646ff81aa79896a47: Status 404 returned error can't find the container with id c7997e98277fb7817751784765f271cac22070761f6d96c646ff81aa79896a47 Jun 09 06:58:25.005559 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:25.005524 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d709ef3_34af_4568_98d4_6d3c78c54a80.slice/crio-6e1e26d4c0836c3dfb1012528dc976d57c9243bf21b2e408dd41e8b8fc0cb92c WatchSource:0}: Error finding container 6e1e26d4c0836c3dfb1012528dc976d57c9243bf21b2e408dd41e8b8fc0cb92c: Status 404 returned error can't find the container with id 6e1e26d4c0836c3dfb1012528dc976d57c9243bf21b2e408dd41e8b8fc0cb92c Jun 09 06:58:25.006260 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:25.006239 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5a6d87_660d_445c_b6fb_2b4726a959f4.slice/crio-45501c43b0f4ef83217b46fdf5d5dad04cdddaada4692a7bcb07de0fc00369d2 WatchSource:0}: Error finding container 45501c43b0f4ef83217b46fdf5d5dad04cdddaada4692a7bcb07de0fc00369d2: Status 404 returned error can't find the container with id 45501c43b0f4ef83217b46fdf5d5dad04cdddaada4692a7bcb07de0fc00369d2 Jun 09 06:58:25.027587 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.027359 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 06:53:24 +0000 UTC" deadline="2028-02-03 09:24:09.405599458 +0000 UTC" Jun 09 06:58:25.027666 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.027591 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14498h25m44.37801379s" Jun 09 06:58:25.076543 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.076518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:25.076696 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.076671 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:25.083949 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.083927 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-strxk" event={"ID":"ac5a6d87-660d-445c-b6fb-2b4726a959f4","Type":"ContainerStarted","Data":"45501c43b0f4ef83217b46fdf5d5dad04cdddaada4692a7bcb07de0fc00369d2"} Jun 09 06:58:25.085011 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.084989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vzv49" event={"ID":"04941328-3a49-46ee-9ef6-d0845e2e2e2b","Type":"ContainerStarted","Data":"c7997e98277fb7817751784765f271cac22070761f6d96c646ff81aa79896a47"} Jun 09 06:58:25.086080 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.086057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerStarted","Data":"cb8225ac1f6c37bfd58d3277a1076e519f29aa8f7d34b2726ca8f8e2bba76cf1"} Jun 09 06:58:25.087121 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.087090 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5p52" event={"ID":"e09c4a7b-65be-42fc-b5e1-0694b9348176","Type":"ContainerStarted","Data":"77190cfb39a9d7eb616b928dfc4af71f26d0b9adc4a02ebb4553815bccd74e9f"} Jun 09 06:58:25.088238 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.088213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwhnp" event={"ID":"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62","Type":"ContainerStarted","Data":"2113f1db5756c194f3ebb43e895932d432aa4f54749ea323ad03f16d93afb7fc"} Jun 09 06:58:25.089308 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.089277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" event={"ID":"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7","Type":"ContainerStarted","Data":"c86d4914c43696ca870eae784e1a2dcd17937ccad52959882430f962c57cf85e"} Jun 09 06:58:25.090483 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.090464 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8954n" event={"ID":"033444c8-65cb-4554-bfe9-a63c1f798ae4","Type":"ContainerStarted","Data":"eae8f1e87bc0c31aea012f6b0393b041e60d94d229146c851aab86045cf49215"} Jun 09 06:58:25.093400 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.093382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lncfj" event={"ID":"8d709ef3-34af-4568-98d4-6d3c78c54a80","Type":"ContainerStarted","Data":"6e1e26d4c0836c3dfb1012528dc976d57c9243bf21b2e408dd41e8b8fc0cb92c"} Jun 09 06:58:25.094494 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.094469 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"cdde546825147d6e3371ed8f4c198cf9c5a1a53f7bba43c34d92314da7a083ab"} Jun 09 06:58:25.108465 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.108425 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" podStartSLOduration=2.108413263 podStartE2EDuration="2.108413263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:25.108093908 +0000 UTC m=+3.492362867" watchObservedRunningTime="2026-06-09 06:58:25.108413263 +0000 UTC m=+3.492682221" Jun 09 06:58:25.613952 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.613864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:25.614120 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.614072 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:25.614214 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.614136 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:27.614116994 +0000 UTC m=+5.998385935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:25.665525 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.665495 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 06:58:25.714977 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.714941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:25.715151 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:25.714989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:25.715225 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.715164 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:25.715280 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.715225 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:27.71520723 +0000 UTC m=+6.099476172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:25.715632 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.715613 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:25.715700 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.715638 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:25.715700 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.715651 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:25.715700 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:25.715694 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:27.715679796 +0000 UTC m=+6.099948737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:26.028636 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.028512 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 06:53:24 +0000 UTC" deadline="2028-01-21 20:22:05.033938536 +0000 UTC" Jun 09 06:58:26.028636 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.028553 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14197h23m39.005390542s" Jun 09 06:58:26.079104 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.078438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:26.079104 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:26.078578 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:26.079104 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.078964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:26.079104 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:26.079050 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:26.121529 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.120966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" event={"ID":"00011cc3b51a86ab1006de7b79c39c2b","Type":"ContainerStarted","Data":"bd727f8d83999a24cfcd9e06f3296a5786f0d0abdf9d600b118b619ba8af8b98"} Jun 09 06:58:26.130765 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.130346 2563 generic.go:356] "Generic (PLEG): container finished" podID="8883f25242e089c09ba0f5743a85bd37" containerID="a844619fbbe8008771f705828c88a24e70ccd42c1aa81e795761e7a2b6d80587" exitCode=0 Jun 09 06:58:26.130765 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:26.130395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"8883f25242e089c09ba0f5743a85bd37","Type":"ContainerDied","Data":"a844619fbbe8008771f705828c88a24e70ccd42c1aa81e795761e7a2b6d80587"} Jun 09 06:58:27.076264 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:27.076221 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:27.076803 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.076363 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:27.164458 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:27.164418 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"8883f25242e089c09ba0f5743a85bd37","Type":"ContainerStarted","Data":"74f772deddd9b7cbfd37d3537f3d7d24a436abae9320d63126a84ab29661f7a6"} Jun 09 06:58:27.634611 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:27.634566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:27.634811 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.634710 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:27.634811 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.634778 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:31.634765525 +0000 UTC m=+10.019034465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:27.735548 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:27.735280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:27.735548 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:27.735333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:27.735548 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.735506 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:27.735964 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.735567 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:31.735548658 +0000 UTC m=+10.119817610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:27.736034 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.735990 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:27.736034 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.736011 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:27.736034 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.736024 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:27.736172 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:27.736072 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:31.736055384 +0000 UTC m=+10.120324345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:28.081164 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:28.081090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:28.081575 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:28.081204 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:28.081575 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:28.081568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:28.081678 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:28.081665 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:29.076033 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:29.075998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:29.076211 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:29.076157 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:30.079913 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:30.079879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:30.080307 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:30.080004 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:30.080352 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:30.080323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:30.080430 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:30.080400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:31.076668 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:31.076634 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:31.076886 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.076813 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:31.669455 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:31.669416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:31.669929 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.669596 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:31.669929 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.669656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:39.669637383 +0000 UTC m=+18.053906335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:31.769842 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:31.769806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:31.769982 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:31.769861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:31.770076 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.770058 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:31.770168 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.770124 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:39.770103954 +0000 UTC m=+18.154372915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:31.770663 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.770535 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:31.770663 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.770560 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:31.770663 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.770581 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:31.770663 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:31.770631 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:39.770615922 +0000 UTC m=+18.154884877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:32.078600 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:32.077987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:32.078600 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:32.078112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:32.078600 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:32.078425 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:32.078600 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:32.078509 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:33.076575 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:33.076535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:33.077057 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:33.076681 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:34.076497 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:34.076460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:34.076661 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:34.076460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:34.076661 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:34.076604 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:34.077069 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:34.076691 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:35.077021 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:35.076523 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:35.077021 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:35.076670 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:36.076198 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:36.076159 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:36.076383 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:36.076159 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:36.076383 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:36.076288 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:36.076492 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:36.076387 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:37.076107 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:37.076079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:37.076529 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:37.076206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:38.076126 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:38.076095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:38.076587 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:38.076123 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:38.076587 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:38.076216 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:38.076587 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:38.076355 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:39.075886 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:39.075853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:39.076056 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.075973 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:39.732946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:39.732916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:39.733387 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.733071 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:39.733387 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.733137 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:55.733119682 +0000 UTC m=+34.117388621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:39.834110 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:39.834075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:39.834268 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:39.834118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:39.834268 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.834231 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:39.834268 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.834255 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:39.834436 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.834284 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:39.834436 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.834294 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:55.834275945 +0000 UTC m=+34.218544897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:39.834436 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.834296 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:39.834436 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:39.834344 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:58:55.834328624 +0000 UTC m=+34.218597563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:40.076731 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:40.076635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:40.076875 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:40.076642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:40.076875 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:40.076788 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:40.076875 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:40.076833 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:41.076481 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:41.076447 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:41.076992 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:41.076594 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:42.077831 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:42.077796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:42.078273 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:42.077928 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:42.079388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:42.079241 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:42.079388 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:42.079347 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:43.076284 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:43.076248 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:43.076461 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:43.076378 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:44.076889 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.076016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:44.076889 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:44.076321 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:44.076889 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.076540 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:44.076889 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:44.076657 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:44.200414 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.200382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"5e7ad8f69cc3152a8ec78b3e5eebe467a7817d5ac5759472894799d108512655"} Jun 09 06:58:44.200549 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.200457 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"60fc3986cab5ef981ae640ce5b915658cbd3ce5559131e9361c2fcb03c6c52f1"} Jun 09 06:58:44.203749 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.203705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-strxk" event={"ID":"ac5a6d87-660d-445c-b6fb-2b4726a959f4","Type":"ContainerStarted","Data":"8882cedd35472c11127970bcb7964a8e09f8c2042a16235a27f2653f6f27aa83"} Jun 09 06:58:44.205380 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.205354 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vzv49" event={"ID":"04941328-3a49-46ee-9ef6-d0845e2e2e2b","Type":"ContainerStarted","Data":"7ff38778dc2efc9a656abab476408d4e39b2c818d4010fddd15d3c1e5dbb5e44"} Jun 09 06:58:44.208541 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.208071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerStarted","Data":"f89c0c7c2e6eafffd5fa9cb0760f1802b58a56481b80b45742e62da2c67bdfc3"} Jun 09 06:58:44.210385 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.210212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5p52" event={"ID":"e09c4a7b-65be-42fc-b5e1-0694b9348176","Type":"ContainerStarted","Data":"c43e6f6295f5ad5da7c629f35202df45d90efd1a39815c5dc92b4a3f52b0d901"} Jun 09 06:58:44.211794 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.211772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwhnp" event={"ID":"57ea668c-83f5-4ed4-9d0a-6120fc7e1e62","Type":"ContainerStarted","Data":"1b011fdc95546a03d16369bc73535bd44db92e60161aad6c6858df1b03853e5f"} Jun 09 06:58:44.213245 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.213224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" event={"ID":"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7","Type":"ContainerStarted","Data":"2966338f13c7cb3f05f7127f3756a9e0d8d453c4d6bee6f3213eb4986fb6e0bb"} Jun 09 06:58:44.214545 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.214524 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lncfj" event={"ID":"8d709ef3-34af-4568-98d4-6d3c78c54a80","Type":"ContainerStarted","Data":"0c11992e1e31462ad1b405688374445d47e3ec58e228f158966001aeeafd0476"} Jun 09 06:58:44.222502 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.222461 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" podStartSLOduration=21.222447105 podStartE2EDuration="21.222447105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:27.181899222 +0000 UTC m=+5.566168180" watchObservedRunningTime="2026-06-09 06:58:44.222447105 +0000 UTC m=+22.606716069" Jun 09 06:58:44.222617 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.222599 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-strxk" podStartSLOduration=3.386902902 podStartE2EDuration="22.222594358s" totalImagesPullingTime="18.835691456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:44.222005067 +0000 UTC m=+22.606274028" watchObservedRunningTime="2026-06-09 06:58:44.222594358 +0000 UTC m=+22.606863316" Jun 09 06:58:44.268522 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.268475 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vzv49" podStartSLOduration=3.449575676 podStartE2EDuration="22.268458713s" totalImagesPullingTime="18.818883037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:44.268031189 +0000 UTC m=+22.652300148" watchObservedRunningTime="2026-06-09 06:58:44.268458713 +0000 UTC m=+22.652727671" Jun 09 06:58:44.287120 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.287078 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5p52" podStartSLOduration=3.4414121939999998 podStartE2EDuration="22.287063378s" totalImagesPullingTime="18.845651184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:44.286601138 +0000 UTC m=+22.670870095" watchObservedRunningTime="2026-06-09 06:58:44.287063378 +0000 UTC m=+22.671332336" Jun 09 06:58:44.304479 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.304298 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mwhnp" podStartSLOduration=3.457930993 podStartE2EDuration="22.304276759s" totalImagesPullingTime="18.846345766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:44.304158435 +0000 UTC m=+22.688427396" watchObservedRunningTime="2026-06-09 06:58:44.304276759 +0000 UTC m=+22.688545717" Jun 09 06:58:44.323797 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:44.323757 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lncfj" podStartSLOduration=3.452515283 podStartE2EDuration="22.323744144s" totalImagesPullingTime="18.871228861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:44.323621602 +0000 UTC m=+22.707890561" watchObservedRunningTime="2026-06-09 06:58:44.323744144 +0000 UTC m=+22.708013098" Jun 09 06:58:45.076697 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.076666 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:45.076879 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:45.076799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:45.217626 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.217600 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9303e23-a282-45e9-b9a9-b1a5192d9077" containerID="f89c0c7c2e6eafffd5fa9cb0760f1802b58a56481b80b45742e62da2c67bdfc3" exitCode=0 Jun 09 06:58:45.218139 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.217675 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerDied","Data":"f89c0c7c2e6eafffd5fa9cb0760f1802b58a56481b80b45742e62da2c67bdfc3"} Jun 09 06:58:45.219259 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.219239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8954n" event={"ID":"033444c8-65cb-4554-bfe9-a63c1f798ae4","Type":"ContainerStarted","Data":"8a1019a82ae669b31f722dddafabf4e406562c6809f274fd63bb3ccde66e8afd"} Jun 09 06:58:45.222257 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222238 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 06:58:45.222591 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222574 2563 generic.go:356] "Generic (PLEG): container finished" podID="a7b5b010-2f48-4d7f-8975-6812c6a01527" containerID="5e7ad8f69cc3152a8ec78b3e5eebe467a7817d5ac5759472894799d108512655" exitCode=1 Jun 09 06:58:45.222708 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerDied","Data":"5e7ad8f69cc3152a8ec78b3e5eebe467a7817d5ac5759472894799d108512655"} Jun 09 06:58:45.222804 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"d3bea45746f089a9cb0afe6e1fb1f9d57121190f11f0b17eaac7d61c7b01b8e0"} Jun 09 06:58:45.222804 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222801 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"e4cb2ac139aa011940a841c495b4325788acc68b1dcb09e5698945d8cfd23083"} Jun 09 06:58:45.222908 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"c2874aa333d6c7c535538c9f32dec33b6aab6e580c18b63aae9a94527da69652"} Jun 09 06:58:45.222908 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.222855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"e6c4bbeeafe262753ebb0a721384a55a8240bef3066acb773578976812fd1924"} Jun 09 06:58:45.375026 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.374992 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:45.375488 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.375472 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:45.500124 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:45.500097 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 06:58:46.071788 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.071663 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T06:58:45.500123939Z","UUID":"ec6ca30d-6c38-4b5c-87f8-6cb1c8a673e0","Handler":null,"Name":"","Endpoint":""} Jun 09 06:58:46.073545 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.073524 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 06:58:46.073663 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.073569 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 06:58:46.076222 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.076198 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:46.076327 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.076239 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:46.076384 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:46.076317 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:46.076488 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:46.076455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:46.227893 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.227849 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" event={"ID":"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7","Type":"ContainerStarted","Data":"70a97a59cbf28184c38f2f61c92a31800901a2f9d863b598d1c68078d785cc13"} Jun 09 06:58:46.242856 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.242803 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8954n" podStartSLOduration=5.400143022 podStartE2EDuration="24.242780592s" totalImagesPullingTime="18.84263757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:46.242281021 +0000 UTC m=+24.626549979" watchObservedRunningTime="2026-06-09 06:58:46.242780592 +0000 UTC m=+24.627049552" Jun 09 06:58:46.747996 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.747960 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:46.748553 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:46.748538 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mwhnp" Jun 09 06:58:47.076460 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:47.076431 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:47.076610 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:47.076533 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:47.232385 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:47.232340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" event={"ID":"1af25c78-8afd-4a19-9fba-1a4f7e0c3ba7","Type":"ContainerStarted","Data":"5829bfb901c7028b9a6b15f42beb2259091e6e111de85748ae098422f447b508"} Jun 09 06:58:47.235841 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:47.235819 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 06:58:47.236299 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:47.236272 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"4366c8bd48ad1ddbad0dce6311292ca17e98e09711c9f2da5ead580616eb0dba"} Jun 09 06:58:47.251665 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:47.251625 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nqv88" podStartSLOduration=4.352600931 podStartE2EDuration="25.251613764s" totalImagesPullingTime="20.899012833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:47.251262065 +0000 UTC m=+25.635531025" watchObservedRunningTime="2026-06-09 06:58:47.251613764 +0000 UTC m=+25.635882722" Jun 09 06:58:48.076930 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:48.076768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:48.077092 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:48.076768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:48.077092 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:48.077021 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:48.077092 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:48.077068 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:49.076731 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.076637 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:49.077420 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:49.076792 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:49.243956 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.243927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 06:58:49.244306 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.244281 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"8714745fa0229d8f27ea534b9431bf688ba1cc2a344756f399f2cd2a45a28df6"} Jun 09 06:58:49.244690 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.244572 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:49.244690 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.244638 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:49.244847 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.244767 2563 scope.go:117] "RemoveContainer" containerID="5e7ad8f69cc3152a8ec78b3e5eebe467a7817d5ac5759472894799d108512655" Jun 09 06:58:49.261328 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:49.261293 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:50.076296 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.076056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:50.076449 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.076061 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:50.076449 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:50.076399 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:50.076566 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:50.076480 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:50.976288 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.976261 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxkhj"] Jun 09 06:58:50.976562 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.976355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:50.976562 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:50.976429 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:50.979514 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.979490 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wxd7l"] Jun 09 06:58:50.979614 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.979574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:50.979695 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:50.979667 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:50.980182 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.980161 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r4btx"] Jun 09 06:58:50.980275 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:50.980257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:50.980434 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:50.980358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:51.250546 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.250473 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9303e23-a282-45e9-b9a9-b1a5192d9077" containerID="96417f7ad82b5a70e46de51738702e680c2ae44556cc7fd665c900e427bfad97" exitCode=0 Jun 09 06:58:51.250701 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.250565 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerDied","Data":"96417f7ad82b5a70e46de51738702e680c2ae44556cc7fd665c900e427bfad97"} Jun 09 06:58:51.254365 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.254349 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 06:58:51.254762 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.254734 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" event={"ID":"a7b5b010-2f48-4d7f-8975-6812c6a01527","Type":"ContainerStarted","Data":"17af67465f1e98a58e0114bf5ef333d516091095c6402597c423120b02766dc4"} Jun 09 06:58:51.255092 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.255072 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:51.270739 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.270700 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:58:51.300025 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:51.299991 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" podStartSLOduration=10.35995098 podStartE2EDuration="29.299978993s" totalImagesPullingTime="18.940028013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:58:51.299397284 +0000 UTC m=+29.683666263" watchObservedRunningTime="2026-06-09 06:58:51.299978993 +0000 UTC m=+29.684247951" Jun 09 06:58:52.076750 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:52.076702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:52.077172 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:52.076828 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:53.075912 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:53.075841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:53.076034 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:53.075950 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:53.076034 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:53.076004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:53.076113 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:53.076081 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:53.261848 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:53.261818 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9303e23-a282-45e9-b9a9-b1a5192d9077" containerID="1674dc37323f5403c0101572b785acc5cefcd6c411926bf3b5efb9fea7626c52" exitCode=0 Jun 09 06:58:53.262172 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:53.261896 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerDied","Data":"1674dc37323f5403c0101572b785acc5cefcd6c411926bf3b5efb9fea7626c52"} Jun 09 06:58:53.277840 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:53.277804 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" podUID="a7b5b010-2f48-4d7f-8975-6812c6a01527" containerName="ovnkube-controller" probeResult="failure" output="" Jun 09 06:58:54.076704 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:54.076556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:54.079591 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:54.077094 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:54.266529 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:54.266440 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9303e23-a282-45e9-b9a9-b1a5192d9077" containerID="b87e3bdea86c155fc644566171a96268f2fc9254c749a3356d14d65e489e73e9" exitCode=0 Jun 09 06:58:54.266529 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:54.266486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerDied","Data":"b87e3bdea86c155fc644566171a96268f2fc9254c749a3356d14d65e489e73e9"} Jun 09 06:58:55.076327 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:55.076294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:55.076601 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:55.076304 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:55.076601 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.076417 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hxkhj" podUID="71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7" Jun 09 06:58:55.076601 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.076490 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 06:58:55.759992 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:55.759944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:55.760520 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.760111 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:55.760520 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.760185 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret podName:362d65c3-ab95-4530-92d4-28fba22aef1c nodeName:}" failed. No retries permitted until 2026-06-09 06:59:27.760163561 +0000 UTC m=+66.144432514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret") pod "global-pull-secret-syncer-wxd7l" (UID: "362d65c3-ab95-4530-92d4-28fba22aef1c") : object "kube-system"/"original-pull-secret" not registered Jun 09 06:58:55.861059 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:55.860985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:55.861059 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:55.861020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:55.861232 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.861126 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:55.861232 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.861136 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 06:58:55.861232 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.861155 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 06:58:55.861232 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.861163 2563 projected.go:196] Error preparing data for projected volume kube-api-access-sp89z for pod openshift-network-diagnostics/network-check-target-hxkhj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:55.861232 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.861171 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:27.861157834 +0000 UTC m=+66.245426773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 06:58:55.861232 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:55.861201 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z podName:71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7 nodeName:}" failed. No retries permitted until 2026-06-09 06:59:27.861189626 +0000 UTC m=+66.245458580 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sp89z" (UniqueName: "kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z") pod "network-check-target-hxkhj" (UID: "71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 06:58:56.076654 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.076628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:56.076814 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:56.076735 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wxd7l" podUID="362d65c3-ab95-4530-92d4-28fba22aef1c" Jun 09 06:58:56.955763 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.954296 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeReady" Jun 09 06:58:56.955763 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.954440 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 06:58:56.990397 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.990367 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d5ff57c48-w5zmq"] Jun 09 06:58:56.992691 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.992669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:56.995128 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.995105 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 06:58:56.995128 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.995117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 06:58:56.995128 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.995121 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zjr8h\"" Jun 09 06:58:56.995418 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:56.995245 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 06:58:57.005019 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.004993 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 06:58:57.008095 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.008075 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-46vqx"] Jun 09 06:58:57.010529 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.010509 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-szm5h"] Jun 09 06:58:57.010637 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.010604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.012738 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.012704 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 06:58:57.013109 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.012810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.013109 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.012971 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4jm8\"" Jun 09 06:58:57.013109 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.013015 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 06:58:57.014883 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.014863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d5ff57c48-w5zmq"] Jun 09 06:58:57.015382 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.015359 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 06:58:57.015577 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.015558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 06:58:57.015681 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.015579 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 06:58:57.015681 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.015594 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-895r4\"" Jun 09 06:58:57.025249 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.025223 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46vqx"] Jun 09 06:58:57.031610 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.031591 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-szm5h"] Jun 09 06:58:57.076363 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.076340 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:58:57.076463 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.076374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:58:57.078946 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.078928 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 06:58:57.079038 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.078946 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-775hf\"" Jun 09 06:58:57.079100 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.079043 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 06:58:57.079100 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.079078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 06:58:57.079100 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.079078 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcng\"" Jun 09 06:58:57.173283 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.173379 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173379 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dmj6\" (UniqueName: \"kubernetes.io/projected/4a494ba6-e26a-4dfe-8209-2fd08ec72d2a-kube-api-access-4dmj6\") pod \"ingress-canary-szm5h\" (UID: \"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a\") " pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.173379 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac5e6519-9520-432b-a416-d02051cc940c-tmp-dir\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.173379 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-image-registry-private-configuration\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58725ca1-2060-49e7-a529-6bedcdfbb66f-ca-trust-extracted\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-bound-sa-token\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-trusted-ca\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a494ba6-e26a-4dfe-8209-2fd08ec72d2a-cert\") pod \"ingress-canary-szm5h\" (UID: \"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a\") " pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-certificates\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-588k6\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-kube-api-access-588k6\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173560 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-installation-pull-secrets\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.173856 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5e6519-9520-432b-a416-d02051cc940c-config-volume\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.173856 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.173607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvk6c\" (UniqueName: \"kubernetes.io/projected/ac5e6519-9520-432b-a416-d02051cc940c-kube-api-access-tvk6c\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.274042 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.273978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-trusted-ca\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274042 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a494ba6-e26a-4dfe-8209-2fd08ec72d2a-cert\") pod \"ingress-canary-szm5h\" (UID: \"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a\") " pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.274042 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-certificates\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274283 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-588k6\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-kube-api-access-588k6\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274339 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-installation-pull-secrets\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5e6519-9520-432b-a416-d02051cc940c-config-volume\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvk6c\" (UniqueName: \"kubernetes.io/projected/ac5e6519-9520-432b-a416-d02051cc940c-kube-api-access-tvk6c\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274441 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dmj6\" (UniqueName: \"kubernetes.io/projected/4a494ba6-e26a-4dfe-8209-2fd08ec72d2a-kube-api-access-4dmj6\") pod \"ingress-canary-szm5h\" (UID: \"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a\") " pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac5e6519-9520-432b-a416-d02051cc940c-tmp-dir\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-image-registry-private-configuration\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58725ca1-2060-49e7-a529-6bedcdfbb66f-ca-trust-extracted\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-bound-sa-token\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.274769 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-certificates\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.274795 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.274860 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:57.774841797 +0000 UTC m=+36.159110738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.274994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ac5e6519-9520-432b-a416-d02051cc940c-config-volume\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.275005 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.275022 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.275049 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-trusted-ca\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.275069 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 06:58:57.775055854 +0000 UTC m=+36.159324789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.275125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58725ca1-2060-49e7-a529-6bedcdfbb66f-ca-trust-extracted\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.275280 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.275231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac5e6519-9520-432b-a416-d02051cc940c-tmp-dir\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.278484 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.278462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a494ba6-e26a-4dfe-8209-2fd08ec72d2a-cert\") pod \"ingress-canary-szm5h\" (UID: \"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a\") " pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.278594 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.278517 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-image-registry-private-configuration\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.278594 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.278539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-installation-pull-secrets\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.292848 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.292823 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-588k6\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-kube-api-access-588k6\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.293942 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.293923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-bound-sa-token\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.294142 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.294116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvk6c\" (UniqueName: \"kubernetes.io/projected/ac5e6519-9520-432b-a416-d02051cc940c-kube-api-access-tvk6c\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.294300 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.294279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dmj6\" (UniqueName: \"kubernetes.io/projected/4a494ba6-e26a-4dfe-8209-2fd08ec72d2a-kube-api-access-4dmj6\") pod \"ingress-canary-szm5h\" (UID: \"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a\") " pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.329388 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.329366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-szm5h" Jun 09 06:58:57.458256 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.458222 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-szm5h"] Jun 09 06:58:57.463497 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:58:57.463472 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a494ba6_e26a_4dfe_8209_2fd08ec72d2a.slice/crio-55fb16c781064e7ec235a61f5b0350cfe6b807d3f913363e1b65da1b5a9fa4c4 WatchSource:0}: Error finding container 55fb16c781064e7ec235a61f5b0350cfe6b807d3f913363e1b65da1b5a9fa4c4: Status 404 returned error can't find the container with id 55fb16c781064e7ec235a61f5b0350cfe6b807d3f913363e1b65da1b5a9fa4c4 Jun 09 06:58:57.778065 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.778033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:57.778065 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:57.778068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:57.778305 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.778189 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:58:57.778305 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.778199 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:58:57.778305 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.778202 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:58:57.778305 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.778261 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 06:58:58.778244986 +0000 UTC m=+37.162513932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:58:57.778305 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:57.778274 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 06:58:58.778268752 +0000 UTC m=+37.162537688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:58:58.076378 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:58.076297 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:58:58.079101 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:58.079075 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 06:58:58.279059 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:58.279019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-szm5h" event={"ID":"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a","Type":"ContainerStarted","Data":"55fb16c781064e7ec235a61f5b0350cfe6b807d3f913363e1b65da1b5a9fa4c4"} Jun 09 06:58:58.787098 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:58.787059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:58:58.787098 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:58:58.787104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:58:58.787364 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:58.787225 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:58:58.787364 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:58.787249 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:58:58.787364 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:58.787263 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:58:58.787364 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:58.787295 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 06:59:00.787275444 +0000 UTC m=+39.171544398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:58:58.787364 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:58:58.787310 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 06:59:00.787304071 +0000 UTC m=+39.171573006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:59:00.802381 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:00.802346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:59:00.802381 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:00.802381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:59:00.802823 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:00.802485 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:59:00.802823 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:00.802491 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:00.802823 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:00.802570 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 06:59:04.802553746 +0000 UTC m=+43.186822682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:59:00.802823 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:00.802495 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:59:00.802823 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:00.802625 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 06:59:04.802614999 +0000 UTC m=+43.186883938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:59:01.287066 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:01.287030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-szm5h" event={"ID":"4a494ba6-e26a-4dfe-8209-2fd08ec72d2a","Type":"ContainerStarted","Data":"fa1468e9af1683c0e887bc7799387a70e823c6e3d82abfa6b38d8cc1f4fd4bbf"} Jun 09 06:59:01.289703 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:01.289677 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9303e23-a282-45e9-b9a9-b1a5192d9077" containerID="5bbac351e82b50fcde63afeb9a61b3c3bd1c4b24af2466f3c2f9b9587add876d" exitCode=0 Jun 09 06:59:01.289846 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:01.289739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerDied","Data":"5bbac351e82b50fcde63afeb9a61b3c3bd1c4b24af2466f3c2f9b9587add876d"} Jun 09 06:59:01.302703 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:01.302666 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-szm5h" podStartSLOduration=2.225947485 podStartE2EDuration="5.302654082s" totalImagesPullingTime="3.076706597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:01.301455767 +0000 UTC m=+39.685724726" watchObservedRunningTime="2026-06-09 06:59:01.302654082 +0000 UTC m=+39.686923040" Jun 09 06:59:02.298049 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:02.298014 2563 generic.go:356] "Generic (PLEG): container finished" podID="c9303e23-a282-45e9-b9a9-b1a5192d9077" containerID="3e96d0f9f60369969f7b844abad33b5077eb99d1e473ef0d4b61a45709cb1a82" exitCode=0 Jun 09 06:59:02.298396 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:02.298098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerDied","Data":"3e96d0f9f60369969f7b844abad33b5077eb99d1e473ef0d4b61a45709cb1a82"} Jun 09 06:59:03.304058 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:03.304021 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dckzw" event={"ID":"c9303e23-a282-45e9-b9a9-b1a5192d9077","Type":"ContainerStarted","Data":"c492c312f4c8a672e6e9942874b7db87580bc38c50c06628a5c75c9d6873c133"} Jun 09 06:59:03.325789 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:03.325743 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dckzw" podStartSLOduration=8.067009605 podStartE2EDuration="41.325708817s" totalImagesPullingTime="33.258699212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:03.325294569 +0000 UTC m=+41.709563527" watchObservedRunningTime="2026-06-09 06:59:03.325708817 +0000 UTC m=+41.709977774" Jun 09 06:59:04.828052 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:04.828015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:59:04.828052 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:04.828051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:59:04.828439 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:04.828157 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:59:04.828439 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:04.828167 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:59:04.828439 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:04.828202 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:04.828439 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:04.828217 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 06:59:12.828203993 +0000 UTC m=+51.212472929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:59:04.828439 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:04.828253 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 06:59:12.828241684 +0000 UTC m=+51.212510620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:59:12.883735 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:12.883694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:59:12.884248 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:12.883745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:59:12.884248 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:12.883838 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:12.884248 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:12.883844 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:59:12.884248 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:12.883863 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:59:12.884248 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:12.883910 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 06:59:28.883897091 +0000 UTC m=+67.268166028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:59:12.884248 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:12.883923 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 06:59:28.883917584 +0000 UTC m=+67.268186521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:59:23.272106 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:23.272078 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tb7h" Jun 09 06:59:27.790311 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.790269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:59:27.793088 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.793067 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 06:59:27.804793 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.804772 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/362d65c3-ab95-4530-92d4-28fba22aef1c-original-pull-secret\") pod \"global-pull-secret-syncer-wxd7l\" (UID: \"362d65c3-ab95-4530-92d4-28fba22aef1c\") " pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:59:27.891078 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.891027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 06:59:27.891260 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.891140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:59:27.893954 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.893931 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 06:59:27.894072 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.893933 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 06:59:27.901664 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:27.901645 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 06:59:27.901748 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:27.901713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 07:00:31.901692917 +0000 UTC m=+130.285961872 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : secret "metrics-daemon-secret" not found Jun 09 06:59:27.903602 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.903588 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 06:59:27.915029 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.915007 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp89z\" (UniqueName: \"kubernetes.io/projected/71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7-kube-api-access-sp89z\") pod \"network-check-target-hxkhj\" (UID: \"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7\") " pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:59:27.993829 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:27.993804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcng\"" Jun 09 06:59:28.001783 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.001763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:59:28.089995 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.089964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wxd7l" Jun 09 06:59:28.132773 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.132743 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hxkhj"] Jun 09 06:59:28.136887 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:59:28.136860 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c7b590_d7b8_42fe_a8ba_8fa4fa9982a7.slice/crio-165b4c335ff940f9cc95da1f76f20158aaa85b9ce65f58302e56a13ee7deb09b WatchSource:0}: Error finding container 165b4c335ff940f9cc95da1f76f20158aaa85b9ce65f58302e56a13ee7deb09b: Status 404 returned error can't find the container with id 165b4c335ff940f9cc95da1f76f20158aaa85b9ce65f58302e56a13ee7deb09b Jun 09 06:59:28.218108 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.218078 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wxd7l"] Jun 09 06:59:28.221079 ip-10-0-134-45 kubenswrapper[2563]: W0609 06:59:28.221049 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362d65c3_ab95_4530_92d4_28fba22aef1c.slice/crio-00ed9557caba7e28c3f86b37ff4f50cc099940bfbe7c86d3bf4f0ca6784ebfb8 WatchSource:0}: Error finding container 00ed9557caba7e28c3f86b37ff4f50cc099940bfbe7c86d3bf4f0ca6784ebfb8: Status 404 returned error can't find the container with id 00ed9557caba7e28c3f86b37ff4f50cc099940bfbe7c86d3bf4f0ca6784ebfb8 Jun 09 06:59:28.362764 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.362668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wxd7l" event={"ID":"362d65c3-ab95-4530-92d4-28fba22aef1c","Type":"ContainerStarted","Data":"00ed9557caba7e28c3f86b37ff4f50cc099940bfbe7c86d3bf4f0ca6784ebfb8"} Jun 09 06:59:28.363662 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.363640 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxkhj" event={"ID":"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7","Type":"ContainerStarted","Data":"165b4c335ff940f9cc95da1f76f20158aaa85b9ce65f58302e56a13ee7deb09b"} Jun 09 06:59:28.900287 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.900236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 06:59:28.900287 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:28.900287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 06:59:28.900815 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:28.900429 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 06:59:28.900815 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:28.900443 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 06:59:28.900815 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:28.900457 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 06:59:28.900815 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:28.900517 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 07:00:00.900497585 +0000 UTC m=+99.284766534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 06:59:28.900815 ip-10-0-134-45 kubenswrapper[2563]: E0609 06:59:28.900542 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 07:00:00.900531659 +0000 UTC m=+99.284800599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 06:59:31.372603 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:31.372526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hxkhj" event={"ID":"71c7b590-d7b8-42fe-a8ba-8fa4fa9982a7","Type":"ContainerStarted","Data":"c679eaec8de5493f605dd95d3124b43ae611109d995b2aa524706cde55b38e7c"} Jun 09 06:59:31.373008 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:31.372662 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 06:59:31.388711 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:31.388670 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hxkhj" podStartSLOduration=66.444357914 podStartE2EDuration="1m9.388657718s" totalImagesPullingTime="2.944299804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:31.387584599 +0000 UTC m=+69.771853556" watchObservedRunningTime="2026-06-09 06:59:31.388657718 +0000 UTC m=+69.772926675" Jun 09 06:59:34.381469 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:34.381430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wxd7l" event={"ID":"362d65c3-ab95-4530-92d4-28fba22aef1c","Type":"ContainerStarted","Data":"53b355b8fb49c9509e434c7f8db6d293e4bda00880daddbd88c04c13d88ab56c"} Jun 09 06:59:34.399162 ip-10-0-134-45 kubenswrapper[2563]: I0609 06:59:34.399114 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wxd7l" podStartSLOduration=67.311676428 podStartE2EDuration="1m12.39909954s" totalImagesPullingTime="5.087423112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 06:59:34.398671855 +0000 UTC m=+72.782940813" watchObservedRunningTime="2026-06-09 06:59:34.39909954 +0000 UTC m=+72.783368492" Jun 09 07:00:00.904984 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:00:00.904945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 07:00:00.904984 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:00:00.904985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:00:00.905425 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:00.905086 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:00:00.905425 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:00.905091 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:00:00.905425 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:00.905155 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 07:01:04.905139797 +0000 UTC m=+163.289408732 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 07:00:00.905425 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:00.905097 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 07:00:00.905425 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:00.905230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 07:01:04.905215519 +0000 UTC m=+163.289484454 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 07:00:02.377528 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:00:02.377493 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hxkhj" Jun 09 07:00:31.911522 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:00:31.911479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 07:00:31.912024 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:31.911592 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 07:00:31.912024 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:00:31.911644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs podName:a7882294-ab8a-44f8-9275-e2b7a5204700 nodeName:}" failed. No retries permitted until 2026-06-09 07:02:33.911631261 +0000 UTC m=+252.295900197 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs") pod "network-metrics-daemon-r4btx" (UID: "a7882294-ab8a-44f8-9275-e2b7a5204700") : secret "metrics-daemon-secret" not found Jun 09 07:01:00.003404 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:00.003357 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" Jun 09 07:01:00.022361 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:00.022322 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-46vqx" podUID="ac5e6519-9520-432b-a416-d02051cc940c" Jun 09 07:01:00.085865 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:00.085830 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r4btx" podUID="a7882294-ab8a-44f8-9275-e2b7a5204700" Jun 09 07:01:00.587281 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:00.587196 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46vqx" Jun 09 07:01:00.587447 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:00.587197 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:01:04.937579 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:04.937526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 07:01:04.937579 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:04.937580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:01:04.938050 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:04.937684 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:01:04.938050 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:04.937696 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:01:04.938050 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:04.937714 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d5ff57c48-w5zmq: secret "image-registry-tls" not found Jun 09 07:01:04.938050 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:04.937773 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls podName:ac5e6519-9520-432b-a416-d02051cc940c nodeName:}" failed. No retries permitted until 2026-06-09 07:03:06.937757424 +0000 UTC m=+285.322026361 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls") pod "dns-default-46vqx" (UID: "ac5e6519-9520-432b-a416-d02051cc940c") : secret "dns-default-metrics-tls" not found Jun 09 07:01:04.938050 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:04.937791 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls podName:58725ca1-2060-49e7-a529-6bedcdfbb66f nodeName:}" failed. No retries permitted until 2026-06-09 07:03:06.937783542 +0000 UTC m=+285.322052477 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls") pod "image-registry-6d5ff57c48-w5zmq" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f") : secret "image-registry-tls" not found Jun 09 07:01:14.076463 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:14.076390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 07:01:49.408993 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.408955 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mvp64"] Jun 09 07:01:49.410630 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.410614 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.415050 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.415028 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kcgs5\"" Jun 09 07:01:49.415179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.415029 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:01:49.415179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.415028 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 07:01:49.415179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.415029 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 07:01:49.415327 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.415030 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 07:01:49.422098 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.422079 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 07:01:49.446316 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.446285 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mvp64"] Jun 09 07:01:49.510964 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.510931 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j"] Jun 09 07:01:49.512753 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.512737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.517003 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.516984 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 07:01:49.517129 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.517016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 07:01:49.517963 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.517939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-t66b9\"" Jun 09 07:01:49.518272 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.518259 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 07:01:49.519046 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.518937 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:01:49.530252 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.530227 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j"] Jun 09 07:01:49.534584 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.534556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d69b561-1585-43ba-9900-6d3ce37343cd-config\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.534673 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.534593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d69b561-1585-43ba-9900-6d3ce37343cd-serving-cert\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.534673 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.534611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnjsm\" (UniqueName: \"kubernetes.io/projected/4d69b561-1585-43ba-9900-6d3ce37343cd-kube-api-access-wnjsm\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.534673 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.534631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d69b561-1585-43ba-9900-6d3ce37343cd-trusted-ca\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.635489 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d69b561-1585-43ba-9900-6d3ce37343cd-config\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.635655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d69b561-1585-43ba-9900-6d3ce37343cd-serving-cert\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.635655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnjsm\" (UniqueName: \"kubernetes.io/projected/4d69b561-1585-43ba-9900-6d3ce37343cd-kube-api-access-wnjsm\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.635655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d147ec9-eb1c-4142-818c-b4bce264e590-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.635655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d69b561-1585-43ba-9900-6d3ce37343cd-trusted-ca\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.635888 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d147ec9-eb1c-4142-818c-b4bce264e590-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.635888 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.635841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6qdb\" (UniqueName: \"kubernetes.io/projected/5d147ec9-eb1c-4142-818c-b4bce264e590-kube-api-access-h6qdb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.636174 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.636148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d69b561-1585-43ba-9900-6d3ce37343cd-config\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.636450 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.636433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d69b561-1585-43ba-9900-6d3ce37343cd-trusted-ca\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.637940 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.637923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d69b561-1585-43ba-9900-6d3ce37343cd-serving-cert\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.644164 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.644143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnjsm\" (UniqueName: \"kubernetes.io/projected/4d69b561-1585-43ba-9900-6d3ce37343cd-kube-api-access-wnjsm\") pod \"console-operator-668fdbf85c-mvp64\" (UID: \"4d69b561-1585-43ba-9900-6d3ce37343cd\") " pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.719838 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.719752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:49.736747 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.736706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d147ec9-eb1c-4142-818c-b4bce264e590-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.736864 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.736813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6qdb\" (UniqueName: \"kubernetes.io/projected/5d147ec9-eb1c-4142-818c-b4bce264e590-kube-api-access-h6qdb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.736912 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.736883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d147ec9-eb1c-4142-818c-b4bce264e590-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.737383 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.737358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d147ec9-eb1c-4142-818c-b4bce264e590-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.739170 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.739145 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d147ec9-eb1c-4142-818c-b4bce264e590-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.746609 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.746566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6qdb\" (UniqueName: \"kubernetes.io/projected/5d147ec9-eb1c-4142-818c-b4bce264e590-kube-api-access-h6qdb\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-vcv4j\" (UID: \"5d147ec9-eb1c-4142-818c-b4bce264e590\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.822064 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.822032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" Jun 09 07:01:49.844482 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.844441 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mvp64"] Jun 09 07:01:49.847183 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:01:49.847158 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d69b561_1585_43ba_9900_6d3ce37343cd.slice/crio-15692a46c5003ad29cce75c3e600d4f29d2cac06190330477c6f0b9cf716afda WatchSource:0}: Error finding container 15692a46c5003ad29cce75c3e600d4f29d2cac06190330477c6f0b9cf716afda: Status 404 returned error can't find the container with id 15692a46c5003ad29cce75c3e600d4f29d2cac06190330477c6f0b9cf716afda Jun 09 07:01:49.951415 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:49.951383 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j"] Jun 09 07:01:49.955500 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:01:49.955473 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d147ec9_eb1c_4142_818c_b4bce264e590.slice/crio-aabc894b0a21f7ad86c5794f7daf21f16fa5f9482600e7b80877da43d0ca2588 WatchSource:0}: Error finding container aabc894b0a21f7ad86c5794f7daf21f16fa5f9482600e7b80877da43d0ca2588: Status 404 returned error can't find the container with id aabc894b0a21f7ad86c5794f7daf21f16fa5f9482600e7b80877da43d0ca2588 Jun 09 07:01:50.707106 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:50.707065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" event={"ID":"4d69b561-1585-43ba-9900-6d3ce37343cd","Type":"ContainerStarted","Data":"15692a46c5003ad29cce75c3e600d4f29d2cac06190330477c6f0b9cf716afda"} Jun 09 07:01:50.708240 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:50.708215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" event={"ID":"5d147ec9-eb1c-4142-818c-b4bce264e590","Type":"ContainerStarted","Data":"aabc894b0a21f7ad86c5794f7daf21f16fa5f9482600e7b80877da43d0ca2588"} Jun 09 07:01:53.717733 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:53.717693 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/0.log" Jun 09 07:01:53.718148 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:53.717750 2563 generic.go:356] "Generic (PLEG): container finished" podID="4d69b561-1585-43ba-9900-6d3ce37343cd" containerID="050a3468a0e1d21b017185e54474e0bd565434b2e11b9d0cc278e5d20c6c4842" exitCode=255 Jun 09 07:01:53.718148 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:53.717822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" event={"ID":"4d69b561-1585-43ba-9900-6d3ce37343cd","Type":"ContainerDied","Data":"050a3468a0e1d21b017185e54474e0bd565434b2e11b9d0cc278e5d20c6c4842"} Jun 09 07:01:53.718148 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:53.718022 2563 scope.go:117] "RemoveContainer" containerID="050a3468a0e1d21b017185e54474e0bd565434b2e11b9d0cc278e5d20c6c4842" Jun 09 07:01:53.719383 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:53.719356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" event={"ID":"5d147ec9-eb1c-4142-818c-b4bce264e590","Type":"ContainerStarted","Data":"328fa13630c7956b3005d849f8e046a9b779049fb3a11c18d576486ea8243379"} Jun 09 07:01:53.746851 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:53.746800 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" podStartSLOduration=1.897877155 podStartE2EDuration="4.746780964s" totalImagesPullingTime="2.848903809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:01:53.746467754 +0000 UTC m=+212.130736714" watchObservedRunningTime="2026-06-09 07:01:53.746780964 +0000 UTC m=+212.131049921" Jun 09 07:01:54.723875 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:54.723849 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/1.log" Jun 09 07:01:54.724350 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:54.724231 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/0.log" Jun 09 07:01:54.724350 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:54.724265 2563 generic.go:356] "Generic (PLEG): container finished" podID="4d69b561-1585-43ba-9900-6d3ce37343cd" containerID="0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938" exitCode=255 Jun 09 07:01:54.724350 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:54.724299 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" event={"ID":"4d69b561-1585-43ba-9900-6d3ce37343cd","Type":"ContainerDied","Data":"0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938"} Jun 09 07:01:54.724350 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:54.724350 2563 scope.go:117] "RemoveContainer" containerID="050a3468a0e1d21b017185e54474e0bd565434b2e11b9d0cc278e5d20c6c4842" Jun 09 07:01:54.724573 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:54.724557 2563 scope.go:117] "RemoveContainer" containerID="0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938" Jun 09 07:01:54.724831 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:54.724758 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvp64_openshift-console-operator(4d69b561-1585-43ba-9900-6d3ce37343cd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" podUID="4d69b561-1585-43ba-9900-6d3ce37343cd" Jun 09 07:01:55.555600 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:55.555569 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5p52_e09c4a7b-65be-42fc-b5e1-0694b9348176/dns-node-resolver/0.log" Jun 09 07:01:55.728638 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:55.728609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/1.log" Jun 09 07:01:55.729010 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:55.728901 2563 scope.go:117] "RemoveContainer" containerID="0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938" Jun 09 07:01:55.729053 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:55.729027 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvp64_openshift-console-operator(4d69b561-1585-43ba-9900-6d3ce37343cd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" podUID="4d69b561-1585-43ba-9900-6d3ce37343cd" Jun 09 07:01:56.355624 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:56.355601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vzv49_04941328-3a49-46ee-9ef6-d0845e2e2e2b/node-ca/0.log" Jun 09 07:01:57.354830 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:57.354803 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-szm5h_4a494ba6-e26a-4dfe-8209-2fd08ec72d2a/serve-healthcheck-canary/0.log" Jun 09 07:01:59.720303 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:59.720253 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:59.720665 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:59.720319 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:01:59.720665 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:01:59.720611 2563 scope.go:117] "RemoveContainer" containerID="0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938" Jun 09 07:01:59.720775 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:01:59.720761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvp64_openshift-console-operator(4d69b561-1585-43ba-9900-6d3ce37343cd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" podUID="4d69b561-1585-43ba-9900-6d3ce37343cd" Jun 09 07:02:12.077502 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.077461 2563 scope.go:117] "RemoveContainer" containerID="0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938" Jun 09 07:02:12.776392 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.776364 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:02:12.776763 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.776740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/1.log" Jun 09 07:02:12.776842 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.776779 2563 generic.go:356] "Generic (PLEG): container finished" podID="4d69b561-1585-43ba-9900-6d3ce37343cd" containerID="69f24516d5c2e2c4e9db6f2f9d2fd2a8562d380ee51d76aabc35f9a47d7bb15f" exitCode=255 Jun 09 07:02:12.776842 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.776827 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" event={"ID":"4d69b561-1585-43ba-9900-6d3ce37343cd","Type":"ContainerDied","Data":"69f24516d5c2e2c4e9db6f2f9d2fd2a8562d380ee51d76aabc35f9a47d7bb15f"} Jun 09 07:02:12.776938 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.776869 2563 scope.go:117] "RemoveContainer" containerID="0b0b9b67cb4395f995da8c664174d851928a25480e03e360781feee6247e9938" Jun 09 07:02:12.777157 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:12.777138 2563 scope.go:117] "RemoveContainer" containerID="69f24516d5c2e2c4e9db6f2f9d2fd2a8562d380ee51d76aabc35f9a47d7bb15f" Jun 09 07:02:12.777323 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:12.777304 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvp64_openshift-console-operator(4d69b561-1585-43ba-9900-6d3ce37343cd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" podUID="4d69b561-1585-43ba-9900-6d3ce37343cd" Jun 09 07:02:13.780601 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:13.780570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:02:19.521660 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.521631 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nl8hf"] Jun 09 07:02:19.525048 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.525029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.527636 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.527611 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 07:02:19.527636 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.527631 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 07:02:19.528630 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.528608 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l9q29\"" Jun 09 07:02:19.528756 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.528655 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 07:02:19.528756 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.528656 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 07:02:19.544079 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.544054 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nl8hf"] Jun 09 07:02:19.641329 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.641304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b97a9-ea84-457d-a070-7bb1580eee7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.641449 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.641366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b97a9-ea84-457d-a070-7bb1580eee7c-data-volume\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.641449 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.641387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b97a9-ea84-457d-a070-7bb1580eee7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.641449 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.641407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b97a9-ea84-457d-a070-7bb1580eee7c-crio-socket\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.641449 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.641422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkrd\" (UniqueName: \"kubernetes.io/projected/b91b97a9-ea84-457d-a070-7bb1580eee7c-kube-api-access-gmkrd\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.720206 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.720179 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:02:19.720305 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.720223 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:02:19.720483 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.720471 2563 scope.go:117] "RemoveContainer" containerID="69f24516d5c2e2c4e9db6f2f9d2fd2a8562d380ee51d76aabc35f9a47d7bb15f" Jun 09 07:02:19.720633 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:19.720616 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mvp64_openshift-console-operator(4d69b561-1585-43ba-9900-6d3ce37343cd)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" podUID="4d69b561-1585-43ba-9900-6d3ce37343cd" Jun 09 07:02:19.741856 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.741830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b97a9-ea84-457d-a070-7bb1580eee7c-data-volume\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.741955 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.741865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b97a9-ea84-457d-a070-7bb1580eee7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.741955 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.741897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b97a9-ea84-457d-a070-7bb1580eee7c-crio-socket\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.741955 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.741920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkrd\" (UniqueName: \"kubernetes.io/projected/b91b97a9-ea84-457d-a070-7bb1580eee7c-kube-api-access-gmkrd\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.742092 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.741981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b97a9-ea84-457d-a070-7bb1580eee7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.742092 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.741983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b91b97a9-ea84-457d-a070-7bb1580eee7c-crio-socket\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.742223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.742203 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91b97a9-ea84-457d-a070-7bb1580eee7c-data-volume\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.742412 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.742386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b91b97a9-ea84-457d-a070-7bb1580eee7c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.744327 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.744306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b91b97a9-ea84-457d-a070-7bb1580eee7c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.756641 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.756615 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkrd\" (UniqueName: \"kubernetes.io/projected/b91b97a9-ea84-457d-a070-7bb1580eee7c-kube-api-access-gmkrd\") pod \"insights-runtime-extractor-nl8hf\" (UID: \"b91b97a9-ea84-457d-a070-7bb1580eee7c\") " pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.833693 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.833646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nl8hf" Jun 09 07:02:19.956676 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:19.956651 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nl8hf"] Jun 09 07:02:19.959595 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:19.959571 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91b97a9_ea84_457d_a070_7bb1580eee7c.slice/crio-0886a70e3ab98ef60a73b7c27daf7bb77b68cb5abb5023b7e39d768fe139caea WatchSource:0}: Error finding container 0886a70e3ab98ef60a73b7c27daf7bb77b68cb5abb5023b7e39d768fe139caea: Status 404 returned error can't find the container with id 0886a70e3ab98ef60a73b7c27daf7bb77b68cb5abb5023b7e39d768fe139caea Jun 09 07:02:20.800976 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:20.800945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nl8hf" event={"ID":"b91b97a9-ea84-457d-a070-7bb1580eee7c","Type":"ContainerStarted","Data":"f2686aea14fb38be33cab7ec1e4d19706d3af8b827c42156e45eb675c26aeb0d"} Jun 09 07:02:20.801260 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:20.800999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nl8hf" event={"ID":"b91b97a9-ea84-457d-a070-7bb1580eee7c","Type":"ContainerStarted","Data":"d47a2debf762bd2f4ee7d5b106423674792bb880f150ec58d6efc84a7439057a"} Jun 09 07:02:20.801260 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:20.801017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nl8hf" event={"ID":"b91b97a9-ea84-457d-a070-7bb1580eee7c","Type":"ContainerStarted","Data":"0886a70e3ab98ef60a73b7c27daf7bb77b68cb5abb5023b7e39d768fe139caea"} Jun 09 07:02:22.807870 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:22.807838 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nl8hf" event={"ID":"b91b97a9-ea84-457d-a070-7bb1580eee7c","Type":"ContainerStarted","Data":"36e2bd9b263061fc1032fec5572e43e544a6c467e21ba6060266fa97e6369978"} Jun 09 07:02:22.844077 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:22.844031 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nl8hf" podStartSLOduration=1.781321482 podStartE2EDuration="3.844019776s" totalImagesPullingTime="2.062698294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:02:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:22.843812714 +0000 UTC m=+241.228081687" watchObservedRunningTime="2026-06-09 07:02:22.844019776 +0000 UTC m=+241.228288733" Jun 09 07:02:24.479901 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.479868 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k"] Jun 09 07:02:24.482629 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.482611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:24.485051 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.485028 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 07:02:24.485148 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.485133 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-b8k4b\"" Jun 09 07:02:24.492838 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.492815 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k"] Jun 09 07:02:24.578474 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.578437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/916b97f5-deed-48a5-8b97-8534f04a042e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ntz8k\" (UID: \"916b97f5-deed-48a5-8b97-8534f04a042e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:24.679298 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:24.679267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/916b97f5-deed-48a5-8b97-8534f04a042e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ntz8k\" (UID: \"916b97f5-deed-48a5-8b97-8534f04a042e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:24.679437 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:24.679376 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 07:02:24.679437 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:24.679427 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916b97f5-deed-48a5-8b97-8534f04a042e-tls-certificates podName:916b97f5-deed-48a5-8b97-8534f04a042e nodeName:}" failed. No retries permitted until 2026-06-09 07:02:25.179412688 +0000 UTC m=+243.563681623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/916b97f5-deed-48a5-8b97-8534f04a042e-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-ntz8k" (UID: "916b97f5-deed-48a5-8b97-8534f04a042e") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 07:02:25.182955 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:25.182925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/916b97f5-deed-48a5-8b97-8534f04a042e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ntz8k\" (UID: \"916b97f5-deed-48a5-8b97-8534f04a042e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:25.185360 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:25.185340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/916b97f5-deed-48a5-8b97-8534f04a042e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-ntz8k\" (UID: \"916b97f5-deed-48a5-8b97-8534f04a042e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:25.391602 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:25.391558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:25.514384 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:25.514356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k"] Jun 09 07:02:25.517360 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:25.517330 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916b97f5_deed_48a5_8b97_8534f04a042e.slice/crio-bf99c46176957e5254260ccd0b040d55b90b3a8c352c9526da573db71acae188 WatchSource:0}: Error finding container bf99c46176957e5254260ccd0b040d55b90b3a8c352c9526da573db71acae188: Status 404 returned error can't find the container with id bf99c46176957e5254260ccd0b040d55b90b3a8c352c9526da573db71acae188 Jun 09 07:02:25.818198 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:25.818127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" event={"ID":"916b97f5-deed-48a5-8b97-8534f04a042e","Type":"ContainerStarted","Data":"bf99c46176957e5254260ccd0b040d55b90b3a8c352c9526da573db71acae188"} Jun 09 07:02:27.826474 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:27.826429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" event={"ID":"916b97f5-deed-48a5-8b97-8534f04a042e","Type":"ContainerStarted","Data":"a564ade9d5a7a38a147717f1065ef6762d257aeb5b40e5381415ae0749d3760e"} Jun 09 07:02:27.826903 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:27.826625 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:27.831288 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:27.831264 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" Jun 09 07:02:27.842306 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:27.842263 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-ntz8k" podStartSLOduration=2.466373585 podStartE2EDuration="3.842249691s" totalImagesPullingTime="1.375876106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:27.841463111 +0000 UTC m=+246.225732068" watchObservedRunningTime="2026-06-09 07:02:27.842249691 +0000 UTC m=+246.226518649" Jun 09 07:02:28.539072 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.539033 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pck2r"] Jun 09 07:02:28.542098 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.542078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.544573 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.544545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 07:02:28.544573 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.544552 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 07:02:28.545859 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.545842 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 07:02:28.546132 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.546116 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 07:02:28.546205 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.546189 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 07:02:28.546262 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.546198 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-z2nz4\"" Jun 09 07:02:28.550015 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.549993 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pck2r"] Jun 09 07:02:28.709292 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.709260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024d4bea-ae2e-4511-b7da-a74b50421531-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.709426 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.709302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77mb\" (UniqueName: \"kubernetes.io/projected/024d4bea-ae2e-4511-b7da-a74b50421531-kube-api-access-h77mb\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.709426 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.709339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/024d4bea-ae2e-4511-b7da-a74b50421531-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.709426 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.709409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024d4bea-ae2e-4511-b7da-a74b50421531-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.810439 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.810378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024d4bea-ae2e-4511-b7da-a74b50421531-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.810439 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.810415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h77mb\" (UniqueName: \"kubernetes.io/projected/024d4bea-ae2e-4511-b7da-a74b50421531-kube-api-access-h77mb\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.810568 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.810440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/024d4bea-ae2e-4511-b7da-a74b50421531-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.810609 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.810570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024d4bea-ae2e-4511-b7da-a74b50421531-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.811223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.811195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/024d4bea-ae2e-4511-b7da-a74b50421531-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.812944 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.812913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/024d4bea-ae2e-4511-b7da-a74b50421531-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.813028 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.812970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/024d4bea-ae2e-4511-b7da-a74b50421531-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.819006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.818986 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77mb\" (UniqueName: \"kubernetes.io/projected/024d4bea-ae2e-4511-b7da-a74b50421531-kube-api-access-h77mb\") pod \"prometheus-operator-7f7d445d84-pck2r\" (UID: \"024d4bea-ae2e-4511-b7da-a74b50421531\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.851509 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.851492 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" Jun 09 07:02:28.972813 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:28.972780 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pck2r"] Jun 09 07:02:28.975331 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:28.975303 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024d4bea_ae2e_4511_b7da_a74b50421531.slice/crio-08b0aba5104537a931cb4b3c885e563742954ffcd7f5ace98009e98eff338aa2 WatchSource:0}: Error finding container 08b0aba5104537a931cb4b3c885e563742954ffcd7f5ace98009e98eff338aa2: Status 404 returned error can't find the container with id 08b0aba5104537a931cb4b3c885e563742954ffcd7f5ace98009e98eff338aa2 Jun 09 07:02:29.834289 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:29.834249 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" event={"ID":"024d4bea-ae2e-4511-b7da-a74b50421531","Type":"ContainerStarted","Data":"08b0aba5104537a931cb4b3c885e563742954ffcd7f5ace98009e98eff338aa2"} Jun 09 07:02:30.839001 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:30.838964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" event={"ID":"024d4bea-ae2e-4511-b7da-a74b50421531","Type":"ContainerStarted","Data":"bd10ec6ca8b54bc3bca7470c652389aadbd71b46e1187ddc076ac64a015cd84b"} Jun 09 07:02:30.839398 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:30.839016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" event={"ID":"024d4bea-ae2e-4511-b7da-a74b50421531","Type":"ContainerStarted","Data":"b5ab31c5c645736876e65f92d4ed307b859f205e4cb81e712d1a3601546bae99"} Jun 09 07:02:30.855626 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:30.855579 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pck2r" podStartSLOduration=1.436756092 podStartE2EDuration="2.855562968s" totalImagesPullingTime="1.418806876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:30.854322066 +0000 UTC m=+249.238591024" watchObservedRunningTime="2026-06-09 07:02:30.855562968 +0000 UTC m=+249.239831926" Jun 09 07:02:32.878675 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.878641 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk"] Jun 09 07:02:32.881894 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.881870 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:32.885185 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.885165 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 07:02:32.885785 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.885767 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 07:02:32.885785 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.885776 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jx5q7\"" Jun 09 07:02:32.897972 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.897948 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk"] Jun 09 07:02:32.903547 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.903523 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6zglt"] Jun 09 07:02:32.911526 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.911502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:32.913873 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.913854 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 07:02:32.913979 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.913896 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-msfvm\"" Jun 09 07:02:32.914453 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.914439 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 07:02:32.914688 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:32.914670 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 07:02:33.044338 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044338 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-sys\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946gg\" (UniqueName: \"kubernetes.io/projected/777553d9-01b4-40fa-9ee9-5b55e2cde59b-kube-api-access-946gg\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-tls\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-metrics-client-ca\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khfnh\" (UniqueName: \"kubernetes.io/projected/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-kube-api-access-khfnh\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.044574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.044910 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777553d9-01b4-40fa-9ee9-5b55e2cde59b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.044910 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-root\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044910 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-textfile\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.044910 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.044710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-wtmp\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.076640 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.076608 2563 scope.go:117] "RemoveContainer" containerID="69f24516d5c2e2c4e9db6f2f9d2fd2a8562d380ee51d76aabc35f9a47d7bb15f" Jun 09 07:02:33.145488 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-metrics-client-ca\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.145488 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khfnh\" (UniqueName: \"kubernetes.io/projected/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-kube-api-access-khfnh\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.145488 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.145488 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.145790 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:33.145606 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 07:02:33.145790 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145620 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777553d9-01b4-40fa-9ee9-5b55e2cde59b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.145790 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:33.145675 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls podName:777553d9-01b4-40fa-9ee9-5b55e2cde59b nodeName:}" failed. No retries permitted until 2026-06-09 07:02:33.645653117 +0000 UTC m=+252.029922059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-fcxjk" (UID: "777553d9-01b4-40fa-9ee9-5b55e2cde59b") : secret "openshift-state-metrics-tls" not found Jun 09 07:02:33.145790 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-root\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.145790 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-textfile\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-wtmp\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145817 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-root\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145936 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-sys\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.145963 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946gg\" (UniqueName: \"kubernetes.io/projected/777553d9-01b4-40fa-9ee9-5b55e2cde59b-kube-api-access-946gg\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.146037 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146023 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-wtmp\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146364 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-tls\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146364 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146073 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-textfile\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146364 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146123 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-metrics-client-ca\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146364 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146134 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-sys\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.146364 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146350 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/777553d9-01b4-40fa-9ee9-5b55e2cde59b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.146589 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.146541 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.148326 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.148282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.148711 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.148612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-tls\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.149861 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.149829 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.155484 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.155429 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khfnh\" (UniqueName: \"kubernetes.io/projected/124e74d1-cb47-4596-801e-fa3ffa1ab4d3-kube-api-access-khfnh\") pod \"node-exporter-6zglt\" (UID: \"124e74d1-cb47-4596-801e-fa3ffa1ab4d3\") " pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.157269 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.157249 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-946gg\" (UniqueName: \"kubernetes.io/projected/777553d9-01b4-40fa-9ee9-5b55e2cde59b-kube-api-access-946gg\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.220649 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.220613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6zglt" Jun 09 07:02:33.232379 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:33.232350 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124e74d1_cb47_4596_801e_fa3ffa1ab4d3.slice/crio-6c92a86346b76ec0052be1cceb803a292353b03a4ae86b739d1ec0754a359916 WatchSource:0}: Error finding container 6c92a86346b76ec0052be1cceb803a292353b03a4ae86b739d1ec0754a359916: Status 404 returned error can't find the container with id 6c92a86346b76ec0052be1cceb803a292353b03a4ae86b739d1ec0754a359916 Jun 09 07:02:33.650017 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.649975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:33.650208 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:33.650152 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 07:02:33.650268 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:33.650232 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls podName:777553d9-01b4-40fa-9ee9-5b55e2cde59b nodeName:}" failed. No retries permitted until 2026-06-09 07:02:34.65021176 +0000 UTC m=+253.034480709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-fcxjk" (UID: "777553d9-01b4-40fa-9ee9-5b55e2cde59b") : secret "openshift-state-metrics-tls" not found Jun 09 07:02:33.853713 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.853678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:02:33.853913 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.853821 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" event={"ID":"4d69b561-1585-43ba-9900-6d3ce37343cd","Type":"ContainerStarted","Data":"288964f95eef335cc45e662353c9fe2a0083f2384245bcb0cc5d814ec01e1810"} Jun 09 07:02:33.854219 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.854172 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:02:33.855772 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.855744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zglt" event={"ID":"124e74d1-cb47-4596-801e-fa3ffa1ab4d3","Type":"ContainerStarted","Data":"6c92a86346b76ec0052be1cceb803a292353b03a4ae86b739d1ec0754a359916"} Jun 09 07:02:33.873513 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.873450 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" podStartSLOduration=41.916252117 podStartE2EDuration="44.873431053s" totalImagesPullingTime="2.957178936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:33.872306005 +0000 UTC m=+252.256574976" watchObservedRunningTime="2026-06-09 07:02:33.873431053 +0000 UTC m=+252.257700013" Jun 09 07:02:33.952914 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.952822 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 07:02:33.955339 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:33.955312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7882294-ab8a-44f8-9275-e2b7a5204700-metrics-certs\") pod \"network-metrics-daemon-r4btx\" (UID: \"a7882294-ab8a-44f8-9275-e2b7a5204700\") " pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 07:02:34.179863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.179834 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-775hf\"" Jun 09 07:02:34.187574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.187550 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r4btx" Jun 09 07:02:34.314775 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.314748 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r4btx"] Jun 09 07:02:34.317274 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:34.317246 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7882294_ab8a_44f8_9275_e2b7a5204700.slice/crio-9614bb01c98b1fcd44f2f4ef685f08563b556aaa63f356fed5bdbd996ce4a5b9 WatchSource:0}: Error finding container 9614bb01c98b1fcd44f2f4ef685f08563b556aaa63f356fed5bdbd996ce4a5b9: Status 404 returned error can't find the container with id 9614bb01c98b1fcd44f2f4ef685f08563b556aaa63f356fed5bdbd996ce4a5b9 Jun 09 07:02:34.606925 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.606844 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-mvp64" Jun 09 07:02:34.659492 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.659457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:34.662444 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.662416 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/777553d9-01b4-40fa-9ee9-5b55e2cde59b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-fcxjk\" (UID: \"777553d9-01b4-40fa-9ee9-5b55e2cde59b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:34.691259 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.691228 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" Jun 09 07:02:34.856292 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.856253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk"] Jun 09 07:02:34.859464 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:34.859435 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777553d9_01b4_40fa_9ee9_5b55e2cde59b.slice/crio-f88108be06f236486c74d6f77d2bab9966a5302bb55c5c96b1f200b77d7e5ed4 WatchSource:0}: Error finding container f88108be06f236486c74d6f77d2bab9966a5302bb55c5c96b1f200b77d7e5ed4: Status 404 returned error can't find the container with id f88108be06f236486c74d6f77d2bab9966a5302bb55c5c96b1f200b77d7e5ed4 Jun 09 07:02:34.861368 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.861312 2563 generic.go:356] "Generic (PLEG): container finished" podID="124e74d1-cb47-4596-801e-fa3ffa1ab4d3" containerID="657ef829e92c0e10cf2cd9239c946d5a3f75777b3556fe9cc6448770661d409d" exitCode=0 Jun 09 07:02:34.861439 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.861411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zglt" event={"ID":"124e74d1-cb47-4596-801e-fa3ffa1ab4d3","Type":"ContainerDied","Data":"657ef829e92c0e10cf2cd9239c946d5a3f75777b3556fe9cc6448770661d409d"} Jun 09 07:02:34.862952 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:34.862931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r4btx" event={"ID":"a7882294-ab8a-44f8-9275-e2b7a5204700","Type":"ContainerStarted","Data":"9614bb01c98b1fcd44f2f4ef685f08563b556aaa63f356fed5bdbd996ce4a5b9"} Jun 09 07:02:35.869252 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.869218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zglt" event={"ID":"124e74d1-cb47-4596-801e-fa3ffa1ab4d3","Type":"ContainerStarted","Data":"92956cb761b8947a5d0fe739d923c938fd87175f7c8b30aaebd87c7c885f8656"} Jun 09 07:02:35.869706 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.869315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zglt" event={"ID":"124e74d1-cb47-4596-801e-fa3ffa1ab4d3","Type":"ContainerStarted","Data":"a9f22087ad7691fabe1cbecd2d31ff31ccffeb379d93aaa86e0792577449d0ab"} Jun 09 07:02:35.870969 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.870935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" event={"ID":"777553d9-01b4-40fa-9ee9-5b55e2cde59b","Type":"ContainerStarted","Data":"dd314599decc8d579982845c0bc4f3630c2ee81c874b6ee4cfbcccf0a48982f8"} Jun 09 07:02:35.871075 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.870992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" event={"ID":"777553d9-01b4-40fa-9ee9-5b55e2cde59b","Type":"ContainerStarted","Data":"77691d25290ba4486b9b3181f564f03ed48aa9661c9ef107b5a8e379a89610b8"} Jun 09 07:02:35.871075 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.871024 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" event={"ID":"777553d9-01b4-40fa-9ee9-5b55e2cde59b","Type":"ContainerStarted","Data":"f88108be06f236486c74d6f77d2bab9966a5302bb55c5c96b1f200b77d7e5ed4"} Jun 09 07:02:35.872675 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.872637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r4btx" event={"ID":"a7882294-ab8a-44f8-9275-e2b7a5204700","Type":"ContainerStarted","Data":"24d90e0b2eca088be2bb36c260851d6f80f02adada08c275e483cf77cb1127af"} Jun 09 07:02:35.872854 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.872685 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r4btx" event={"ID":"a7882294-ab8a-44f8-9275-e2b7a5204700","Type":"ContainerStarted","Data":"df574c8ef963103b6669b6518aef7193b8c349475775e719aa0f3ee8421f5b0f"} Jun 09 07:02:35.887898 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.887816 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6zglt" podStartSLOduration=3.060578809 podStartE2EDuration="3.887795181s" totalImagesPullingTime="751.077009ms" totalInitContainerRuntime="76.139363ms" isStatefulPod=true podCreationTimestamp="2026-06-09 07:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:35.887351961 +0000 UTC m=+254.271620934" watchObservedRunningTime="2026-06-09 07:02:35.887795181 +0000 UTC m=+254.272064140" Jun 09 07:02:35.906255 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:35.906203 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r4btx" podStartSLOduration=252.994678225 podStartE2EDuration="4m13.906182511s" totalImagesPullingTime="911.504286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:35.905870645 +0000 UTC m=+254.290139603" watchObservedRunningTime="2026-06-09 07:02:35.906182511 +0000 UTC m=+254.290451469" Jun 09 07:02:36.878965 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:36.878889 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" event={"ID":"777553d9-01b4-40fa-9ee9-5b55e2cde59b","Type":"ContainerStarted","Data":"01bda09402e3eea66be31e00ecca0598eef061e51d6f3cdf20440c22362a6841"} Jun 09 07:02:36.898283 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:36.898229 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-fcxjk" podStartSLOduration=3.784422096 podStartE2EDuration="4.898214475s" totalImagesPullingTime="1.113792379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:36.89752984 +0000 UTC m=+255.281798834" watchObservedRunningTime="2026-06-09 07:02:36.898214475 +0000 UTC m=+255.282483434" Jun 09 07:02:37.691946 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.691915 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-27xxv"] Jun 09 07:02:37.693961 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.693941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:37.696945 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.696919 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xvtkz\"" Jun 09 07:02:37.697877 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.697854 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 07:02:37.706304 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.706283 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-27xxv"] Jun 09 07:02:37.793455 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.793425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8vx8\" (UniqueName: \"kubernetes.io/projected/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-kube-api-access-b8vx8\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:37.793635 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.793492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:37.893870 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.893841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8vx8\" (UniqueName: \"kubernetes.io/projected/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-kube-api-access-b8vx8\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:37.894305 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.893901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:37.894305 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:37.894007 2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 07:02:37.894305 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:02:37.894055 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-monitoring-plugin-cert podName:0625d9a4-2dcc-4172-9bdf-b5d6de333f77 nodeName:}" failed. No retries permitted until 2026-06-09 07:02:38.394042405 +0000 UTC m=+256.778311340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-27xxv" (UID: "0625d9a4-2dcc-4172-9bdf-b5d6de333f77") : secret "monitoring-plugin-cert" not found Jun 09 07:02:37.904400 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:37.904375 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8vx8\" (UniqueName: \"kubernetes.io/projected/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-kube-api-access-b8vx8\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:38.396568 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:38.396512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:38.399008 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:38.398984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0625d9a4-2dcc-4172-9bdf-b5d6de333f77-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-27xxv\" (UID: \"0625d9a4-2dcc-4172-9bdf-b5d6de333f77\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:38.603760 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:38.603693 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:38.725164 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:38.725141 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-27xxv"] Jun 09 07:02:38.727494 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:38.727461 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0625d9a4_2dcc_4172_9bdf_b5d6de333f77.slice/crio-91f621d0b73f8f3c01a3fd8fd1b585ffbe36ef571af4379d7ac26e7efa8677a1 WatchSource:0}: Error finding container 91f621d0b73f8f3c01a3fd8fd1b585ffbe36ef571af4379d7ac26e7efa8677a1: Status 404 returned error can't find the container with id 91f621d0b73f8f3c01a3fd8fd1b585ffbe36ef571af4379d7ac26e7efa8677a1 Jun 09 07:02:38.887919 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:38.887881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" event={"ID":"0625d9a4-2dcc-4172-9bdf-b5d6de333f77","Type":"ContainerStarted","Data":"91f621d0b73f8f3c01a3fd8fd1b585ffbe36ef571af4379d7ac26e7efa8677a1"} Jun 09 07:02:39.098228 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.098144 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:02:39.101152 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.101116 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.105893 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.106136 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.106246 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wnhks\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.106409 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.106553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.106576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.106952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 07:02:39.107233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.107067 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 07:02:39.107712 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.107275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 07:02:39.109176 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.107833 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 07:02:39.109176 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.108677 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 07:02:39.109176 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.108986 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 07:02:39.110033 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.110013 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 07:02:39.110202 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.110177 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b9f4vask8f7p4\"" Jun 09 07:02:39.110278 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.110030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 07:02:39.110336 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.110325 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 07:02:39.115159 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.115138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 07:02:39.120537 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.120406 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:02:39.202931 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.202891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203105 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.202942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203105 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203105 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203105 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203105 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203333 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203333 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203333 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203333 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203264 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203333 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-web-config\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203572 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203572 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203572 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config-out\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203572 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203471 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203802 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203802 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203802 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203802 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.203802 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.203751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z828t\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-kube-api-access-z828t\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305040 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.304949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305040 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305040 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305090 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-web-config\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config-out\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z828t\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-kube-api-access-z828t\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.305863 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.306213 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.305976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.306213 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.306059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.307594 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.306518 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.307594 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.306599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.307594 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.307033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.308541 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.308514 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.309343 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.309310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.309530 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.309503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config-out\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.311990 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.311934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.312754 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.312735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.313664 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.313625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.314371 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.314326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.315024 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.314846 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-web-config\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.315024 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.314880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z828t\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-kube-api-access-z828t\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.315024 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.314978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.315234 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.315061 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.315515 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.315489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.316012 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.315990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.316810 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.316788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.317807 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.317781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.421824 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.421780 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:02:39.586129 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.586025 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:02:39.879324 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:02:39.879253 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e51f5b_3cc7_46f9_9535_e357dab1b27b.slice/crio-2e7c992cd98e3996042245b6cfc1a237115fd1e28c493f88e6f128da43e92c98 WatchSource:0}: Error finding container 2e7c992cd98e3996042245b6cfc1a237115fd1e28c493f88e6f128da43e92c98: Status 404 returned error can't find the container with id 2e7c992cd98e3996042245b6cfc1a237115fd1e28c493f88e6f128da43e92c98 Jun 09 07:02:39.891597 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:39.891572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"2e7c992cd98e3996042245b6cfc1a237115fd1e28c493f88e6f128da43e92c98"} Jun 09 07:02:40.896658 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:40.896618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" event={"ID":"0625d9a4-2dcc-4172-9bdf-b5d6de333f77","Type":"ContainerStarted","Data":"73ba26049d51461e0819857685a933d2a865f5fa5373e5847f9a037c7a7c3ff0"} Jun 09 07:02:40.897130 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:40.896787 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:40.898181 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:40.898156 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" exitCode=0 Jun 09 07:02:40.898305 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:40.898239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} Jun 09 07:02:40.901886 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:40.901866 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" Jun 09 07:02:40.911596 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:40.911552 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-27xxv" podStartSLOduration=2.7392576699999998 podStartE2EDuration="3.911540183s" totalImagesPullingTime="1.172282513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:40.910425834 +0000 UTC m=+259.294694792" watchObservedRunningTime="2026-06-09 07:02:40.911540183 +0000 UTC m=+259.295809141" Jun 09 07:02:44.917979 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:44.917945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} Jun 09 07:02:44.918324 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:44.918010 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} Jun 09 07:02:46.927169 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:46.927139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} Jun 09 07:02:46.927622 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:46.927201 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} Jun 09 07:02:46.927622 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:46.927227 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} Jun 09 07:02:46.927622 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:46.927252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerStarted","Data":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} Jun 09 07:02:46.955080 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:46.955040 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.7073310290000001 podStartE2EDuration="7.955026676s" totalImagesPullingTime="6.227209301s" totalInitContainerRuntime="20.486346ms" isStatefulPod=false podCreationTimestamp="2026-06-09 07:02:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:02:46.954464878 +0000 UTC m=+265.338733859" watchObservedRunningTime="2026-06-09 07:02:46.955026676 +0000 UTC m=+265.339295670" Jun 09 07:02:49.422220 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:02:49.422182 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:03.588462 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:03.588424 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" Jun 09 07:03:03.588462 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:03.588454 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-46vqx" podUID="ac5e6519-9520-432b-a416-d02051cc940c" Jun 09 07:03:03.793803 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:03.793780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-27xxv_0625d9a4-2dcc-4172-9bdf-b5d6de333f77/monitoring-plugin/0.log" Jun 09 07:03:03.988621 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:03.988600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46vqx" Jun 09 07:03:03.988805 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:03.988602 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:03:03.993633 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:03.993617 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zglt_124e74d1-cb47-4596-801e-fa3ffa1ab4d3/init-textfile/0.log" Jun 09 07:03:04.194126 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:04.194102 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zglt_124e74d1-cb47-4596-801e-fa3ffa1ab4d3/node-exporter/0.log" Jun 09 07:03:04.393880 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:04.393802 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zglt_124e74d1-cb47-4596-801e-fa3ffa1ab4d3/kube-rbac-proxy/0.log" Jun 09 07:03:05.794501 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:05.794472 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fcxjk_777553d9-01b4-40fa-9ee9-5b55e2cde59b/kube-rbac-proxy-main/0.log" Jun 09 07:03:05.993711 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:05.993684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fcxjk_777553d9-01b4-40fa-9ee9-5b55e2cde59b/kube-rbac-proxy-self/0.log" Jun 09 07:03:06.193662 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.193639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fcxjk_777553d9-01b4-40fa-9ee9-5b55e2cde59b/openshift-state-metrics/0.log" Jun 09 07:03:06.393790 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.393767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/init-config-reloader/0.log" Jun 09 07:03:06.594912 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.594853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/prometheus/0.log" Jun 09 07:03:06.793917 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.793894 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/config-reloader/0.log" Jun 09 07:03:06.940665 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.940642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:03:06.940977 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.940675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 07:03:06.943079 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.943059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac5e6519-9520-432b-a416-d02051cc940c-metrics-tls\") pod \"dns-default-46vqx\" (UID: \"ac5e6519-9520-432b-a416-d02051cc940c\") " pod="openshift-dns/dns-default-46vqx" Jun 09 07:03:06.943172 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.943140 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"image-registry-6d5ff57c48-w5zmq\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:03:06.992672 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.992652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zjr8h\"" Jun 09 07:03:06.992799 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.992654 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4jm8\"" Jun 09 07:03:06.994788 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.994763 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/thanos-sidecar/0.log" Jun 09 07:03:06.999506 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:06.999480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:03:07.001055 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.000860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-46vqx" Jun 09 07:03:07.146871 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.146838 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d5ff57c48-w5zmq"] Jun 09 07:03:07.150184 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:03:07.150157 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58725ca1_2060_49e7_a529_6bedcdfbb66f.slice/crio-b3860be66f74f9ad4dbe38e2733da479d9c5b74381b2198819006dcd97d92eea WatchSource:0}: Error finding container b3860be66f74f9ad4dbe38e2733da479d9c5b74381b2198819006dcd97d92eea: Status 404 returned error can't find the container with id b3860be66f74f9ad4dbe38e2733da479d9c5b74381b2198819006dcd97d92eea Jun 09 07:03:07.163853 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.163829 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-46vqx"] Jun 09 07:03:07.166511 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:03:07.166481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5e6519_9520_432b_a416_d02051cc940c.slice/crio-09e3b6db12e8ca7062ccc2c95862280824aedd88e6b94d695ad8a4669b108041 WatchSource:0}: Error finding container 09e3b6db12e8ca7062ccc2c95862280824aedd88e6b94d695ad8a4669b108041: Status 404 returned error can't find the container with id 09e3b6db12e8ca7062ccc2c95862280824aedd88e6b94d695ad8a4669b108041 Jun 09 07:03:07.194570 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.194525 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/kube-rbac-proxy-web/0.log" Jun 09 07:03:07.395979 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.395945 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/kube-rbac-proxy/0.log" Jun 09 07:03:07.594782 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.594697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_15e51f5b-3cc7-46f9-9535-e357dab1b27b/kube-rbac-proxy-thanos/0.log" Jun 09 07:03:07.795555 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.795523 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pck2r_024d4bea-ae2e-4511-b7da-a74b50421531/prometheus-operator/0.log" Jun 09 07:03:07.993969 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:07.993938 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pck2r_024d4bea-ae2e-4511-b7da-a74b50421531/kube-rbac-proxy/0.log" Jun 09 07:03:08.005788 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:08.005754 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46vqx" event={"ID":"ac5e6519-9520-432b-a416-d02051cc940c","Type":"ContainerStarted","Data":"09e3b6db12e8ca7062ccc2c95862280824aedd88e6b94d695ad8a4669b108041"} Jun 09 07:03:08.007465 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:08.007439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" event={"ID":"58725ca1-2060-49e7-a529-6bedcdfbb66f","Type":"ContainerStarted","Data":"d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511"} Jun 09 07:03:08.007576 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:08.007480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" event={"ID":"58725ca1-2060-49e7-a529-6bedcdfbb66f","Type":"ContainerStarted","Data":"b3860be66f74f9ad4dbe38e2733da479d9c5b74381b2198819006dcd97d92eea"} Jun 09 07:03:08.007643 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:08.007574 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:03:08.194439 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:08.194400 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-ntz8k_916b97f5-deed-48a5-8b97-8534f04a042e/prometheus-operator-admission-webhook/0.log" Jun 09 07:03:09.012167 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:09.012133 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46vqx" event={"ID":"ac5e6519-9520-432b-a416-d02051cc940c","Type":"ContainerStarted","Data":"ad132d7b9ef9c2c5cfab94509d9c131bac3c19741c314b5bdac416f4e6150ba7"} Jun 09 07:03:09.013366 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:09.013346 2563 generic.go:356] "Generic (PLEG): container finished" podID="5d147ec9-eb1c-4142-818c-b4bce264e590" containerID="328fa13630c7956b3005d849f8e046a9b779049fb3a11c18d576486ea8243379" exitCode=0 Jun 09 07:03:09.013462 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:09.013414 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" event={"ID":"5d147ec9-eb1c-4142-818c-b4bce264e590","Type":"ContainerDied","Data":"328fa13630c7956b3005d849f8e046a9b779049fb3a11c18d576486ea8243379"} Jun 09 07:03:09.013846 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:09.013830 2563 scope.go:117] "RemoveContainer" containerID="328fa13630c7956b3005d849f8e046a9b779049fb3a11c18d576486ea8243379" Jun 09 07:03:09.029127 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:09.029081 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" podStartSLOduration=265.0290664 podStartE2EDuration="4m25.0290664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:03:08.029170484 +0000 UTC m=+286.413439445" watchObservedRunningTime="2026-06-09 07:03:09.0290664 +0000 UTC m=+287.413335358" Jun 09 07:03:10.018816 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:10.018780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-46vqx" event={"ID":"ac5e6519-9520-432b-a416-d02051cc940c","Type":"ContainerStarted","Data":"3d715e8042542ee95736042451e7a1ca79da920cb6372e2e7beefeb54bb2f0e1"} Jun 09 07:03:10.019255 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:10.018866 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-46vqx" Jun 09 07:03:10.020655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:10.020634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-vcv4j" event={"ID":"5d147ec9-eb1c-4142-818c-b4bce264e590","Type":"ContainerStarted","Data":"e65230f209fc5c42dbee4c62ceb01e93adc9dcb229d5321c77fcff2dd5e66ed8"} Jun 09 07:03:10.036140 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:10.036099 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-46vqx" podStartSLOduration=252.334722215 podStartE2EDuration="4m14.036087244s" totalImagesPullingTime="1.701365029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 06:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:03:10.034784638 +0000 UTC m=+288.419053611" watchObservedRunningTime="2026-06-09 07:03:10.036087244 +0000 UTC m=+288.420356201" Jun 09 07:03:10.398639 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:10.398601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:03:10.596020 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:10.595989 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/3.log" Jun 09 07:03:11.394439 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:11.394409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46vqx_ac5e6519-9520-432b-a416-d02051cc940c/dns/0.log" Jun 09 07:03:11.594417 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:11.594394 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46vqx_ac5e6519-9520-432b-a416-d02051cc940c/kube-rbac-proxy/0.log" Jun 09 07:03:12.994159 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:12.994130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5p52_e09c4a7b-65be-42fc-b5e1-0694b9348176/dns-node-resolver/0.log" Jun 09 07:03:13.196171 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:13.196143 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d5ff57c48-w5zmq_58725ca1-2060-49e7-a529-6bedcdfbb66f/registry/0.log" Jun 09 07:03:13.794013 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:13.793985 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vzv49_04941328-3a49-46ee-9ef6-d0845e2e2e2b/node-ca/0.log" Jun 09 07:03:14.794078 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:14.794052 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-szm5h_4a494ba6-e26a-4dfe-8209-2fd08ec72d2a/serve-healthcheck-canary/0.log" Jun 09 07:03:20.026187 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:20.026159 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-46vqx" Jun 09 07:03:22.000006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:21.999983 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:03:22.001697 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:22.001677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:03:22.005891 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:22.005867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 07:03:22.007774 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:22.007751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 07:03:22.009927 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:22.009910 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 07:03:27.004712 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:27.004669 2563 patch_prober.go:28] interesting pod/image-registry-6d5ff57c48-w5zmq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 07:03:27.005983 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:27.004769 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 07:03:29.018275 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:29.018246 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:03:39.422151 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:39.422114 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:39.441198 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:39.441175 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:40.150751 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:40.150706 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:48.427007 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:48.426969 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d5ff57c48-w5zmq"] Jun 09 07:03:57.476421 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.476382 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:03:57.477465 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.477407 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="prometheus" containerID="cri-o://1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" gracePeriod=600 Jun 09 07:03:57.477791 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.477736 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy" containerID="cri-o://901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" gracePeriod=600 Jun 09 07:03:57.477904 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.477756 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="thanos-sidecar" containerID="cri-o://b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" gracePeriod=600 Jun 09 07:03:57.477904 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.477736 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-web" containerID="cri-o://d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" gracePeriod=600 Jun 09 07:03:57.478009 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.477934 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="config-reloader" containerID="cri-o://83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" gracePeriod=600 Jun 09 07:03:57.478142 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.478036 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" gracePeriod=600 Jun 09 07:03:57.752643 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.752312 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:57.823107 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823076 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823287 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823129 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z828t\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-kube-api-access-z828t\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823287 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823152 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-metrics-client-certs\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823404 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823338 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-kube-rbac-proxy\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823404 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823386 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823580 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823418 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-tls-assets\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823580 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823452 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-kubelet-serving-ca-bundle\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823580 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823514 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-0\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823580 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823539 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-1\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.823580 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823572 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-grpc-tls\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823604 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-metrics-client-ca\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823630 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-2\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823662 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-db\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823700 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-thanos-prometheus-http-client-file\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823757 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823790 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config-out\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823843 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-trusted-ca-bundle\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823869 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-serving-certs-ca-bundle\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823899 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-web-config\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.824006 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.823928 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-tls\") pod \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\" (UID: \"15e51f5b-3cc7-46f9-9535-e357dab1b27b\") " Jun 09 07:03:57.825272 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.825145 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.825431 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.825434 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.825951 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.826133 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.826371 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826758 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.826674 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:03:57.826997 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.826968 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:03:57.828928 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.828897 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.828928 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.828917 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.829154 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.829128 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config" (OuterVolumeSpecName: "config") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.830315 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.830274 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.830315 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.830278 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-kube-api-access-z828t" (OuterVolumeSpecName: "kube-api-access-z828t") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "kube-api-access-z828t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:03:57.830315 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.830297 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.830512 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.830466 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.830512 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.830495 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:03:57.830611 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.830594 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.831254 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.831224 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.831344 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.831309 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config-out" (OuterVolumeSpecName: "config-out") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:03:57.840583 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.840553 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-web-config" (OuterVolumeSpecName: "web-config") pod "15e51f5b-3cc7-46f9-9535-e357dab1b27b" (UID: "15e51f5b-3cc7-46f9-9535-e357dab1b27b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:03:57.925274 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925237 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925274 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925264 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925274 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925275 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-web-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925285 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925293 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925301 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z828t\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-kube-api-access-z828t\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925311 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-metrics-client-certs\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925320 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-kube-rbac-proxy\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925329 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925338 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/15e51f5b-3cc7-46f9-9535-e357dab1b27b-tls-assets\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925346 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925353 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925361 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925370 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-grpc-tls\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925378 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-configmap-metrics-client-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925385 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925393 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-prometheus-k8s-db\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925401 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925409 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/15e51f5b-3cc7-46f9-9535-e357dab1b27b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:57.925481 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:57.925418 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/15e51f5b-3cc7-46f9-9535-e357dab1b27b-config-out\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:03:58.201433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201387 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" exitCode=0 Jun 09 07:03:58.201433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201414 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" exitCode=0 Jun 09 07:03:58.201433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201420 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" exitCode=0 Jun 09 07:03:58.201433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201427 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" exitCode=0 Jun 09 07:03:58.201433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201434 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" exitCode=0 Jun 09 07:03:58.201433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201441 2563 generic.go:356] "Generic (PLEG): container finished" podID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" exitCode=0 Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201474 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201570 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201645 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201662 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201696 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} Jun 09 07:03:58.201892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.201746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"15e51f5b-3cc7-46f9-9535-e357dab1b27b","Type":"ContainerDied","Data":"2e7c992cd98e3996042245b6cfc1a237115fd1e28c493f88e6f128da43e92c98"} Jun 09 07:03:58.211358 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.211324 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.218784 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.218765 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.223242 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.223219 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:03:58.225974 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.225958 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.228486 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.228467 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:03:58.233197 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.233182 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.239568 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.239549 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.246333 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.246317 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.252878 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.252857 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.253162 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.253135 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.253229 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253171 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} err="failed to get container status \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" Jun 09 07:03:58.253229 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253202 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.253420 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.253403 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.253466 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253424 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} err="failed to get container status \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" Jun 09 07:03:58.253466 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253436 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.253682 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.253665 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.253745 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253688 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} err="failed to get container status \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" Jun 09 07:03:58.253745 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253705 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.253987 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.253969 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.254029 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.253991 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} err="failed to get container status \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" Jun 09 07:03:58.254029 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254005 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.254249 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.254234 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.254289 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254254 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} err="failed to get container status \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" Jun 09 07:03:58.254289 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254267 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.254492 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.254474 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.254531 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254496 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} err="failed to get container status \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" Jun 09 07:03:58.254531 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254510 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.254823 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:03:58.254707 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.254867 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254829 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} err="failed to get container status \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" Jun 09 07:03:58.254867 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.254843 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.255056 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255039 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} err="failed to get container status \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" Jun 09 07:03:58.255096 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255056 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.255280 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255263 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} err="failed to get container status \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" Jun 09 07:03:58.255335 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255280 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.255501 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255484 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} err="failed to get container status \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" Jun 09 07:03:58.255501 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255500 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.255711 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255693 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} err="failed to get container status \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" Jun 09 07:03:58.255776 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255711 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.255968 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255951 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} err="failed to get container status \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" Jun 09 07:03:58.255968 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.255967 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.256154 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256135 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} err="failed to get container status \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" Jun 09 07:03:58.256196 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256154 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.256349 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256324 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} err="failed to get container status \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" Jun 09 07:03:58.256349 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256348 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.256564 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256544 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} err="failed to get container status \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" Jun 09 07:03:58.256604 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256565 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.256761 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256746 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} err="failed to get container status \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" Jun 09 07:03:58.256761 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256760 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.257053 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.256994 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} err="failed to get container status \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" Jun 09 07:03:58.257053 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.257015 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.257587 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.257567 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} err="failed to get container status \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" Jun 09 07:03:58.257654 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.257590 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.257859 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.257830 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} err="failed to get container status \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" Jun 09 07:03:58.257940 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.257859 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.258140 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258115 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} err="failed to get container status \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" Jun 09 07:03:58.258140 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258141 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.258390 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258370 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} err="failed to get container status \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" Jun 09 07:03:58.258462 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258401 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.258659 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258631 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} err="failed to get container status \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" Jun 09 07:03:58.258761 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258662 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.259003 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.258972 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} err="failed to get container status \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" Jun 09 07:03:58.259003 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259001 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.259215 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259196 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:03:58.259302 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259285 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} err="failed to get container status \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" Jun 09 07:03:58.259355 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259303 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.259472 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259458 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-web" Jun 09 07:03:58.259525 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259476 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-web" Jun 09 07:03:58.259525 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259492 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy" Jun 09 07:03:58.259525 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259500 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy" Jun 09 07:03:58.259525 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259512 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="init-config-reloader" Jun 09 07:03:58.259525 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259520 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="init-config-reloader" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259530 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-thanos" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259537 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-thanos" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259532 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} err="failed to get container status \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259554 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259557 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="prometheus" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259567 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="prometheus" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259583 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="thanos-sidecar" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259592 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="thanos-sidecar" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259607 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="config-reloader" Jun 09 07:03:58.259663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259615 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="config-reloader" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259670 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="prometheus" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259682 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="thanos-sidecar" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259693 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-thanos" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259703 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy-web" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259711 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="config-reloader" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259741 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" containerName="kube-rbac-proxy" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259827 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} err="failed to get container status \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" Jun 09 07:03:58.260074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.259846 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.260431 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260084 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} err="failed to get container status \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" Jun 09 07:03:58.260431 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260101 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.260431 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260408 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} err="failed to get container status \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" Jun 09 07:03:58.260431 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260424 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.260659 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260640 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} err="failed to get container status \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" Jun 09 07:03:58.260738 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260661 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.260965 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260945 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} err="failed to get container status \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" Jun 09 07:03:58.261015 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.260966 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.261191 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261174 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} err="failed to get container status \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" Jun 09 07:03:58.261258 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261195 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.261436 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261416 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} err="failed to get container status \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" Jun 09 07:03:58.261477 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261437 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.261652 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261635 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} err="failed to get container status \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" Jun 09 07:03:58.261742 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261654 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.261908 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261889 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} err="failed to get container status \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" Jun 09 07:03:58.261994 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.261911 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.262115 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262099 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} err="failed to get container status \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" Jun 09 07:03:58.262154 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262116 2563 scope.go:117] "RemoveContainer" containerID="d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843" Jun 09 07:03:58.262311 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262292 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843"} err="failed to get container status \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": rpc error: code = NotFound desc = could not find container \"d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843\": container with ID starting with d74713fbdbb0ea9db515c1f382c33aeb5b4f1cf6f0cebe30cbe75f8266d83843 not found: ID does not exist" Jun 09 07:03:58.262378 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262313 2563 scope.go:117] "RemoveContainer" containerID="901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08" Jun 09 07:03:58.262529 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262514 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08"} err="failed to get container status \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": rpc error: code = NotFound desc = could not find container \"901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08\": container with ID starting with 901b25e2e6272c12130ba13d06bff492881ad90e68280fd1df75262302e79e08 not found: ID does not exist" Jun 09 07:03:58.262579 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262529 2563 scope.go:117] "RemoveContainer" containerID="d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc" Jun 09 07:03:58.262712 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262696 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc"} err="failed to get container status \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": rpc error: code = NotFound desc = could not find container \"d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc\": container with ID starting with d8665f771fe95e0c6469cb5aae12d1c376eb01ac644f83edc69da9cf8fd484cc not found: ID does not exist" Jun 09 07:03:58.262712 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262712 2563 scope.go:117] "RemoveContainer" containerID="b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21" Jun 09 07:03:58.262906 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262888 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21"} err="failed to get container status \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": rpc error: code = NotFound desc = could not find container \"b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21\": container with ID starting with b1861f11d0b0fa5c7654a60e8b6d9d5d21ba8b25599956201be9bc088307cd21 not found: ID does not exist" Jun 09 07:03:58.262954 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.262907 2563 scope.go:117] "RemoveContainer" containerID="83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9" Jun 09 07:03:58.263062 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.263047 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9"} err="failed to get container status \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": rpc error: code = NotFound desc = could not find container \"83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9\": container with ID starting with 83ab8f280e1e2414efce36300b8789563726b0ba433c8f6ccb0dc18fd847a7e9 not found: ID does not exist" Jun 09 07:03:58.263103 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.263062 2563 scope.go:117] "RemoveContainer" containerID="1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4" Jun 09 07:03:58.263218 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.263204 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4"} err="failed to get container status \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": rpc error: code = NotFound desc = could not find container \"1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4\": container with ID starting with 1460d6b9c27eebf650c94d8b781697d1ce7f55c55d2b7890f8fe4d699f6374c4 not found: ID does not exist" Jun 09 07:03:58.263267 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.263217 2563 scope.go:117] "RemoveContainer" containerID="5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045" Jun 09 07:03:58.263433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.263416 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045"} err="failed to get container status \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": rpc error: code = NotFound desc = could not find container \"5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045\": container with ID starting with 5c26fae3d7f049a2dc9dd9a7c788cc7b600c3083552289b1021e7fb980ae8045 not found: ID does not exist" Jun 09 07:03:58.266269 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.265300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.268346 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.268327 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wnhks\"" Jun 09 07:03:58.268346 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.268334 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 07:03:58.268487 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.268465 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 07:03:58.268588 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.268570 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b9f4vask8f7p4\"" Jun 09 07:03:58.268672 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.268657 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 07:03:58.269125 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269106 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 07:03:58.269195 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269112 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 07:03:58.269247 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269114 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 07:03:58.269247 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 07:03:58.269386 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269318 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 07:03:58.269467 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269422 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 07:03:58.269467 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269437 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 07:03:58.269656 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 07:03:58.269730 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269642 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 07:03:58.269730 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.269678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 07:03:58.273855 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.273834 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 07:03:58.277043 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.277026 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 07:03:58.285497 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.285473 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:03:58.327284 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327246 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327432 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327432 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327432 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327432 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-web-config\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-config\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c918c8db-525c-4772-bc77-11558d8dc163-config-out\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327607 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327601 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgznq\" (UniqueName: \"kubernetes.io/projected/c918c8db-525c-4772-bc77-11558d8dc163-kube-api-access-fgznq\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c918c8db-525c-4772-bc77-11558d8dc163-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.327973 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.327846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429007 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.428966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-web-config\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-config\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c918c8db-525c-4772-bc77-11558d8dc163-config-out\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429179 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429542 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429520 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429663 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.429897 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.429883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgznq\" (UniqueName: \"kubernetes.io/projected/c918c8db-525c-4772-bc77-11558d8dc163-kube-api-access-fgznq\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430135 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430263 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430386 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430490 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c918c8db-525c-4772-bc77-11558d8dc163-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430588 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430714 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430855 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.430967 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.431058 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.430267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.431136 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.431121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.431738 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.431692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.432281 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.432259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.432553 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.432527 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.432781 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.432764 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.433065 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.433041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.433212 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.433190 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c918c8db-525c-4772-bc77-11558d8dc163-config-out\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.433489 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.433472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.433586 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.433526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-web-config\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.433682 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.433646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.434268 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.434231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.434422 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.434400 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.434483 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.434417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c918c8db-525c-4772-bc77-11558d8dc163-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.434675 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.434638 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.434818 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.434803 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.435018 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.435000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-config\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.435151 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.435137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c918c8db-525c-4772-bc77-11558d8dc163-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.435337 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.435323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c918c8db-525c-4772-bc77-11558d8dc163-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.439948 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.439925 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgznq\" (UniqueName: \"kubernetes.io/projected/c918c8db-525c-4772-bc77-11558d8dc163-kube-api-access-fgznq\") pod \"prometheus-k8s-0\" (UID: \"c918c8db-525c-4772-bc77-11558d8dc163\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.576328 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.576289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:03:58.723433 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:58.723373 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 07:03:58.725594 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:03:58.725567 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc918c8db_525c_4772_bc77_11558d8dc163.slice/crio-1d48b99b1fc03bba2381ddf6ece82e4e65f5b6eb967a63a3694655352279ea0a WatchSource:0}: Error finding container 1d48b99b1fc03bba2381ddf6ece82e4e65f5b6eb967a63a3694655352279ea0a: Status 404 returned error can't find the container with id 1d48b99b1fc03bba2381ddf6ece82e4e65f5b6eb967a63a3694655352279ea0a Jun 09 07:03:59.207529 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:59.207492 2563 generic.go:356] "Generic (PLEG): container finished" podID="c918c8db-525c-4772-bc77-11558d8dc163" containerID="002c264b94fcd6af17cf06c403697d0c845fe3d2282b6d3b9f32b2882cb50cee" exitCode=0 Jun 09 07:03:59.207691 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:59.207556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerDied","Data":"002c264b94fcd6af17cf06c403697d0c845fe3d2282b6d3b9f32b2882cb50cee"} Jun 09 07:03:59.207691 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:03:59.207608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"1d48b99b1fc03bba2381ddf6ece82e4e65f5b6eb967a63a3694655352279ea0a"} Jun 09 07:04:00.080736 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.080697 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e51f5b-3cc7-46f9-9535-e357dab1b27b" path="/var/lib/kubelet/pods/15e51f5b-3cc7-46f9-9535-e357dab1b27b/volumes" Jun 09 07:04:00.214635 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.214603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"e50b5e1cccd1bdb96b959dce8271ea567b114b0539477f9cf541e72749ba6f8c"} Jun 09 07:04:00.214794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.214673 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"c1136c89b6fa76578783fbceb007a496e27c129bbee73b5b1f4391ffacb1dcf3"} Jun 09 07:04:00.214794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.214700 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"05a2da0c621799c7342ba7f5fd4523ffa4f0e3809e3951cde8709b48eed48dad"} Jun 09 07:04:00.214794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.214755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"e140c1337dadfaaa0d555328d69d2de44b96ee1772401e558b28d062f6ebb998"} Jun 09 07:04:00.214794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.214780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"8e5c5efb4061e9cd09a4027c462d8786af812fc53aaa06c1da54758431387a27"} Jun 09 07:04:00.214952 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.214803 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c918c8db-525c-4772-bc77-11558d8dc163","Type":"ContainerStarted","Data":"bf333c3a30bf0f84c481690afde3f4f104b7de00954e9be4828bb55ee50bb04a"} Jun 09 07:04:00.244686 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:00.244636 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.222560326 podStartE2EDuration="2.244620631s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.060305ms" isStatefulPod=false podCreationTimestamp="2026-06-09 07:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:04:00.241976182 +0000 UTC m=+338.626245174" watchObservedRunningTime="2026-06-09 07:04:00.244620631 +0000 UTC m=+338.628889588" Jun 09 07:04:03.576541 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:03.576508 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:04:13.447299 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.447208 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" containerName="registry" containerID="cri-o://d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511" gracePeriod=30 Jun 09 07:04:13.692700 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.692677 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:04:13.759059 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.758988 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-588k6\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-kube-api-access-588k6\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759059 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759039 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-certificates\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759063 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58725ca1-2060-49e7-a529-6bedcdfbb66f-ca-trust-extracted\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759096 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-image-registry-private-configuration\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759161 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759188 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-installation-pull-secrets\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759214 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-bound-sa-token\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759486 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759235 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-trusted-ca\") pod \"58725ca1-2060-49e7-a529-6bedcdfbb66f\" (UID: \"58725ca1-2060-49e7-a529-6bedcdfbb66f\") " Jun 09 07:04:13.759486 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759467 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:04:13.759843 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.759807 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 07:04:13.761814 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.761768 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:04:13.762009 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.761980 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:04:13.762009 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.761994 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-kube-api-access-588k6" (OuterVolumeSpecName: "kube-api-access-588k6") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "kube-api-access-588k6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:04:13.762253 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.762228 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 07:04:13.762382 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.762367 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:04:13.767529 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.767508 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58725ca1-2060-49e7-a529-6bedcdfbb66f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "58725ca1-2060-49e7-a529-6bedcdfbb66f" (UID: "58725ca1-2060-49e7-a529-6bedcdfbb66f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:04:13.860334 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860304 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58725ca1-2060-49e7-a529-6bedcdfbb66f-ca-trust-extracted\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860334 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860329 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-image-registry-private-configuration\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860334 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860340 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-tls\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860545 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860349 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58725ca1-2060-49e7-a529-6bedcdfbb66f-installation-pull-secrets\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860545 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860358 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-bound-sa-token\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860545 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860366 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-trusted-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860545 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860374 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-588k6\" (UniqueName: \"kubernetes.io/projected/58725ca1-2060-49e7-a529-6bedcdfbb66f-kube-api-access-588k6\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:13.860545 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:13.860381 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58725ca1-2060-49e7-a529-6bedcdfbb66f-registry-certificates\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:04:14.269679 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.269649 2563 generic.go:356] "Generic (PLEG): container finished" podID="58725ca1-2060-49e7-a529-6bedcdfbb66f" containerID="d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511" exitCode=0 Jun 09 07:04:14.269840 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.269693 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" Jun 09 07:04:14.269840 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.269731 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" event={"ID":"58725ca1-2060-49e7-a529-6bedcdfbb66f","Type":"ContainerDied","Data":"d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511"} Jun 09 07:04:14.269840 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.269770 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d5ff57c48-w5zmq" event={"ID":"58725ca1-2060-49e7-a529-6bedcdfbb66f","Type":"ContainerDied","Data":"b3860be66f74f9ad4dbe38e2733da479d9c5b74381b2198819006dcd97d92eea"} Jun 09 07:04:14.269840 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.269788 2563 scope.go:117] "RemoveContainer" containerID="d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511" Jun 09 07:04:14.278030 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.278008 2563 scope.go:117] "RemoveContainer" containerID="d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511" Jun 09 07:04:14.278284 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:04:14.278264 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511\": container with ID starting with d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511 not found: ID does not exist" containerID="d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511" Jun 09 07:04:14.278334 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.278292 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511"} err="failed to get container status \"d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511\": rpc error: code = NotFound desc = could not find container \"d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511\": container with ID starting with d50a560d5a978c8f4c81b9d107065d2d738a1e4beb52381f0d1121a0e89fd511 not found: ID does not exist" Jun 09 07:04:14.286624 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.286602 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d5ff57c48-w5zmq"] Jun 09 07:04:14.294454 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:14.294433 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d5ff57c48-w5zmq"] Jun 09 07:04:16.081090 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:16.081058 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" path="/var/lib/kubelet/pods/58725ca1-2060-49e7-a529-6bedcdfbb66f/volumes" Jun 09 07:04:58.577153 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:58.577118 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:04:58.593344 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:58.593319 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:04:59.453296 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:04:59.453262 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 07:05:18.790562 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.790522 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k5thc"] Jun 09 07:05:18.791151 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.790951 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" containerName="registry" Jun 09 07:05:18.791151 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.790968 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" containerName="registry" Jun 09 07:05:18.791151 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.791055 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58725ca1-2060-49e7-a529-6bedcdfbb66f" containerName="registry" Jun 09 07:05:18.794233 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.794212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:18.796454 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.796433 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 07:05:18.796594 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.796573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 07:05:18.797424 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.797410 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-m9q7j\"" Jun 09 07:05:18.802370 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.802346 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k5thc"] Jun 09 07:05:18.845255 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.845225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d67kb\" (UniqueName: \"kubernetes.io/projected/e67a7cfd-0468-454d-be17-3e69c6844a0d-kube-api-access-d67kb\") pod \"cert-manager-webhook-7dc76cbb94-k5thc\" (UID: \"e67a7cfd-0468-454d-be17-3e69c6844a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:18.845255 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.845255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e67a7cfd-0468-454d-be17-3e69c6844a0d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k5thc\" (UID: \"e67a7cfd-0468-454d-be17-3e69c6844a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:18.946550 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.946531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d67kb\" (UniqueName: \"kubernetes.io/projected/e67a7cfd-0468-454d-be17-3e69c6844a0d-kube-api-access-d67kb\") pod \"cert-manager-webhook-7dc76cbb94-k5thc\" (UID: \"e67a7cfd-0468-454d-be17-3e69c6844a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:18.946642 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.946557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e67a7cfd-0468-454d-be17-3e69c6844a0d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k5thc\" (UID: \"e67a7cfd-0468-454d-be17-3e69c6844a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:18.954136 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.954113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e67a7cfd-0468-454d-be17-3e69c6844a0d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-k5thc\" (UID: \"e67a7cfd-0468-454d-be17-3e69c6844a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:18.954215 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:18.954136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d67kb\" (UniqueName: \"kubernetes.io/projected/e67a7cfd-0468-454d-be17-3e69c6844a0d-kube-api-access-d67kb\") pod \"cert-manager-webhook-7dc76cbb94-k5thc\" (UID: \"e67a7cfd-0468-454d-be17-3e69c6844a0d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:19.115074 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:19.115012 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:19.242348 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:19.242324 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-k5thc"] Jun 09 07:05:19.245037 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:05:19.245010 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode67a7cfd_0468_454d_be17_3e69c6844a0d.slice/crio-8160cf9dcc8426110798ce827e585daf3dc9888b8d7fbf605cea65b51253e00a WatchSource:0}: Error finding container 8160cf9dcc8426110798ce827e585daf3dc9888b8d7fbf605cea65b51253e00a: Status 404 returned error can't find the container with id 8160cf9dcc8426110798ce827e585daf3dc9888b8d7fbf605cea65b51253e00a Jun 09 07:05:19.247500 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:19.247480 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 07:05:19.510124 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:19.510094 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" event={"ID":"e67a7cfd-0468-454d-be17-3e69c6844a0d","Type":"ContainerStarted","Data":"8160cf9dcc8426110798ce827e585daf3dc9888b8d7fbf605cea65b51253e00a"} Jun 09 07:05:22.524523 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:22.524489 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" event={"ID":"e67a7cfd-0468-454d-be17-3e69c6844a0d","Type":"ContainerStarted","Data":"990d3baf5648bc1156360963b2e2f8e7d1c75f868e6864cbc2e54f4f44c61bfc"} Jun 09 07:05:22.524992 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:22.524603 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:22.541073 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:22.541030 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" podStartSLOduration=1.483211595 podStartE2EDuration="4.541015311s" totalImagesPullingTime="3.057803716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:05:22.539448635 +0000 UTC m=+420.923717593" watchObservedRunningTime="2026-06-09 07:05:22.541015311 +0000 UTC m=+420.925284269" Jun 09 07:05:23.583814 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.583776 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-6skpk"] Jun 09 07:05:23.587104 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.587079 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.589351 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.589328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vhkw6\"" Jun 09 07:05:23.595804 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.595783 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-6skpk"] Jun 09 07:05:23.686583 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.686556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbdc\" (UniqueName: \"kubernetes.io/projected/3690bf0f-e8cf-4715-9a9e-6633ab04a413-kube-api-access-8lbdc\") pod \"cert-manager-cainjector-5d99449ffd-6skpk\" (UID: \"3690bf0f-e8cf-4715-9a9e-6633ab04a413\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.686714 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.686598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3690bf0f-e8cf-4715-9a9e-6633ab04a413-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-6skpk\" (UID: \"3690bf0f-e8cf-4715-9a9e-6633ab04a413\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.787905 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.787875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3690bf0f-e8cf-4715-9a9e-6633ab04a413-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-6skpk\" (UID: \"3690bf0f-e8cf-4715-9a9e-6633ab04a413\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.788032 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.787930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbdc\" (UniqueName: \"kubernetes.io/projected/3690bf0f-e8cf-4715-9a9e-6633ab04a413-kube-api-access-8lbdc\") pod \"cert-manager-cainjector-5d99449ffd-6skpk\" (UID: \"3690bf0f-e8cf-4715-9a9e-6633ab04a413\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.796384 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.796356 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3690bf0f-e8cf-4715-9a9e-6633ab04a413-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-6skpk\" (UID: \"3690bf0f-e8cf-4715-9a9e-6633ab04a413\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.796654 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.796633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbdc\" (UniqueName: \"kubernetes.io/projected/3690bf0f-e8cf-4715-9a9e-6633ab04a413-kube-api-access-8lbdc\") pod \"cert-manager-cainjector-5d99449ffd-6skpk\" (UID: \"3690bf0f-e8cf-4715-9a9e-6633ab04a413\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:23.895837 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:23.895784 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" Jun 09 07:05:24.021016 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:24.020991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-6skpk"] Jun 09 07:05:24.023255 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:05:24.023230 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3690bf0f_e8cf_4715_9a9e_6633ab04a413.slice/crio-2694f2b0ccfd0fca55413cad0422b7c1879ac7ccaf6f1978a882d964343b1a7f WatchSource:0}: Error finding container 2694f2b0ccfd0fca55413cad0422b7c1879ac7ccaf6f1978a882d964343b1a7f: Status 404 returned error can't find the container with id 2694f2b0ccfd0fca55413cad0422b7c1879ac7ccaf6f1978a882d964343b1a7f Jun 09 07:05:24.534140 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:24.534095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" event={"ID":"3690bf0f-e8cf-4715-9a9e-6633ab04a413","Type":"ContainerStarted","Data":"871a97dea0b26a11452ac012603ea22321fac0d8fc01923ba40ac5fcf77930ea"} Jun 09 07:05:24.534140 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:24.534146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" event={"ID":"3690bf0f-e8cf-4715-9a9e-6633ab04a413","Type":"ContainerStarted","Data":"2694f2b0ccfd0fca55413cad0422b7c1879ac7ccaf6f1978a882d964343b1a7f"} Jun 09 07:05:24.551214 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:24.551169 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-6skpk" podStartSLOduration=1.551153512 podStartE2EDuration="1.551153512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:05:24.549536884 +0000 UTC m=+422.933805838" watchObservedRunningTime="2026-06-09 07:05:24.551153512 +0000 UTC m=+422.935422470" Jun 09 07:05:28.530918 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:28.530890 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-k5thc" Jun 09 07:05:45.683574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.683502 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56"] Jun 09 07:05:45.687010 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.686993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.694909 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.694886 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 07:05:45.695021 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.694910 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 07:05:45.695021 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.694971 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 07:05:45.695140 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.695058 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h92lg\"" Jun 09 07:05:45.697010 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.696993 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 07:05:45.711861 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.711839 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56"] Jun 09 07:05:45.756034 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.756005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlkx2\" (UniqueName: \"kubernetes.io/projected/64d57e01-05e9-498c-a7e2-0183a65b1ee2-kube-api-access-tlkx2\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.756146 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.756101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d57e01-05e9-498c-a7e2-0183a65b1ee2-webhook-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.756146 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.756134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64d57e01-05e9-498c-a7e2-0183a65b1ee2-manifests\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.756228 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.756163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64d57e01-05e9-498c-a7e2-0183a65b1ee2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.756228 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.756196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64d57e01-05e9-498c-a7e2-0183a65b1ee2-tmp\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.856640 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.856613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d57e01-05e9-498c-a7e2-0183a65b1ee2-webhook-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.856760 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.856648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64d57e01-05e9-498c-a7e2-0183a65b1ee2-manifests\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.856760 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.856670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64d57e01-05e9-498c-a7e2-0183a65b1ee2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.856849 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.856794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64d57e01-05e9-498c-a7e2-0183a65b1ee2-tmp\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.856849 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.856839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlkx2\" (UniqueName: \"kubernetes.io/projected/64d57e01-05e9-498c-a7e2-0183a65b1ee2-kube-api-access-tlkx2\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.857166 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.857143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/64d57e01-05e9-498c-a7e2-0183a65b1ee2-manifests\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.859069 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.859046 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64d57e01-05e9-498c-a7e2-0183a65b1ee2-tmp\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.859261 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.859245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/64d57e01-05e9-498c-a7e2-0183a65b1ee2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.859396 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.859378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d57e01-05e9-498c-a7e2-0183a65b1ee2-webhook-cert\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.871066 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.871040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlkx2\" (UniqueName: \"kubernetes.io/projected/64d57e01-05e9-498c-a7e2-0183a65b1ee2-kube-api-access-tlkx2\") pod \"opendatahub-operator-controller-manager-579b94c545-drm56\" (UID: \"64d57e01-05e9-498c-a7e2-0183a65b1ee2\") " pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:45.997539 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:45.997481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:46.155108 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:46.155072 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56"] Jun 09 07:05:46.158604 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:05:46.158573 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d57e01_05e9_498c_a7e2_0183a65b1ee2.slice/crio-8a5fd4b45abec61d820b869bcda5d9f12451d1cfd639fc66c8ba7f64dd60cf68 WatchSource:0}: Error finding container 8a5fd4b45abec61d820b869bcda5d9f12451d1cfd639fc66c8ba7f64dd60cf68: Status 404 returned error can't find the container with id 8a5fd4b45abec61d820b869bcda5d9f12451d1cfd639fc66c8ba7f64dd60cf68 Jun 09 07:05:46.617126 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:46.617092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" event={"ID":"64d57e01-05e9-498c-a7e2-0183a65b1ee2","Type":"ContainerStarted","Data":"8a5fd4b45abec61d820b869bcda5d9f12451d1cfd639fc66c8ba7f64dd60cf68"} Jun 09 07:05:49.630030 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:49.630003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" event={"ID":"64d57e01-05e9-498c-a7e2-0183a65b1ee2","Type":"ContainerStarted","Data":"454e9d25db46b7ef1e1b9c4ca2804e2e86a28c09bed546180e3e90ea57a26ee6"} Jun 09 07:05:50.635290 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:50.635257 2563 generic.go:356] "Generic (PLEG): container finished" podID="64d57e01-05e9-498c-a7e2-0183a65b1ee2" containerID="454e9d25db46b7ef1e1b9c4ca2804e2e86a28c09bed546180e3e90ea57a26ee6" exitCode=0 Jun 09 07:05:50.635666 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:50.635315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" event={"ID":"64d57e01-05e9-498c-a7e2-0183a65b1ee2","Type":"ContainerDied","Data":"454e9d25db46b7ef1e1b9c4ca2804e2e86a28c09bed546180e3e90ea57a26ee6"} Jun 09 07:05:51.641470 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:51.641431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" event={"ID":"64d57e01-05e9-498c-a7e2-0183a65b1ee2","Type":"ContainerStarted","Data":"4c767974660e79c01ec9f10aab099ea0772362a0e33c5def19288e216f5fe4ea"} Jun 09 07:05:51.641864 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:51.641677 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:05:51.662822 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:05:51.662773 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" podStartSLOduration=2.591658571 podStartE2EDuration="6.662758893s" totalImagesPullingTime="3.089524511s" totalInitContainerRuntime="981.575811ms" isStatefulPod=false podCreationTimestamp="2026-06-09 07:05:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:05:51.660635518 +0000 UTC m=+450.044904477" watchObservedRunningTime="2026-06-09 07:05:51.662758893 +0000 UTC m=+450.047027850" Jun 09 07:06:02.647238 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:02.647205 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-579b94c545-drm56" Jun 09 07:06:04.262960 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.262926 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9"] Jun 09 07:06:04.272072 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.272050 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.274711 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.274691 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 07:06:04.275442 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.275426 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 07:06:04.275685 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.275667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:06:04.275799 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.275696 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 07:06:04.275799 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.275674 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g9bbb\"" Jun 09 07:06:04.276021 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.276005 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 07:06:04.288978 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.288956 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9"] Jun 09 07:06:04.400957 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.400919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06a02b51-287c-482d-ae75-ad874fef2db8-metrics-cert\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.400957 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.400956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpq7\" (UniqueName: \"kubernetes.io/projected/06a02b51-287c-482d-ae75-ad874fef2db8-kube-api-access-jnpq7\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.401147 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.400976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06a02b51-287c-482d-ae75-ad874fef2db8-manager-config\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.401147 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.401092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a02b51-287c-482d-ae75-ad874fef2db8-cert\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.502301 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.502267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a02b51-287c-482d-ae75-ad874fef2db8-cert\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.502462 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.502320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06a02b51-287c-482d-ae75-ad874fef2db8-metrics-cert\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.502462 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.502336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpq7\" (UniqueName: \"kubernetes.io/projected/06a02b51-287c-482d-ae75-ad874fef2db8-kube-api-access-jnpq7\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.502462 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.502353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06a02b51-287c-482d-ae75-ad874fef2db8-manager-config\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.503083 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.503046 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/06a02b51-287c-482d-ae75-ad874fef2db8-manager-config\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.504806 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.504790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/06a02b51-287c-482d-ae75-ad874fef2db8-metrics-cert\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.504922 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.504905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06a02b51-287c-482d-ae75-ad874fef2db8-cert\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.524936 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.524885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpq7\" (UniqueName: \"kubernetes.io/projected/06a02b51-287c-482d-ae75-ad874fef2db8-kube-api-access-jnpq7\") pod \"lws-controller-manager-d96c9b794-ml2n9\" (UID: \"06a02b51-287c-482d-ae75-ad874fef2db8\") " pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.580557 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.580532 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:04.736066 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:04.736003 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9"] Jun 09 07:06:04.738958 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:06:04.738927 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a02b51_287c_482d_ae75_ad874fef2db8.slice/crio-24e908be840bdf1712ed09baa26d21dc7748df9f9a4a419213bc6548b6810819 WatchSource:0}: Error finding container 24e908be840bdf1712ed09baa26d21dc7748df9f9a4a419213bc6548b6810819: Status 404 returned error can't find the container with id 24e908be840bdf1712ed09baa26d21dc7748df9f9a4a419213bc6548b6810819 Jun 09 07:06:05.696917 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:05.696875 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" event={"ID":"06a02b51-287c-482d-ae75-ad874fef2db8","Type":"ContainerStarted","Data":"24e908be840bdf1712ed09baa26d21dc7748df9f9a4a419213bc6548b6810819"} Jun 09 07:06:06.325144 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.325106 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn"] Jun 09 07:06:06.334167 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.334142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.337745 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.337667 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 07:06:06.337745 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.337708 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 07:06:06.337924 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.337751 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p4vm2\"" Jun 09 07:06:06.337924 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.337773 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 07:06:06.337924 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.337667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 07:06:06.343945 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.343917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn"] Jun 09 07:06:06.522438 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.522405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472ef781-33b7-478b-bc16-e2fbfb790f68-tls-certs\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.522438 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.522441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/472ef781-33b7-478b-bc16-e2fbfb790f68-tmp\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.522658 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.522513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbgb\" (UniqueName: \"kubernetes.io/projected/472ef781-33b7-478b-bc16-e2fbfb790f68-kube-api-access-wnbgb\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.623830 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.623739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472ef781-33b7-478b-bc16-e2fbfb790f68-tls-certs\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.623830 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.623779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/472ef781-33b7-478b-bc16-e2fbfb790f68-tmp\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.624056 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.623937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbgb\" (UniqueName: \"kubernetes.io/projected/472ef781-33b7-478b-bc16-e2fbfb790f68-kube-api-access-wnbgb\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.626535 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.626505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/472ef781-33b7-478b-bc16-e2fbfb790f68-tmp\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.626680 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.626594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/472ef781-33b7-478b-bc16-e2fbfb790f68-tls-certs\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.641027 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.641000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbgb\" (UniqueName: \"kubernetes.io/projected/472ef781-33b7-478b-bc16-e2fbfb790f68-kube-api-access-wnbgb\") pod \"kube-auth-proxy-757b5997cf-q7bmn\" (UID: \"472ef781-33b7-478b-bc16-e2fbfb790f68\") " pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:06.647668 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:06.647645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" Jun 09 07:06:07.278099 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:07.278028 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn"] Jun 09 07:06:07.280031 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:06:07.279999 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472ef781_33b7_478b_bc16_e2fbfb790f68.slice/crio-2ee95903810f14b4f7d2b5a5ac65680b7a0db00b2d2c3a5ffbd76f55009865b7 WatchSource:0}: Error finding container 2ee95903810f14b4f7d2b5a5ac65680b7a0db00b2d2c3a5ffbd76f55009865b7: Status 404 returned error can't find the container with id 2ee95903810f14b4f7d2b5a5ac65680b7a0db00b2d2c3a5ffbd76f55009865b7 Jun 09 07:06:07.712352 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:07.712315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" event={"ID":"472ef781-33b7-478b-bc16-e2fbfb790f68","Type":"ContainerStarted","Data":"2ee95903810f14b4f7d2b5a5ac65680b7a0db00b2d2c3a5ffbd76f55009865b7"} Jun 09 07:06:07.714881 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:07.714848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" event={"ID":"06a02b51-287c-482d-ae75-ad874fef2db8","Type":"ContainerStarted","Data":"d2c1fd667b2cc67cbf462e0665e3115cd57b54d5c67a710cb009a70ab31c9ce3"} Jun 09 07:06:07.715300 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:07.715273 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:06:07.764001 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:07.763950 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" podStartSLOduration=1.286578321 podStartE2EDuration="3.763935909s" totalImagesPullingTime="2.477357588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:06:07.76237151 +0000 UTC m=+466.146640468" watchObservedRunningTime="2026-06-09 07:06:07.763935909 +0000 UTC m=+466.148204866" Jun 09 07:06:10.732276 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:10.732239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" event={"ID":"472ef781-33b7-478b-bc16-e2fbfb790f68","Type":"ContainerStarted","Data":"2cd7622cc9eec47b5e7e1a41342d1cb9660243bc45155195aea9497b32e350b4"} Jun 09 07:06:10.752914 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:10.752867 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-757b5997cf-q7bmn" podStartSLOduration=2.041760251 podStartE2EDuration="4.75285166s" totalImagesPullingTime="2.711091409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:06:10.751997442 +0000 UTC m=+469.136266400" watchObservedRunningTime="2026-06-09 07:06:10.75285166 +0000 UTC m=+469.137120679" Jun 09 07:06:18.722414 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:06:18.722379 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d96c9b794-ml2n9" Jun 09 07:07:40.083664 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.083627 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t"] Jun 09 07:07:40.085693 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.085676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:07:40.088804 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.088780 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 07:07:40.088950 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.088821 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 07:07:40.089761 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.089742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8cnhd\"" Jun 09 07:07:40.089826 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.089781 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 07:07:40.104223 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.104195 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t"] Jun 09 07:07:40.160552 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.160508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltbf\" (UniqueName: \"kubernetes.io/projected/a2beb80f-11ea-4091-87ce-8830aa4273a8-kube-api-access-5ltbf\") pod \"dns-operator-controller-manager-864dd78c4c-s944t\" (UID: \"a2beb80f-11ea-4091-87ce-8830aa4273a8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:07:40.266533 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.266492 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltbf\" (UniqueName: \"kubernetes.io/projected/a2beb80f-11ea-4091-87ce-8830aa4273a8-kube-api-access-5ltbf\") pod \"dns-operator-controller-manager-864dd78c4c-s944t\" (UID: \"a2beb80f-11ea-4091-87ce-8830aa4273a8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:07:40.275738 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.275692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltbf\" (UniqueName: \"kubernetes.io/projected/a2beb80f-11ea-4091-87ce-8830aa4273a8-kube-api-access-5ltbf\") pod \"dns-operator-controller-manager-864dd78c4c-s944t\" (UID: \"a2beb80f-11ea-4091-87ce-8830aa4273a8\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:07:40.396132 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.396103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:07:40.536669 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:40.536641 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t"] Jun 09 07:07:40.540668 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:07:40.540634 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2beb80f_11ea_4091_87ce_8830aa4273a8.slice/crio-e2879e99c6f400db533f161cf3601af7d84c559e2ed813d56445feecdec843c6 WatchSource:0}: Error finding container e2879e99c6f400db533f161cf3601af7d84c559e2ed813d56445feecdec843c6: Status 404 returned error can't find the container with id e2879e99c6f400db533f161cf3601af7d84c559e2ed813d56445feecdec843c6 Jun 09 07:07:41.095485 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:41.095450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" event={"ID":"a2beb80f-11ea-4091-87ce-8830aa4273a8","Type":"ContainerStarted","Data":"e2879e99c6f400db533f161cf3601af7d84c559e2ed813d56445feecdec843c6"} Jun 09 07:07:44.110738 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.110687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" event={"ID":"a2beb80f-11ea-4091-87ce-8830aa4273a8","Type":"ContainerStarted","Data":"d8e459fb7f748ecbfd0dabbf1e25990e4112a5872c1fc11c7abcfce9eb6d56fd"} Jun 09 07:07:44.111159 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.110768 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:07:44.128636 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.128575 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" podStartSLOduration=1.189219657 podStartE2EDuration="4.128552363s" totalImagesPullingTime="2.939332706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:07:44.128193636 +0000 UTC m=+562.512462593" watchObservedRunningTime="2026-06-09 07:07:44.128552363 +0000 UTC m=+562.512821321" Jun 09 07:07:44.554311 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.554273 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5"] Jun 09 07:07:44.556592 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.556576 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.559227 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.559210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bldc7\"" Jun 09 07:07:44.569277 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.569251 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5"] Jun 09 07:07:44.606282 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.606240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.606456 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.606300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c669h\" (UniqueName: \"kubernetes.io/projected/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-kube-api-access-c669h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.707283 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.707241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.707456 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.707294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c669h\" (UniqueName: \"kubernetes.io/projected/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-kube-api-access-c669h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.707662 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.707638 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.722845 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.722809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c669h\" (UniqueName: \"kubernetes.io/projected/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-kube-api-access-c669h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:44.865611 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:44.865514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:45.002212 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:45.002165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5"] Jun 09 07:07:45.004655 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:07:45.004624 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47f7f77_1538_4ec8_b6ab_b7df5091bd1b.slice/crio-df4b62c01d6909c61629da45494837f085a49447cb55549a51836f12a0e303db WatchSource:0}: Error finding container df4b62c01d6909c61629da45494837f085a49447cb55549a51836f12a0e303db: Status 404 returned error can't find the container with id df4b62c01d6909c61629da45494837f085a49447cb55549a51836f12a0e303db Jun 09 07:07:45.116613 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:45.116521 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" event={"ID":"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b","Type":"ContainerStarted","Data":"df4b62c01d6909c61629da45494837f085a49447cb55549a51836f12a0e303db"} Jun 09 07:07:54.158258 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:54.158218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" event={"ID":"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b","Type":"ContainerStarted","Data":"cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723"} Jun 09 07:07:54.158690 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:54.158349 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:07:54.190304 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:54.190252 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" podStartSLOduration=1.6108913839999999 podStartE2EDuration="10.190234224s" totalImagesPullingTime="8.57934284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:07:54.189888506 +0000 UTC m=+572.574157464" watchObservedRunningTime="2026-06-09 07:07:54.190234224 +0000 UTC m=+572.574503182" Jun 09 07:07:55.119214 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:07:55.119179 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s944t" Jun 09 07:08:05.166009 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:05.165974 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:06.908550 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.908513 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5"] Jun 09 07:08:06.909022 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.908692 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" containerName="manager" containerID="cri-o://cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723" gracePeriod=2 Jun 09 07:08:06.925443 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.925370 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5"] Jun 09 07:08:06.926508 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:06.926477 2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lgms5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:06.931091 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.931069 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f"] Jun 09 07:08:06.931377 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.931364 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" containerName="manager" Jun 09 07:08:06.931417 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.931378 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" containerName="manager" Jun 09 07:08:06.931450 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.931438 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" containerName="manager" Jun 09 07:08:06.933356 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.933336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:06.951803 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:06.951775 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f"] Jun 09 07:08:06.975108 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:06.975077 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" is forbidden: User \"system:node:ip-10-0-134-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-45.ec2.internal' and this object" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:07.102250 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.102218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b248f\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.102395 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.102267 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-kube-api-access-trcz7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b248f\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.142430 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.142407 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:07.144438 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:07.144415 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" is forbidden: User \"system:node:ip-10-0-134-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-45.ec2.internal' and this object" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:07.203073 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.202994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b248f\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.203073 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.203042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-kube-api-access-trcz7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b248f\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.203458 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.203435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b248f\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.211517 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.211494 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-kube-api-access-trcz7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b248f\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.212792 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.212765 2563 generic.go:356] "Generic (PLEG): container finished" podID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" containerID="cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723" exitCode=0 Jun 09 07:08:07.212892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.212799 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:07.212892 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.212866 2563 scope.go:117] "RemoveContainer" containerID="cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723" Jun 09 07:08:07.216388 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:07.216363 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" is forbidden: User \"system:node:ip-10-0-134-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-45.ec2.internal' and this object" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:07.222300 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.222283 2563 scope.go:117] "RemoveContainer" containerID="cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723" Jun 09 07:08:07.222554 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:07.222534 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723\": container with ID starting with cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723 not found: ID does not exist" containerID="cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723" Jun 09 07:08:07.222624 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.222560 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723"} err="failed to get container status \"cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723\": rpc error: code = NotFound desc = could not find container \"cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723\": container with ID starting with cf10a43ea4d3215ee16ecabee5069ab4222c17af37ac48fba5cf57858a5ec723 not found: ID does not exist" Jun 09 07:08:07.278575 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.278543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:07.304050 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.304023 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-extensions-socket-volume\") pod \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " Jun 09 07:08:07.304174 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.304073 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c669h\" (UniqueName: \"kubernetes.io/projected/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-kube-api-access-c669h\") pod \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\" (UID: \"b47f7f77-1538-4ec8-b6ab-b7df5091bd1b\") " Jun 09 07:08:07.304492 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.304466 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" (UID: "b47f7f77-1538-4ec8-b6ab-b7df5091bd1b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:08:07.306317 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.306296 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-kube-api-access-c669h" (OuterVolumeSpecName: "kube-api-access-c669h") pod "b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" (UID: "b47f7f77-1538-4ec8-b6ab-b7df5091bd1b"). InnerVolumeSpecName "kube-api-access-c669h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:08:07.405640 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.405609 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-extensions-socket-volume\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:08:07.405640 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.405639 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c669h\" (UniqueName: \"kubernetes.io/projected/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b-kube-api-access-c669h\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:08:07.419016 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:07.418980 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f"] Jun 09 07:08:07.421575 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:08:07.421545 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc3cf2b_7563_4888_b13e_2c6e589a11d7.slice/crio-f64d49f672108cd86ff34b25d37b0347b947b6ff28d85d1228debb5cd6999157 WatchSource:0}: Error finding container f64d49f672108cd86ff34b25d37b0347b947b6ff28d85d1228debb5cd6999157: Status 404 returned error can't find the container with id f64d49f672108cd86ff34b25d37b0347b947b6ff28d85d1228debb5cd6999157 Jun 09 07:08:07.523856 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:07.523825 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgms5\" is forbidden: User \"system:node:ip-10-0-134-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-45.ec2.internal' and this object" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgms5" Jun 09 07:08:08.081533 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:08.081495 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b47f7f77-1538-4ec8-b6ab-b7df5091bd1b" path="/var/lib/kubelet/pods/b47f7f77-1538-4ec8-b6ab-b7df5091bd1b/volumes" Jun 09 07:08:08.218776 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:08.218649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" event={"ID":"1bc3cf2b-7563-4888-b13e-2c6e589a11d7","Type":"ContainerStarted","Data":"0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9"} Jun 09 07:08:08.218776 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:08.218708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" event={"ID":"1bc3cf2b-7563-4888-b13e-2c6e589a11d7","Type":"ContainerStarted","Data":"f64d49f672108cd86ff34b25d37b0347b947b6ff28d85d1228debb5cd6999157"} Jun 09 07:08:08.218776 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:08.218750 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:08.238491 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:08.238438 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" podStartSLOduration=2.238418233 podStartE2EDuration="2.238418233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:08.237992877 +0000 UTC m=+586.622261835" watchObservedRunningTime="2026-06-09 07:08:08.238418233 +0000 UTC m=+586.622687192" Jun 09 07:08:19.226098 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:19.226069 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:22.027712 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:22.027682 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:08:22.028957 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:22.028935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:08:22.034520 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:22.034499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 07:08:22.035815 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:22.035796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 07:08:23.703206 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:23.703171 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f"] Jun 09 07:08:23.703635 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:23.703378 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" podUID="1bc3cf2b-7563-4888-b13e-2c6e589a11d7" containerName="manager" containerID="cri-o://0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9" gracePeriod=10 Jun 09 07:08:23.926214 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:23.926180 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw"] Jun 09 07:08:23.930959 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:23.930943 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:23.941084 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:23.941060 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw"] Jun 09 07:08:24.038480 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.038396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd6vw\" (UniqueName: \"kubernetes.io/projected/04480748-0f8d-44b9-ab6a-484bce9f21a7-kube-api-access-rd6vw\") pod \"kuadrant-operator-controller-manager-86878c769f-vxtxw\" (UID: \"04480748-0f8d-44b9-ab6a-484bce9f21a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.038480 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.038443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04480748-0f8d-44b9-ab6a-484bce9f21a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vxtxw\" (UID: \"04480748-0f8d-44b9-ab6a-484bce9f21a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.139205 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.139168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd6vw\" (UniqueName: \"kubernetes.io/projected/04480748-0f8d-44b9-ab6a-484bce9f21a7-kube-api-access-rd6vw\") pod \"kuadrant-operator-controller-manager-86878c769f-vxtxw\" (UID: \"04480748-0f8d-44b9-ab6a-484bce9f21a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.139378 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.139227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04480748-0f8d-44b9-ab6a-484bce9f21a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vxtxw\" (UID: \"04480748-0f8d-44b9-ab6a-484bce9f21a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.139580 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.139562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04480748-0f8d-44b9-ab6a-484bce9f21a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vxtxw\" (UID: \"04480748-0f8d-44b9-ab6a-484bce9f21a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.153603 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.153580 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd6vw\" (UniqueName: \"kubernetes.io/projected/04480748-0f8d-44b9-ab6a-484bce9f21a7-kube-api-access-rd6vw\") pod \"kuadrant-operator-controller-manager-86878c769f-vxtxw\" (UID: \"04480748-0f8d-44b9-ab6a-484bce9f21a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.241378 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.241337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:24.381583 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.381503 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw"] Jun 09 07:08:24.387821 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:08:24.387793 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04480748_0f8d_44b9_ab6a_484bce9f21a7.slice/crio-ee7a7bbde70affee08fff0549db14d6884c9a3661e8db39f97b3b704a14edb05 WatchSource:0}: Error finding container ee7a7bbde70affee08fff0549db14d6884c9a3661e8db39f97b3b704a14edb05: Status 404 returned error can't find the container with id ee7a7bbde70affee08fff0549db14d6884c9a3661e8db39f97b3b704a14edb05 Jun 09 07:08:24.442332 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.442311 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:24.542626 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.542546 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-extensions-socket-volume\") pod \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " Jun 09 07:08:24.542626 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.542606 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-kube-api-access-trcz7\") pod \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\" (UID: \"1bc3cf2b-7563-4888-b13e-2c6e589a11d7\") " Jun 09 07:08:24.542966 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.542939 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1bc3cf2b-7563-4888-b13e-2c6e589a11d7" (UID: "1bc3cf2b-7563-4888-b13e-2c6e589a11d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 07:08:24.544741 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.544701 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-kube-api-access-trcz7" (OuterVolumeSpecName: "kube-api-access-trcz7") pod "1bc3cf2b-7563-4888-b13e-2c6e589a11d7" (UID: "1bc3cf2b-7563-4888-b13e-2c6e589a11d7"). InnerVolumeSpecName "kube-api-access-trcz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:08:24.643935 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.643897 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trcz7\" (UniqueName: \"kubernetes.io/projected/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-kube-api-access-trcz7\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:08:24.643935 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:24.643927 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bc3cf2b-7563-4888-b13e-2c6e589a11d7-extensions-socket-volume\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:08:25.295156 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.295121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" event={"ID":"04480748-0f8d-44b9-ab6a-484bce9f21a7","Type":"ContainerStarted","Data":"254da4cee333e06aaf6c6fca7e7c8fc14f5fc69d4c1954e5403777eb4c8cfb29"} Jun 09 07:08:25.295598 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.295178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" event={"ID":"04480748-0f8d-44b9-ab6a-484bce9f21a7","Type":"ContainerStarted","Data":"ee7a7bbde70affee08fff0549db14d6884c9a3661e8db39f97b3b704a14edb05"} Jun 09 07:08:25.295598 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.295238 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:25.296557 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.296536 2563 generic.go:356] "Generic (PLEG): container finished" podID="1bc3cf2b-7563-4888-b13e-2c6e589a11d7" containerID="0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9" exitCode=0 Jun 09 07:08:25.296659 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.296567 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" event={"ID":"1bc3cf2b-7563-4888-b13e-2c6e589a11d7","Type":"ContainerDied","Data":"0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9"} Jun 09 07:08:25.296659 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.296594 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" event={"ID":"1bc3cf2b-7563-4888-b13e-2c6e589a11d7","Type":"ContainerDied","Data":"f64d49f672108cd86ff34b25d37b0347b947b6ff28d85d1228debb5cd6999157"} Jun 09 07:08:25.296659 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.296569 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f" Jun 09 07:08:25.296659 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.296615 2563 scope.go:117] "RemoveContainer" containerID="0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9" Jun 09 07:08:25.306052 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.306036 2563 scope.go:117] "RemoveContainer" containerID="0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9" Jun 09 07:08:25.306321 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:25.306305 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9\": container with ID starting with 0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9 not found: ID does not exist" containerID="0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9" Jun 09 07:08:25.306370 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.306327 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9"} err="failed to get container status \"0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9\": rpc error: code = NotFound desc = could not find container \"0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9\": container with ID starting with 0965f2e2f43c5860846f08c2dd6cc1f86b310cdae3b7582d9e0531ac34bddde9 not found: ID does not exist" Jun 09 07:08:25.337954 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.337897 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" podStartSLOduration=2.337878149 podStartE2EDuration="2.337878149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:25.336434071 +0000 UTC m=+603.720703052" watchObservedRunningTime="2026-06-09 07:08:25.337878149 +0000 UTC m=+603.722147111" Jun 09 07:08:25.355097 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.355066 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f"] Jun 09 07:08:25.359199 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:25.359179 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b248f"] Jun 09 07:08:26.081695 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:26.081660 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc3cf2b-7563-4888-b13e-2c6e589a11d7" path="/var/lib/kubelet/pods/1bc3cf2b-7563-4888-b13e-2c6e589a11d7/volumes" Jun 09 07:08:36.304435 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:36.304400 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vxtxw" Jun 09 07:08:44.895287 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.895253 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:08:44.895655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.895550 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc3cf2b-7563-4888-b13e-2c6e589a11d7" containerName="manager" Jun 09 07:08:44.895655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.895561 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc3cf2b-7563-4888-b13e-2c6e589a11d7" containerName="manager" Jun 09 07:08:44.895655 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.895619 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc3cf2b-7563-4888-b13e-2c6e589a11d7" containerName="manager" Jun 09 07:08:44.898414 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.898393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:44.901191 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.901164 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 07:08:44.901311 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.901192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n72cf\"" Jun 09 07:08:44.906740 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.906701 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:08:44.933949 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:44.933923 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:08:45.021058 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.021019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a4ca6988-6941-48ff-99da-4da75e19bf1b-config-file\") pod \"limitador-limitador-54d6d988d5-224kp\" (UID: \"a4ca6988-6941-48ff-99da-4da75e19bf1b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.021058 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.021053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x86mn\" (UniqueName: \"kubernetes.io/projected/a4ca6988-6941-48ff-99da-4da75e19bf1b-kube-api-access-x86mn\") pod \"limitador-limitador-54d6d988d5-224kp\" (UID: \"a4ca6988-6941-48ff-99da-4da75e19bf1b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.121474 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.121442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a4ca6988-6941-48ff-99da-4da75e19bf1b-config-file\") pod \"limitador-limitador-54d6d988d5-224kp\" (UID: \"a4ca6988-6941-48ff-99da-4da75e19bf1b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.121474 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.121478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x86mn\" (UniqueName: \"kubernetes.io/projected/a4ca6988-6941-48ff-99da-4da75e19bf1b-kube-api-access-x86mn\") pod \"limitador-limitador-54d6d988d5-224kp\" (UID: \"a4ca6988-6941-48ff-99da-4da75e19bf1b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.122093 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.122071 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a4ca6988-6941-48ff-99da-4da75e19bf1b-config-file\") pod \"limitador-limitador-54d6d988d5-224kp\" (UID: \"a4ca6988-6941-48ff-99da-4da75e19bf1b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.130418 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.130398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x86mn\" (UniqueName: \"kubernetes.io/projected/a4ca6988-6941-48ff-99da-4da75e19bf1b-kube-api-access-x86mn\") pod \"limitador-limitador-54d6d988d5-224kp\" (UID: \"a4ca6988-6941-48ff-99da-4da75e19bf1b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.209788 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.209753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:45.336735 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.336681 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:08:45.339846 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:08:45.339821 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ca6988_6941_48ff_99da_4da75e19bf1b.slice/crio-84a053b95a742669053055eb47112e16955893c823b703b7ee10b04084a2aacd WatchSource:0}: Error finding container 84a053b95a742669053055eb47112e16955893c823b703b7ee10b04084a2aacd: Status 404 returned error can't find the container with id 84a053b95a742669053055eb47112e16955893c823b703b7ee10b04084a2aacd Jun 09 07:08:45.381475 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.381444 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4sc2j"] Jun 09 07:08:45.385809 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.385786 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:45.386118 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.386089 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" event={"ID":"a4ca6988-6941-48ff-99da-4da75e19bf1b","Type":"ContainerStarted","Data":"84a053b95a742669053055eb47112e16955893c823b703b7ee10b04084a2aacd"} Jun 09 07:08:45.388199 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.388181 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nd5q5\"" Jun 09 07:08:45.391243 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.391224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4sc2j"] Jun 09 07:08:45.524212 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.524133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sprkp\" (UniqueName: \"kubernetes.io/projected/574036ba-5928-456e-8ca6-b55d63bc8b97-kube-api-access-sprkp\") pod \"authorino-58cd955675-4sc2j\" (UID: \"574036ba-5928-456e-8ca6-b55d63bc8b97\") " pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:45.624810 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.624777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sprkp\" (UniqueName: \"kubernetes.io/projected/574036ba-5928-456e-8ca6-b55d63bc8b97-kube-api-access-sprkp\") pod \"authorino-58cd955675-4sc2j\" (UID: \"574036ba-5928-456e-8ca6-b55d63bc8b97\") " pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:45.633087 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.633061 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sprkp\" (UniqueName: \"kubernetes.io/projected/574036ba-5928-456e-8ca6-b55d63bc8b97-kube-api-access-sprkp\") pod \"authorino-58cd955675-4sc2j\" (UID: \"574036ba-5928-456e-8ca6-b55d63bc8b97\") " pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:45.696932 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.696900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:45.832491 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:45.832465 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4sc2j"] Jun 09 07:08:45.835480 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:08:45.835446 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod574036ba_5928_456e_8ca6_b55d63bc8b97.slice/crio-a2f48d1e41a79f5c42010fc7feb913d3b678ca2e0d24e9fde7e9236ae8bac43f WatchSource:0}: Error finding container a2f48d1e41a79f5c42010fc7feb913d3b678ca2e0d24e9fde7e9236ae8bac43f: Status 404 returned error can't find the container with id a2f48d1e41a79f5c42010fc7feb913d3b678ca2e0d24e9fde7e9236ae8bac43f Jun 09 07:08:46.393099 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:46.393063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4sc2j" event={"ID":"574036ba-5928-456e-8ca6-b55d63bc8b97","Type":"ContainerStarted","Data":"a2f48d1e41a79f5c42010fc7feb913d3b678ca2e0d24e9fde7e9236ae8bac43f"} Jun 09 07:08:50.431064 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:50.431023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4sc2j" event={"ID":"574036ba-5928-456e-8ca6-b55d63bc8b97","Type":"ContainerStarted","Data":"4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373"} Jun 09 07:08:50.432457 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:50.432437 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" event={"ID":"a4ca6988-6941-48ff-99da-4da75e19bf1b","Type":"ContainerStarted","Data":"1f8525ab03b364eaa8c0d4373096f8bd74ab2d60d4192d3403579f581cbd2f9e"} Jun 09 07:08:50.432578 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:50.432562 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:08:50.445183 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:50.445136 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4sc2j" podStartSLOduration=1.484049462 podStartE2EDuration="5.445121288s" totalImagesPullingTime="3.961071826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:50.444575108 +0000 UTC m=+628.828844248" watchObservedRunningTime="2026-06-09 07:08:50.445121288 +0000 UTC m=+628.829390245" Jun 09 07:08:50.460239 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:50.460195 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" podStartSLOduration=2.059833127 podStartE2EDuration="6.460181606s" totalImagesPullingTime="4.400348479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:08:50.45835182 +0000 UTC m=+628.842620778" watchObservedRunningTime="2026-06-09 07:08:50.460181606 +0000 UTC m=+628.844450563" Jun 09 07:08:51.216138 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:51.216102 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4sc2j"] Jun 09 07:08:52.441200 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:52.441150 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4sc2j" podUID="574036ba-5928-456e-8ca6-b55d63bc8b97" containerName="authorino" containerID="cri-o://4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373" gracePeriod=30 Jun 09 07:08:52.689531 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:52.689507 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:52.786918 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:52.786832 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sprkp\" (UniqueName: \"kubernetes.io/projected/574036ba-5928-456e-8ca6-b55d63bc8b97-kube-api-access-sprkp\") pod \"574036ba-5928-456e-8ca6-b55d63bc8b97\" (UID: \"574036ba-5928-456e-8ca6-b55d63bc8b97\") " Jun 09 07:08:52.788966 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:52.788945 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/574036ba-5928-456e-8ca6-b55d63bc8b97-kube-api-access-sprkp" (OuterVolumeSpecName: "kube-api-access-sprkp") pod "574036ba-5928-456e-8ca6-b55d63bc8b97" (UID: "574036ba-5928-456e-8ca6-b55d63bc8b97"). InnerVolumeSpecName "kube-api-access-sprkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:08:52.888082 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:52.888046 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sprkp\" (UniqueName: \"kubernetes.io/projected/574036ba-5928-456e-8ca6-b55d63bc8b97-kube-api-access-sprkp\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:08:53.446283 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.446247 2563 generic.go:356] "Generic (PLEG): container finished" podID="574036ba-5928-456e-8ca6-b55d63bc8b97" containerID="4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373" exitCode=0 Jun 09 07:08:53.446798 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.446293 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4sc2j" Jun 09 07:08:53.446798 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.446346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4sc2j" event={"ID":"574036ba-5928-456e-8ca6-b55d63bc8b97","Type":"ContainerDied","Data":"4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373"} Jun 09 07:08:53.446798 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.446399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4sc2j" event={"ID":"574036ba-5928-456e-8ca6-b55d63bc8b97","Type":"ContainerDied","Data":"a2f48d1e41a79f5c42010fc7feb913d3b678ca2e0d24e9fde7e9236ae8bac43f"} Jun 09 07:08:53.446798 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.446424 2563 scope.go:117] "RemoveContainer" containerID="4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373" Jun 09 07:08:53.455504 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.455485 2563 scope.go:117] "RemoveContainer" containerID="4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373" Jun 09 07:08:53.455777 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:08:53.455759 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373\": container with ID starting with 4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373 not found: ID does not exist" containerID="4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373" Jun 09 07:08:53.455829 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.455785 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373"} err="failed to get container status \"4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373\": rpc error: code = NotFound desc = could not find container \"4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373\": container with ID starting with 4614846ec895607bb657d35df51e2647fd3965a584d5478151a4122dc5ecd373 not found: ID does not exist" Jun 09 07:08:53.466419 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.466396 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4sc2j"] Jun 09 07:08:53.470498 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:53.470477 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4sc2j"] Jun 09 07:08:54.082126 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:08:54.082092 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="574036ba-5928-456e-8ca6-b55d63bc8b97" path="/var/lib/kubelet/pods/574036ba-5928-456e-8ca6-b55d63bc8b97/volumes" Jun 09 07:09:01.437641 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:01.437611 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-224kp" Jun 09 07:09:41.280604 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.280571 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:09:41.281087 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.281058 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="574036ba-5928-456e-8ca6-b55d63bc8b97" containerName="authorino" Jun 09 07:09:41.281087 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.281077 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="574036ba-5928-456e-8ca6-b55d63bc8b97" containerName="authorino" Jun 09 07:09:41.281214 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.281198 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="574036ba-5928-456e-8ca6-b55d63bc8b97" containerName="authorino" Jun 09 07:09:41.284103 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.284083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:41.286682 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.286652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-khxjk\"" Jun 09 07:09:41.286801 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.286652 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 07:09:41.286801 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.286655 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 07:09:41.287540 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.287515 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 07:09:41.298499 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.298477 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:09:41.412276 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.412243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5nrw\" (UniqueName: \"kubernetes.io/projected/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca-kube-api-access-j5nrw\") pod \"maas-keycloak-0\" (UID: \"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:41.512894 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.512863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nrw\" (UniqueName: \"kubernetes.io/projected/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca-kube-api-access-j5nrw\") pod \"maas-keycloak-0\" (UID: \"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:41.521499 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.521464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5nrw\" (UniqueName: \"kubernetes.io/projected/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca-kube-api-access-j5nrw\") pod \"maas-keycloak-0\" (UID: \"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:41.593101 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.593016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:41.726457 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:41.726434 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:09:41.728743 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:09:41.728701 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a0a46f_d8a5_433b_a9f0_d19fe3ef8cca.slice/crio-d3c8e4704a055d4dba23c2583324abfe11489b59acab756a61a6f724ca224c04 WatchSource:0}: Error finding container d3c8e4704a055d4dba23c2583324abfe11489b59acab756a61a6f724ca224c04: Status 404 returned error can't find the container with id d3c8e4704a055d4dba23c2583324abfe11489b59acab756a61a6f724ca224c04 Jun 09 07:09:42.671929 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:42.671886 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca","Type":"ContainerStarted","Data":"d3c8e4704a055d4dba23c2583324abfe11489b59acab756a61a6f724ca224c04"} Jun 09 07:09:48.709066 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:48.709026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca","Type":"ContainerStarted","Data":"9daea26439438b780ee50dac6aa431b675c19fae5047c0f32361cadb2615ddba"} Jun 09 07:09:48.728245 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:48.728197 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.192998031 podStartE2EDuration="7.728180807s" totalImagesPullingTime="6.535182776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:09:48.726476735 +0000 UTC m=+687.110745693" watchObservedRunningTime="2026-06-09 07:09:48.728180807 +0000 UTC m=+687.112449764" Jun 09 07:09:49.594278 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:49.594231 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:49.595708 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:49.595665 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:50.593953 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:50.593901 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:51.593276 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:51.593184 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 07:09:51.593628 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:51.593584 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:52.593953 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:52.593904 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:53.593813 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:53.593675 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:54.594426 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:54.594379 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:55.593624 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:55.593571 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:56.593981 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:56.593932 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:57.594472 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:57.594417 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:58.594156 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:58.594116 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:09:59.593876 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:09:59.593828 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:10:00.594448 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:00.594345 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:10:01.593949 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:01.593893 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 09 07:10:02.721775 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:02.721709 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 07:10:02.740362 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:02.740305 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 07:10:12.728097 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:12.727996 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 07:10:54.318111 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.318071 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:10:54.340112 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.340080 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-z24p4"] Jun 09 07:10:54.343306 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.343288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:10:54.346024 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.346000 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 07:10:54.346126 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.346000 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sprvd\"" Jun 09 07:10:54.352887 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.352862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-z24p4"] Jun 09 07:10:54.450145 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.450109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8ff\" (UniqueName: \"kubernetes.io/projected/33cfcf86-97f1-4592-aa19-b8991a0ef6e6-kube-api-access-rc8ff\") pod \"payload-processing-7c6c859784-z24p4\" (UID: \"33cfcf86-97f1-4592-aa19-b8991a0ef6e6\") " pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:10:54.551308 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.551272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8ff\" (UniqueName: \"kubernetes.io/projected/33cfcf86-97f1-4592-aa19-b8991a0ef6e6-kube-api-access-rc8ff\") pod \"payload-processing-7c6c859784-z24p4\" (UID: \"33cfcf86-97f1-4592-aa19-b8991a0ef6e6\") " pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:10:54.558899 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.558868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8ff\" (UniqueName: \"kubernetes.io/projected/33cfcf86-97f1-4592-aa19-b8991a0ef6e6-kube-api-access-rc8ff\") pod \"payload-processing-7c6c859784-z24p4\" (UID: \"33cfcf86-97f1-4592-aa19-b8991a0ef6e6\") " pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:10:54.654126 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.654092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:10:54.785620 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.785592 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-z24p4"] Jun 09 07:10:54.787713 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:10:54.787680 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33cfcf86_97f1_4592_aa19_b8991a0ef6e6.slice/crio-7c6dfda5f3467dc3645c1b899381826dfcb124dc305b330ea917abdcfb595b1b WatchSource:0}: Error finding container 7c6dfda5f3467dc3645c1b899381826dfcb124dc305b330ea917abdcfb595b1b: Status 404 returned error can't find the container with id 7c6dfda5f3467dc3645c1b899381826dfcb124dc305b330ea917abdcfb595b1b Jun 09 07:10:54.789628 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:54.789607 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 07:10:55.031920 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:55.031837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerStarted","Data":"7c6dfda5f3467dc3645c1b899381826dfcb124dc305b330ea917abdcfb595b1b"} Jun 09 07:10:57.043896 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:57.043856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerStarted","Data":"b24dd5b460f05f0000653356b48fa177468534cd461fd2b16788dd527872d32f"} Jun 09 07:10:57.044336 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:57.043959 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:10:57.059044 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:10:57.058997 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podStartSLOduration=0.935650718 podStartE2EDuration="3.058983366s" totalImagesPullingTime="2.123332648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:10:57.057947788 +0000 UTC m=+755.442216748" watchObservedRunningTime="2026-06-09 07:10:57.058983366 +0000 UTC m=+755.443252341" Jun 09 07:11:05.262757 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:05.262705 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:11:05.263154 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:05.262924 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" containerID="cri-o://9daea26439438b780ee50dac6aa431b675c19fae5047c0f32361cadb2615ddba" gracePeriod=30 Jun 09 07:11:07.089340 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:07.089257 2563 generic.go:356] "Generic (PLEG): container finished" podID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerID="9daea26439438b780ee50dac6aa431b675c19fae5047c0f32361cadb2615ddba" exitCode=143 Jun 09 07:11:07.089340 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:07.089329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca","Type":"ContainerDied","Data":"9daea26439438b780ee50dac6aa431b675c19fae5047c0f32361cadb2615ddba"} Jun 09 07:11:07.301279 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:07.301253 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:07.463946 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:07.463918 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5nrw\" (UniqueName: \"kubernetes.io/projected/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca-kube-api-access-j5nrw\") pod \"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca\" (UID: \"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca\") " Jun 09 07:11:07.466219 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:07.466195 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca-kube-api-access-j5nrw" (OuterVolumeSpecName: "kube-api-access-j5nrw") pod "53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" (UID: "53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca"). InnerVolumeSpecName "kube-api-access-j5nrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:11:07.564934 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:07.564903 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5nrw\" (UniqueName: \"kubernetes.io/projected/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca-kube-api-access-j5nrw\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:11:08.050523 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.050492 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:11:08.096010 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.095978 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.096370 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.095986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca","Type":"ContainerDied","Data":"d3c8e4704a055d4dba23c2583324abfe11489b59acab756a61a6f724ca224c04"} Jun 09 07:11:08.096370 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.096117 2563 scope.go:117] "RemoveContainer" containerID="9daea26439438b780ee50dac6aa431b675c19fae5047c0f32361cadb2615ddba" Jun 09 07:11:08.111469 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.111445 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:11:08.117644 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.117618 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:11:08.139010 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.138984 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:11:08.139295 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.139283 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" Jun 09 07:11:08.139340 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.139297 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" Jun 09 07:11:08.139375 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.139356 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" containerName="keycloak" Jun 09 07:11:08.142188 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.142172 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.144622 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.144594 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 07:11:08.144742 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.144624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 07:11:08.144742 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.144637 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 07:11:08.144742 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.144624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 07:11:08.144742 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.144624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-khxjk\"" Jun 09 07:11:08.152260 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.152239 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:11:08.270880 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.270845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9nz\" (UniqueName: \"kubernetes.io/projected/10484392-9730-42f8-bfba-174de44ce149-kube-api-access-nk9nz\") pod \"maas-keycloak-0\" (UID: \"10484392-9730-42f8-bfba-174de44ce149\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.271040 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.270913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/10484392-9730-42f8-bfba-174de44ce149-test-realms\") pod \"maas-keycloak-0\" (UID: \"10484392-9730-42f8-bfba-174de44ce149\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.371618 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.371541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/10484392-9730-42f8-bfba-174de44ce149-test-realms\") pod \"maas-keycloak-0\" (UID: \"10484392-9730-42f8-bfba-174de44ce149\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.371618 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.371606 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9nz\" (UniqueName: \"kubernetes.io/projected/10484392-9730-42f8-bfba-174de44ce149-kube-api-access-nk9nz\") pod \"maas-keycloak-0\" (UID: \"10484392-9730-42f8-bfba-174de44ce149\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.372251 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.372233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/10484392-9730-42f8-bfba-174de44ce149-test-realms\") pod \"maas-keycloak-0\" (UID: \"10484392-9730-42f8-bfba-174de44ce149\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.386265 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.386232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9nz\" (UniqueName: \"kubernetes.io/projected/10484392-9730-42f8-bfba-174de44ce149-kube-api-access-nk9nz\") pod \"maas-keycloak-0\" (UID: \"10484392-9730-42f8-bfba-174de44ce149\") " pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.451774 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.451751 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:08.585275 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:08.585248 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 07:11:08.587543 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:11:08.587516 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10484392_9730_42f8_bfba_174de44ce149.slice/crio-a9d051c191081920ccda80b81359acad91cb0d446cf48271d740e30504c2667d WatchSource:0}: Error finding container a9d051c191081920ccda80b81359acad91cb0d446cf48271d740e30504c2667d: Status 404 returned error can't find the container with id a9d051c191081920ccda80b81359acad91cb0d446cf48271d740e30504c2667d Jun 09 07:11:09.103249 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:09.103209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"10484392-9730-42f8-bfba-174de44ce149","Type":"ContainerStarted","Data":"3f92a8882bbd5fa0ac63d9dd26a159bc40f6e267862341b8fc6be2a9fac3633d"} Jun 09 07:11:09.103694 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:09.103270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"10484392-9730-42f8-bfba-174de44ce149","Type":"ContainerStarted","Data":"a9d051c191081920ccda80b81359acad91cb0d446cf48271d740e30504c2667d"} Jun 09 07:11:09.122812 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:09.122766 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.781137732 podStartE2EDuration="1.122750208s" totalImagesPullingTime="341.612476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:11:09.120603639 +0000 UTC m=+767.504872599" watchObservedRunningTime="2026-06-09 07:11:09.122750208 +0000 UTC m=+767.507019165" Jun 09 07:11:09.452563 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:09.452533 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:09.453846 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:09.453809 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:10.085567 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:10.085520 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca" path="/var/lib/kubelet/pods/53a0a46f-d8a5-433b-a9f0-d19fe3ef8cca/volumes" Jun 09 07:11:10.452205 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:10.452159 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:11.452848 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:11.452799 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:12.452671 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:12.452617 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:13.452565 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:13.452523 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:14.452502 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:14.452447 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:15.452749 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:15.452258 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:16.452941 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:16.452884 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:17.452930 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:17.452883 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:18.451946 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:18.451899 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:18.452359 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:18.452156 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:19.452692 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:19.452645 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:20.452504 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:20.452448 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:21.452472 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:21.452428 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jun 09 07:11:22.574077 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:22.574042 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:22.593083 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:22.593032 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="10484392-9730-42f8-bfba-174de44ce149" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 07:11:32.581178 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:32.581142 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 07:11:54.541248 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:11:54.541155 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:12:11.058499 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:11.058459 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:12:22.038845 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:22.038815 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:12:33.040733 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:33.040695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:12:42.471103 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.471056 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d"] Jun 09 07:12:42.474582 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.474561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.477276 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.477239 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 07:12:42.477276 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.477250 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 07:12:42.477473 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.477281 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f84rz\"" Jun 09 07:12:42.477473 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.477249 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 07:12:42.495154 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.495128 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d"] Jun 09 07:12:42.595088 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.595048 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.595277 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.595094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.595277 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.595132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.595277 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.595201 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkjpq\" (UniqueName: \"kubernetes.io/projected/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-kube-api-access-qkjpq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.595277 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.595263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.595434 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.595284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696150 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696150 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696153 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696396 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696396 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjpq\" (UniqueName: \"kubernetes.io/projected/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-kube-api-access-qkjpq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696396 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696568 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696410 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696632 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696632 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.696789 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.696685 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.698700 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.698675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.699018 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.698999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.704517 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.704487 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkjpq\" (UniqueName: \"kubernetes.io/projected/bfc5163f-7e37-4d1b-bd75-5d94df53c7e1-kube-api-access-qkjpq\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ct42d\" (UID: \"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.785759 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.785635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" Jun 09 07:12:42.923206 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:42.923180 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d"] Jun 09 07:12:42.925959 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:12:42.925929 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc5163f_7e37_4d1b_bd75_5d94df53c7e1.slice/crio-5752c8b40b000b301d83175008739b3793ce8f948a6b5629d7e1abc2f369156b WatchSource:0}: Error finding container 5752c8b40b000b301d83175008739b3793ce8f948a6b5629d7e1abc2f369156b: Status 404 returned error can't find the container with id 5752c8b40b000b301d83175008739b3793ce8f948a6b5629d7e1abc2f369156b Jun 09 07:12:43.342746 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:43.342690 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:12:43.553250 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:43.553212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" event={"ID":"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1","Type":"ContainerStarted","Data":"5752c8b40b000b301d83175008739b3793ce8f948a6b5629d7e1abc2f369156b"} Jun 09 07:12:46.569768 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:46.569728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ct42d" event={"ID":"bfc5163f-7e37-4d1b-bd75-5d94df53c7e1","Type":"ContainerStarted","Data":"41018563d43b8cc90860c9a4ad54d32550dade3279923e45f1c2b40ba8938674"} Jun 09 07:12:57.619360 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:57.619327 2563 generic.go:356] "Generic (PLEG): container finished" podID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" containerID="b24dd5b460f05f0000653356b48fa177468534cd461fd2b16788dd527872d32f" exitCode=1 Jun 09 07:12:57.619783 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:57.619406 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerDied","Data":"b24dd5b460f05f0000653356b48fa177468534cd461fd2b16788dd527872d32f"} Jun 09 07:12:57.619834 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:57.619786 2563 scope.go:117] "RemoveContainer" containerID="b24dd5b460f05f0000653356b48fa177468534cd461fd2b16788dd527872d32f" Jun 09 07:12:58.050025 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:58.049994 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:12:58.626978 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:58.626941 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerStarted","Data":"363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d"} Jun 09 07:12:58.627449 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:12:58.627033 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:13:09.633630 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:13:09.633540 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:13:10.339382 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:13:10.339344 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-224kp"] Jun 09 07:13:22.057768 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:13:22.057739 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:13:22.058868 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:13:22.058844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:13:22.064084 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:13:22.064064 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 07:13:22.065248 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:13:22.065227 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4tb7h_a7b5b010-2f48-4d7f-8975-6812c6a01527/ovn-acl-logging/0.log" Jun 09 07:14:58.176247 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:14:58.176215 2563 generic.go:356] "Generic (PLEG): container finished" podID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" containerID="363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d" exitCode=1 Jun 09 07:14:58.176682 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:14:58.176283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerDied","Data":"363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d"} Jun 09 07:14:58.176682 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:14:58.176350 2563 scope.go:117] "RemoveContainer" containerID="b24dd5b460f05f0000653356b48fa177468534cd461fd2b16788dd527872d32f" Jun 09 07:14:58.176682 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:14:58.176653 2563 scope.go:117] "RemoveContainer" containerID="363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d" Jun 09 07:14:58.176914 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:14:58.176887 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-z24p4_openshift-ingress(33cfcf86-97f1-4592-aa19-b8991a0ef6e6)\"" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podUID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" Jun 09 07:14:59.631970 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:14:59.631935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:14:59.632350 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:14:59.632316 2563 scope.go:117] "RemoveContainer" containerID="363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d" Jun 09 07:14:59.632513 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:14:59.632493 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-z24p4_openshift-ingress(33cfcf86-97f1-4592-aa19-b8991a0ef6e6)\"" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podUID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" Jun 09 07:15:00.142496 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.142466 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683155-vj4wh"] Jun 09 07:15:00.147017 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.147001 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:00.149535 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.149512 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6q8nm\"" Jun 09 07:15:00.153870 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.153825 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683155-vj4wh"] Jun 09 07:15:00.175823 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.175797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v9hf\" (UniqueName: \"kubernetes.io/projected/a9eeafa6-4e98-46ba-bea8-977d5a325799-kube-api-access-5v9hf\") pod \"maas-api-key-cleanup-29683155-vj4wh\" (UID: \"a9eeafa6-4e98-46ba-bea8-977d5a325799\") " pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:00.277142 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.277111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9hf\" (UniqueName: \"kubernetes.io/projected/a9eeafa6-4e98-46ba-bea8-977d5a325799-kube-api-access-5v9hf\") pod \"maas-api-key-cleanup-29683155-vj4wh\" (UID: \"a9eeafa6-4e98-46ba-bea8-977d5a325799\") " pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:00.285946 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.285917 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v9hf\" (UniqueName: \"kubernetes.io/projected/a9eeafa6-4e98-46ba-bea8-977d5a325799-kube-api-access-5v9hf\") pod \"maas-api-key-cleanup-29683155-vj4wh\" (UID: \"a9eeafa6-4e98-46ba-bea8-977d5a325799\") " pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:00.458713 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.458680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:00.590885 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:00.590860 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683155-vj4wh"] Jun 09 07:15:00.592711 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:15:00.592684 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9eeafa6_4e98_46ba_bea8_977d5a325799.slice/crio-9af97949caf2e1a5e1a6f7b1de55ea16f68a292e77a5e4dd96003a425109b659 WatchSource:0}: Error finding container 9af97949caf2e1a5e1a6f7b1de55ea16f68a292e77a5e4dd96003a425109b659: Status 404 returned error can't find the container with id 9af97949caf2e1a5e1a6f7b1de55ea16f68a292e77a5e4dd96003a425109b659 Jun 09 07:15:01.192235 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:01.192200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" event={"ID":"a9eeafa6-4e98-46ba-bea8-977d5a325799","Type":"ContainerStarted","Data":"9af97949caf2e1a5e1a6f7b1de55ea16f68a292e77a5e4dd96003a425109b659"} Jun 09 07:15:03.202822 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:03.202782 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" event={"ID":"a9eeafa6-4e98-46ba-bea8-977d5a325799","Type":"ContainerStarted","Data":"bac7b380486af5aa5a9c0d583007923087d07ccb2ac867b366881bc9b55e09de"} Jun 09 07:15:03.218161 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:03.218105 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" podStartSLOduration=1.144522593 podStartE2EDuration="3.218089315s" totalImagesPullingTime="2.073566722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:15:03.217408306 +0000 UTC m=+1001.601677276" watchObservedRunningTime="2026-06-09 07:15:03.218089315 +0000 UTC m=+1001.602358272" Jun 09 07:15:04.209108 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:04.209071 2563 generic.go:356] "Generic (PLEG): container finished" podID="a9eeafa6-4e98-46ba-bea8-977d5a325799" containerID="bac7b380486af5aa5a9c0d583007923087d07ccb2ac867b366881bc9b55e09de" exitCode=0 Jun 09 07:15:04.209574 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:04.209129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" event={"ID":"a9eeafa6-4e98-46ba-bea8-977d5a325799","Type":"ContainerDied","Data":"bac7b380486af5aa5a9c0d583007923087d07ccb2ac867b366881bc9b55e09de"} Jun 09 07:15:05.341446 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:05.341422 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:05.420888 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:05.420853 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v9hf\" (UniqueName: \"kubernetes.io/projected/a9eeafa6-4e98-46ba-bea8-977d5a325799-kube-api-access-5v9hf\") pod \"a9eeafa6-4e98-46ba-bea8-977d5a325799\" (UID: \"a9eeafa6-4e98-46ba-bea8-977d5a325799\") " Jun 09 07:15:05.423195 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:05.423170 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9eeafa6-4e98-46ba-bea8-977d5a325799-kube-api-access-5v9hf" (OuterVolumeSpecName: "kube-api-access-5v9hf") pod "a9eeafa6-4e98-46ba-bea8-977d5a325799" (UID: "a9eeafa6-4e98-46ba-bea8-977d5a325799"). InnerVolumeSpecName "kube-api-access-5v9hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 07:15:05.522019 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:05.521932 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v9hf\" (UniqueName: \"kubernetes.io/projected/a9eeafa6-4e98-46ba-bea8-977d5a325799-kube-api-access-5v9hf\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jun 09 07:15:06.220520 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:06.220480 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" event={"ID":"a9eeafa6-4e98-46ba-bea8-977d5a325799","Type":"ContainerDied","Data":"9af97949caf2e1a5e1a6f7b1de55ea16f68a292e77a5e4dd96003a425109b659"} Jun 09 07:15:06.220520 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:06.220518 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683155-vj4wh" Jun 09 07:15:06.220763 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:06.220540 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9af97949caf2e1a5e1a6f7b1de55ea16f68a292e77a5e4dd96003a425109b659" Jun 09 07:15:14.654551 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:14.654513 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:15:14.654996 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:14.654896 2563 scope.go:117] "RemoveContainer" containerID="363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d" Jun 09 07:15:15.262566 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:15.262528 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerStarted","Data":"79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741"} Jun 09 07:15:15.262779 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:15.262761 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:15:26.271706 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:15:26.271674 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:16:48.666808 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:48.666774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-ct42d_bfc5163f-7e37-4d1b-bd75-5d94df53c7e1/storage-initializer/0.log" Jun 09 07:16:54.688886 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:54.688853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683155-vj4wh_a9eeafa6-4e98-46ba-bea8-977d5a325799/cleanup/0.log" Jun 09 07:16:55.291760 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:55.291714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-drm56_64d57e01-05e9-498c-a7e2-0183a65b1ee2/copy-manifests/0.log" Jun 09 07:16:55.301289 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:55.301254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-drm56_64d57e01-05e9-498c-a7e2-0183a65b1ee2/manager/0.log" Jun 09 07:16:57.014711 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:57.014680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s944t_a2beb80f-11ea-4091-87ce-8830aa4273a8/manager/0.log" Jun 09 07:16:57.365959 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:57.365883 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vxtxw_04480748-0f8d-44b9-ab6a-484bce9f21a7/manager/0.log" Jun 09 07:16:57.482572 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:57.482541 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-224kp_a4ca6988-6941-48ff-99da-4da75e19bf1b/limitador/0.log" Jun 09 07:16:58.288603 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:58.288573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757b5997cf-q7bmn_472ef781-33b7-478b-bc16-e2fbfb790f68/kube-auth-proxy/0.log" Jun 09 07:16:58.612583 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:58.612493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:16:59.530253 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:16:59.530222 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-ct42d_bfc5163f-7e37-4d1b-bd75-5d94df53c7e1/storage-initializer/0.log" Jun 09 07:17:06.969985 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:06.969956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wxd7l_362d65c3-ab95-4530-92d4-28fba22aef1c/global-pull-secret-syncer/0.log" Jun 09 07:17:07.051249 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:07.051220 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mwhnp_57ea668c-83f5-4ed4-9d0a-6120fc7e1e62/konnectivity-agent/0.log" Jun 09 07:17:07.129998 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:07.129971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-45.ec2.internal_00011cc3b51a86ab1006de7b79c39c2b/haproxy/0.log" Jun 09 07:17:12.291639 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:12.291497 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s944t_a2beb80f-11ea-4091-87ce-8830aa4273a8/manager/0.log" Jun 09 07:17:12.407189 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:12.407150 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vxtxw_04480748-0f8d-44b9-ab6a-484bce9f21a7/manager/0.log" Jun 09 07:17:12.428969 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:12.428935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-224kp_a4ca6988-6941-48ff-99da-4da75e19bf1b/limitador/0.log" Jun 09 07:17:14.494829 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.494751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-27xxv_0625d9a4-2dcc-4172-9bdf-b5d6de333f77/monitoring-plugin/0.log" Jun 09 07:17:14.536667 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.536630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zglt_124e74d1-cb47-4596-801e-fa3ffa1ab4d3/node-exporter/0.log" Jun 09 07:17:14.573463 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.573434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zglt_124e74d1-cb47-4596-801e-fa3ffa1ab4d3/kube-rbac-proxy/0.log" Jun 09 07:17:14.593550 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.593529 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zglt_124e74d1-cb47-4596-801e-fa3ffa1ab4d3/init-textfile/0.log" Jun 09 07:17:14.800995 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.800974 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fcxjk_777553d9-01b4-40fa-9ee9-5b55e2cde59b/kube-rbac-proxy-main/0.log" Jun 09 07:17:14.816784 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.816760 2563 generic.go:356] "Generic (PLEG): container finished" podID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" containerID="79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741" exitCode=1 Jun 09 07:17:14.816904 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.816820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" event={"ID":"33cfcf86-97f1-4592-aa19-b8991a0ef6e6","Type":"ContainerDied","Data":"79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741"} Jun 09 07:17:14.816904 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.816869 2563 scope.go:117] "RemoveContainer" containerID="363febd2521a8463ed141a1994ed3d61c2b476194429cf6b5c3ad98458c6394d" Jun 09 07:17:14.817166 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.817150 2563 scope.go:117] "RemoveContainer" containerID="79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741" Jun 09 07:17:14.817390 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:17:14.817369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-z24p4_openshift-ingress(33cfcf86-97f1-4592-aa19-b8991a0ef6e6)\"" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podUID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" Jun 09 07:17:14.825888 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.825871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fcxjk_777553d9-01b4-40fa-9ee9-5b55e2cde59b/kube-rbac-proxy-self/0.log" Jun 09 07:17:14.861771 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.861707 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-fcxjk_777553d9-01b4-40fa-9ee9-5b55e2cde59b/openshift-state-metrics/0.log" Jun 09 07:17:14.941583 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.941546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/prometheus/0.log" Jun 09 07:17:14.962546 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.962512 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/config-reloader/0.log" Jun 09 07:17:14.987167 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:14.987127 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/thanos-sidecar/0.log" Jun 09 07:17:15.006266 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.006242 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/kube-rbac-proxy-web/0.log" Jun 09 07:17:15.029510 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.029485 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/kube-rbac-proxy/0.log" Jun 09 07:17:15.055259 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.055197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/kube-rbac-proxy-thanos/0.log" Jun 09 07:17:15.070553 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.070531 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c918c8db-525c-4772-bc77-11558d8dc163/init-config-reloader/0.log" Jun 09 07:17:15.098685 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.098652 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pck2r_024d4bea-ae2e-4511-b7da-a74b50421531/prometheus-operator/0.log" Jun 09 07:17:15.115875 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.115853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pck2r_024d4bea-ae2e-4511-b7da-a74b50421531/kube-rbac-proxy/0.log" Jun 09 07:17:15.139330 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:15.139300 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-ntz8k_916b97f5-deed-48a5-8b97-8534f04a042e/prometheus-operator-admission-webhook/0.log" Jun 09 07:17:16.270123 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:16.270092 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:17:16.270513 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:16.270397 2563 scope.go:117] "RemoveContainer" containerID="79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741" Jun 09 07:17:16.270615 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:17:16.270586 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-z24p4_openshift-ingress(33cfcf86-97f1-4592-aa19-b8991a0ef6e6)\"" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podUID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" Jun 09 07:17:17.345842 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.345811 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/2.log" Jun 09 07:17:17.354558 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.354535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mvp64_4d69b561-1585-43ba-9900-6d3ce37343cd/console-operator/3.log" Jun 09 07:17:17.687639 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.687609 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j"] Jun 09 07:17:17.687995 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.687981 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9eeafa6-4e98-46ba-bea8-977d5a325799" containerName="cleanup" Jun 09 07:17:17.688053 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.687998 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9eeafa6-4e98-46ba-bea8-977d5a325799" containerName="cleanup" Jun 09 07:17:17.688053 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.688052 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9eeafa6-4e98-46ba-bea8-977d5a325799" containerName="cleanup" Jun 09 07:17:17.692232 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.692212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.694413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.694396 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mz9tj\"/\"kube-root-ca.crt\"" Jun 09 07:17:17.695268 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.695254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mz9tj\"/\"openshift-service-ca.crt\"" Jun 09 07:17:17.695339 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.695287 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mz9tj\"/\"default-dockercfg-97djq\"" Jun 09 07:17:17.698287 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.698252 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j"] Jun 09 07:17:17.842007 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.841973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-podres\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.842007 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.842012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-lib-modules\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.842213 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.842033 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-proc\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.842213 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.842076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hcdw\" (UniqueName: \"kubernetes.io/projected/a9613362-6c2b-4a38-a6f0-647fd5cd077e-kube-api-access-7hcdw\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.842213 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.842149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-sys\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943400 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-podres\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943400 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-lib-modules\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943400 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-proc\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943674 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hcdw\" (UniqueName: \"kubernetes.io/projected/a9613362-6c2b-4a38-a6f0-647fd5cd077e-kube-api-access-7hcdw\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943674 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-sys\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943674 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943496 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-proc\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943674 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-sys\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943674 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-lib-modules\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.943674 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.943500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9613362-6c2b-4a38-a6f0-647fd5cd077e-podres\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:17.951007 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:17.950983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hcdw\" (UniqueName: \"kubernetes.io/projected/a9613362-6c2b-4a38-a6f0-647fd5cd077e-kube-api-access-7hcdw\") pod \"perf-node-gather-daemonset-4nd2j\" (UID: \"a9613362-6c2b-4a38-a6f0-647fd5cd077e\") " pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:18.002872 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:18.002838 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:18.134734 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:18.134698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j"] Jun 09 07:17:18.137227 ip-10-0-134-45 kubenswrapper[2563]: W0609 07:17:18.137202 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9613362_6c2b_4a38_a6f0_647fd5cd077e.slice/crio-5c8b04bb4b4077919635847612756c5c21b4e27a7f00f68246d0d3f367cf6448 WatchSource:0}: Error finding container 5c8b04bb4b4077919635847612756c5c21b4e27a7f00f68246d0d3f367cf6448: Status 404 returned error can't find the container with id 5c8b04bb4b4077919635847612756c5c21b4e27a7f00f68246d0d3f367cf6448 Jun 09 07:17:18.837101 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:18.837059 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" event={"ID":"a9613362-6c2b-4a38-a6f0-647fd5cd077e","Type":"ContainerStarted","Data":"7495c51728dcffb734fadb38c0337cc4c976ac3ec00e642df7d27baf39e8af1e"} Jun 09 07:17:18.837501 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:18.837254 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:18.837501 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:18.837282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" event={"ID":"a9613362-6c2b-4a38-a6f0-647fd5cd077e","Type":"ContainerStarted","Data":"5c8b04bb4b4077919635847612756c5c21b4e27a7f00f68246d0d3f367cf6448"} Jun 09 07:17:18.853210 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:18.853137 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" podStartSLOduration=1.8531226680000001 podStartE2EDuration="1.853122668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:17:18.851676549 +0000 UTC m=+1137.235945506" watchObservedRunningTime="2026-06-09 07:17:18.853122668 +0000 UTC m=+1137.237391648" Jun 09 07:17:19.858552 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:19.858510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46vqx_ac5e6519-9520-432b-a416-d02051cc940c/dns/0.log" Jun 09 07:17:19.880643 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:19.880615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-46vqx_ac5e6519-9520-432b-a416-d02051cc940c/kube-rbac-proxy/0.log" Jun 09 07:17:20.042854 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:20.042821 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5p52_e09c4a7b-65be-42fc-b5e1-0694b9348176/dns-node-resolver/0.log" Jun 09 07:17:20.636735 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:20.636692 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vzv49_04941328-3a49-46ee-9ef6-d0845e2e2e2b/node-ca/0.log" Jun 09 07:17:21.702937 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:21.702906 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757b5997cf-q7bmn_472ef781-33b7-478b-bc16-e2fbfb790f68/kube-auth-proxy/0.log" Jun 09 07:17:21.776615 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:21.776580 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:17:21.776813 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:21.776625 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:17:22.446882 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:22.446852 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-szm5h_4a494ba6-e26a-4dfe-8209-2fd08ec72d2a/serve-healthcheck-canary/0.log" Jun 09 07:17:23.047947 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:23.047921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nl8hf_b91b97a9-ea84-457d-a070-7bb1580eee7c/kube-rbac-proxy/0.log" Jun 09 07:17:23.068284 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:23.068260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nl8hf_b91b97a9-ea84-457d-a070-7bb1580eee7c/exporter/0.log" Jun 09 07:17:23.087692 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:23.087668 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nl8hf_b91b97a9-ea84-457d-a070-7bb1580eee7c/extractor/0.log" Jun 09 07:17:24.853317 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:24.853285 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mz9tj/perf-node-gather-daemonset-4nd2j" Jun 09 07:17:25.479507 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:25.479478 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683155-vj4wh_a9eeafa6-4e98-46ba-bea8-977d5a325799/cleanup/0.log" Jun 09 07:17:25.707902 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:25.707872 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-drm56_64d57e01-05e9-498c-a7e2-0183a65b1ee2/manager/0.log" Jun 09 07:17:25.725794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:25.725768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-579b94c545-drm56_64d57e01-05e9-498c-a7e2-0183a65b1ee2/copy-manifests/0.log" Jun 09 07:17:27.621598 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:27.621559 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d96c9b794-ml2n9_06a02b51-287c-482d-ae75-ad874fef2db8/manager/0.log" Jun 09 07:17:30.076587 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:30.076554 2563 scope.go:117] "RemoveContainer" containerID="79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741" Jun 09 07:17:30.076995 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:17:30.076802 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-z24p4_openshift-ingress(33cfcf86-97f1-4592-aa19-b8991a0ef6e6)\"" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podUID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" Jun 09 07:17:32.725829 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:32.725798 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757b5997cf-q7bmn_472ef781-33b7-478b-bc16-e2fbfb790f68/kube-auth-proxy/0.log" Jun 09 07:17:32.785194 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:32.785140 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:17:32.785395 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:32.785253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:17:33.470678 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:33.470645 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-vcv4j_5d147ec9-eb1c-4142-818c-b4bce264e590/kube-storage-version-migrator-operator/1.log" Jun 09 07:17:33.472243 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:33.472221 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-vcv4j_5d147ec9-eb1c-4142-818c-b4bce264e590/kube-storage-version-migrator-operator/0.log" Jun 09 07:17:34.124694 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.124661 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757b5997cf-q7bmn_472ef781-33b7-478b-bc16-e2fbfb790f68/kube-auth-proxy/0.log" Jun 09 07:17:34.177853 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.177827 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:17:34.178040 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.177865 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-z24p4_33cfcf86-97f1-4592-aa19-b8991a0ef6e6/payload-processing/2.log" Jun 09 07:17:34.655081 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.655047 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" Jun 09 07:17:34.655413 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.655399 2563 scope.go:117] "RemoveContainer" containerID="79e6cde3a44a7ed022e6d097e64f04ce44ae375909631fd350fc01e87d836741" Jun 09 07:17:34.655623 ip-10-0-134-45 kubenswrapper[2563]: E0609 07:17:34.655603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-z24p4_openshift-ingress(33cfcf86-97f1-4592-aa19-b8991a0ef6e6)\"" pod="openshift-ingress/payload-processing-7c6c859784-z24p4" podUID="33cfcf86-97f1-4592-aa19-b8991a0ef6e6" Jun 09 07:17:34.930830 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.930757 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/kube-multus-additional-cni-plugins/0.log" Jun 09 07:17:34.951560 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.951536 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/egress-router-binary-copy/0.log" Jun 09 07:17:34.973993 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.973970 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/cni-plugins/0.log" Jun 09 07:17:34.993957 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:34.993931 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/bond-cni-plugin/0.log" Jun 09 07:17:35.013794 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:35.013769 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/routeoverride-cni/0.log" Jun 09 07:17:35.033435 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:35.033412 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/whereabouts-cni-bincopy/0.log" Jun 09 07:17:35.053712 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:35.053686 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dckzw_c9303e23-a282-45e9-b9a9-b1a5192d9077/whereabouts-cni/0.log" Jun 09 07:17:35.277545 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:35.277473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lncfj_8d709ef3-34af-4568-98d4-6d3c78c54a80/kube-multus/0.log" Jun 09 07:17:35.386802 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:35.386775 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r4btx_a7882294-ab8a-44f8-9275-e2b7a5204700/network-metrics-daemon/0.log" Jun 09 07:17:35.407963 ip-10-0-134-45 kubenswrapper[2563]: I0609 07:17:35.407929 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r4btx_a7882294-ab8a-44f8-9275-e2b7a5204700/kube-rbac-proxy/0.log"